-- Logs begin at Mon 2022-07-18 01:36:06 UTC, end at Mon 2022-07-18 02:55:12 UTC. -- Jul 18 02:15:14.912573 dv-cinder-850015-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 18 02:15:14.924034 dv-cinder-850015-3-smb devstack@keystone.service[80345]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 18 02:15:14.926165 dv-cinder-850015-3-smb devstack@keystone.service[80345]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 02:15:14 2022] *** Jul 18 02:15:14.926165 dv-cinder-850015-3-smb devstack@keystone.service[80345]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 02:15:14.926165 dv-cinder-850015-3-smb devstack@keystone.service[80345]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 02:15:14.926165 dv-cinder-850015-3-smb devstack@keystone.service[80345]: nodename: dv-cinder-850015-3-smb Jul 18 02:15:14.926165 dv-cinder-850015-3-smb devstack@keystone.service[80345]: machine: x86_64 Jul 18 02:15:14.926165 dv-cinder-850015-3-smb devstack@keystone.service[80345]: clock source: unix Jul 18 02:15:14.926165 dv-cinder-850015-3-smb devstack@keystone.service[80345]: pcre jit disabled Jul 18 02:15:14.926165 dv-cinder-850015-3-smb devstack@keystone.service[80345]: detected number of CPU cores: 4 Jul 18 02:15:14.926165 dv-cinder-850015-3-smb devstack@keystone.service[80345]: current working directory: / Jul 18 02:15:14.926165 dv-cinder-850015-3-smb devstack@keystone.service[80345]: detected binary path: /usr/bin/uwsgi-core Jul 18 02:15:14.926843 dv-cinder-850015-3-smb devstack@keystone.service[80345]: your processes number limit is 47680 Jul 18 02:15:14.926843 dv-cinder-850015-3-smb devstack@keystone.service[80345]: your memory page size is 4096 bytes Jul 18 02:15:14.926843 dv-cinder-850015-3-smb devstack@keystone.service[80345]: detected max file descriptor number: 2048 Jul 18 02:15:14.926843 dv-cinder-850015-3-smb devstack@keystone.service[80345]: lock engine: pthread robust mutexes Jul 18 02:15:14.926843 dv-cinder-850015-3-smb devstack@keystone.service[80345]: thunder lock: enabled Jul 18 02:15:14.926843 dv-cinder-850015-3-smb devstack@keystone.service[80345]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 18 02:15:14.926843 dv-cinder-850015-3-smb devstack@keystone.service[80345]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 02:15:14.967214 dv-cinder-850015-3-smb devstack@keystone.service[80345]: Python main interpreter initialized at 0x5622866fa9c0 Jul 18 02:15:14.967214 dv-cinder-850015-3-smb devstack@keystone.service[80345]: python threads support enabled Jul 18 02:15:14.967214 dv-cinder-850015-3-smb devstack@keystone.service[80345]: your server socket listen backlog is limited to 100 connections Jul 18 02:15:14.967214 dv-cinder-850015-3-smb devstack@keystone.service[80345]: your mercy for graceful operations on workers is 90 seconds Jul 18 02:15:14.967527 dv-cinder-850015-3-smb devstack@keystone.service[80345]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 02:15:14.967626 dv-cinder-850015-3-smb devstack@keystone.service[80345]: *** Operational MODE: preforking *** Jul 18 02:15:14.967895 dv-cinder-850015-3-smb devstack@keystone.service[80345]: *** uWSGI is running in multiple interpreter mode *** Jul 18 02:15:14.967895 dv-cinder-850015-3-smb devstack@keystone.service[80345]: spawned uWSGI master process (pid: 80345) Jul 18 02:15:14.968089 dv-cinder-850015-3-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 18 02:15:14.971725 dv-cinder-850015-3-smb devstack@keystone.service[80345]: spawned uWSGI worker 1 (pid: 80357, cores: 1) Jul 18 02:15:14.971725 dv-cinder-850015-3-smb devstack@keystone.service[80345]: spawned uWSGI worker 2 (pid: 80358, cores: 1) Jul 18 02:15:14.971725 dv-cinder-850015-3-smb devstack@keystone.service[80345]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 02:15:20.419291 dv-cinder-850015-3-smb devstack@keystone.service[80357]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 02:15:20.419291 dv-cinder-850015-3-smb devstack@keystone.service[80357]: from cryptography.utils import int_from_bytes Jul 18 02:15:20.420020 dv-cinder-850015-3-smb devstack@keystone.service[80357]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 02:15:20.420020 dv-cinder-850015-3-smb devstack@keystone.service[80357]: from cryptography.utils import int_from_bytes Jul 18 02:15:20.420125 dv-cinder-850015-3-smb devstack@keystone.service[80358]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 02:15:20.420125 dv-cinder-850015-3-smb devstack@keystone.service[80358]: from cryptography.utils import int_from_bytes Jul 18 02:15:20.420125 dv-cinder-850015-3-smb devstack@keystone.service[80358]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 02:15:20.420125 dv-cinder-850015-3-smb devstack@keystone.service[80358]: from cryptography.utils import int_from_bytes Jul 18 02:15:20.469295 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 02:15:20.469463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 02:15:20.469554 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 02:15:20.469648 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 02:15:20.469755 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] command line args: [] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 02:15:20.469844 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] command line args: [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 02:15:20.469959 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 02:15:20.470112 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 02:15:20.470191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ================================================================================ {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 02:15:20.470298 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ================================================================================ {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 02:15:20.470391 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] admin_token = **** {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.470558 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] admin_token = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.470638 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] config_dir = [] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.470796 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.470882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] config_dir = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.470986 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] config_source = [] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.471074 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.471154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] debug = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.471227 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] config_source = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.471340 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] debug = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.471427 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.471621 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.471715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.471782 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.471919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.471998 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.472115 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.472198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.472445 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.472527 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.472684 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] list_limit = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.472773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] list_limit = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.472883 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] log_config_append = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.472958 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] log_config_append = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.473051 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.473130 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.473236 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] log_dir = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.473310 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] log_dir = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.473382 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] log_file = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.473443 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] log_file = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.473620 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.473737 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.473900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.473982 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.474152 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.474242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.474402 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.474535 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.474613 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.474737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.474737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.474929 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.475005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.475127 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.475225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.475315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.475464 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.475591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.475699 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.475778 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.475936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.476068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.476174 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.476261 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.476422 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.476512 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.476671 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.476758 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.476947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.477028 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.477440 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.477521 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.477727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] publish_errors = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.477818 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] publish_errors = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.477938 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.478026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.478106 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.478178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.478248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.478363 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.478492 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.478591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.478732 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.478818 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.478968 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] standard_threads = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.479056 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] standard_threads = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.479204 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.479289 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.479448 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.479531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.479628 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.479717 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.479791 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] use_journal = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.479907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] use_journal = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.479990 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] use_json = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.480063 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] use_json = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.480133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] use_stderr = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.480278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] use_stderr = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.480354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] use_syslog = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.480431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] use_syslog = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.480509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.480581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 02:15:20.480755 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.480844 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.480996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.481075 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.481259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.481338 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.481501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.481593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.481770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.481852 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.482014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.482095 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.482266 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.482353 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.482502 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.482587 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.482752 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.482838 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.483002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.483092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.483254 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.483340 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.483493 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.483577 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.483741 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.483838 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.483981 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.484069 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.484228 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.484306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.484480 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.484570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.484717 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.484802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.484975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.485054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.485230 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.485316 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.485479 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.485558 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.485733 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.485825 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.485996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.486078 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.486261 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.486346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.486519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.486596 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.486768 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.486853 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.487004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.487103 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.487247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.487365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.487483 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.487573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.487716 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.487793 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.487997 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.488074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.488253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.488334 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.488487 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.488564 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.488721 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.488806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.488969 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.489048 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.489220 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.489298 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.489457 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.489533 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.489739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.489821 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.489968 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.490057 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.490210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.490299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.490448 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.490528 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.490681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.490750 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.490914 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.490989 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.491142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.491217 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.491477 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.491594 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.491594 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.491807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.491914 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.491990 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.492127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.492213 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.492333 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.492409 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.492506 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.492628 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.492744 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.492913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.493028 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.493156 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.493238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.493435 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.493526 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.493670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.493778 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.493932 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.494012 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.494174 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.494263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.494413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.494507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.494650 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.494729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.494886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.494967 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.495137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.495224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.495374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.495450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.495614 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.495701 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.495848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.495943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.496109 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.496189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.496348 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.496470 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.496582 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.496740 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.496820 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.497009 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.497099 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.497251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.497338 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.497517 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.497595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.497819 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.497982 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.498058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.498129 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.498296 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.498375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.498535 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.498623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.498775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.498853 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.499024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.499102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.499267 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.499360 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.499507 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.499596 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.499753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.499839 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.499993 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.500072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.500233 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.500314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.500471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.500581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.500711 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.500839 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.500949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.501103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.501213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.501359 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.501445 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.501626 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.501738 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.501934 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.502013 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.502180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.502269 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.502431 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.502519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.502673 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.502753 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.502914 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.502993 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.503148 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.503239 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.503383 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.504076 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.504166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.504238 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.504372 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.504465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.504605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.504684 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.504847 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.504926 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.505084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.505176 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.505336 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.505416 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.505576 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.505655 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.505856 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.505949 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.506121 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.506202 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.506366 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.506445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.506603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] auth.external = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.506729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.506837 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.507141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.507220 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.507378 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.507456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.507612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] auth.password = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.507720 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] auth.external = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.507846 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] auth.token = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.507929 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.508088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.508175 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.508327 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.508407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.508578 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.508660 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] auth.password = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.508815 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] auth.token = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.508895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.509060 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.509139 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.509300 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.509381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.509529 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.509608 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.509801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] credential.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.509887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.510055 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.510136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.510306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.510384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.510546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.510625 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.510786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.510866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] credential.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.511035 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.511115 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.511274 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.511354 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.511532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.511612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.511778 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.511857 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.512014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.512101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.512257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.512345 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.512531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.512619 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.512775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.512853 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.513018 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.513100 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.513269 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.513348 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.513526 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.513606 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.513784 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] federation.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.513869 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.514027 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.514107 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.514276 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.514356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.514527 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.514608 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.514760 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.514839 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.515007 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.515095 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.515248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.515329 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.515502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.515581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.515736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.515823 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.515984 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.516064 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.516220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.516298 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.516468 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.516560 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.516706 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.516786 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.516956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.517042 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.517197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.517283 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.517436 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.517515 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.517674 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.517811 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.517948 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.518040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.518185 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.518264 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.518424 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.518503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.518660 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.518746 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.518913 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.518992 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.519198 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.519804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.519945 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.520038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.520188 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.520307 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.520454 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.520549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.520677 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.520766 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.520922 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.521001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.521158 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.521236 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.521412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.521500 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.521718 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.521809 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.521930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.522020 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.522170 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.522258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.522405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.522485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.522653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.522734 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.522888 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.522977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.523126 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.523205 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.523406 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.523484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.523652 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.523740 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.523892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.523972 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.524135 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.524214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.524404 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.524484 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.524655 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.524735 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.524894 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.524975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.525145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.525226 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.525398 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.525477 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.525634 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.525769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.525901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.525983 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.526137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.526216 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.526379 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.526459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.526620 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.526702 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.526866 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.526945 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.527101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.527179 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.527339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.527420 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.527582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.527660 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.527832 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.527948 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.528055 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.528153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.528281 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.528362 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.528531 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.528611 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.528780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.528862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.529015 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.529094 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.529251 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.529328 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.529494 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.529616 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.529745 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.529848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.529997 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.530090 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.530240 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.530333 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.530477 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.530556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.530711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.530792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.530961 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.531052 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.531206 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.531285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.531444 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.531524 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.531677 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.531758 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.531911 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.531992 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.532148 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.532228 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.532386 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.532468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.532618 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.532699 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.532857 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.532936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.533103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.533184 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.533346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.533424 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.533580 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.533658 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.533852 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.533934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.534087 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.534167 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.534336 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.534415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.534577 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.534658 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.534845 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.534925 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.535085 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.535165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.535324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.535405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.535565 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.535649 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.535811 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.535889 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.536051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.536131 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.536293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.536372 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.536523 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.536601 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.536770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.536852 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.537011 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.537089 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.537248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.537328 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.537487 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.537568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.537752 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.537839 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.537999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.538077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.538233 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.538314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.538472 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.538551 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.538713 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] resource.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.538800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.538959 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.539039 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.539200 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.539278 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.539434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.539513 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.539678 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.539758 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.539925 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.540003 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.540161 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.540249 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.540406 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.540485 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.540642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.540721 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.540883 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.540971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.541120 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] role.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.541200 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.541369 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.541448 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] role.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.541601 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.541688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.541874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.541954 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.542117 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] role.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.542197 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.542364 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.542454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] role.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.542600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.542679 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.542855 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.542934 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.543101 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.543188 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.543356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.543469 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.543602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.543682 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.543838 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.543926 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.544087 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.544167 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.544336 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.544414 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.544583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.544671 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.544821 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.544899 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.545076 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.545216 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.545331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.545458 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.545592 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.545734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.545871 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.545987 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.546241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.546331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.546494 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.546574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.546734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.546813 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.546986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.547066 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.547242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.547321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.547482 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.547560 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.547721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.547802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.547958 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.548037 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.548193 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.548273 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.548447 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.548527 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.548682 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.548760 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.548920 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.548998 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.549159 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.549240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.549395 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.549473 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.549629 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.549726 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.549903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] token.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.549985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.550144 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.550222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.550418 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.550496 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.550656 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.550735 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.550898 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] token.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.550975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.551143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.551222 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.551382 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.551461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.551630 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.551709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.551876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.551956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.552127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.552208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.552367 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.552446 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.552607 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.552686 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.552844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.552926 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.553344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.553430 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.553588 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.553665 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.553842 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.553923 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.554089 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.554170 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.554339 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.554417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.554597 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.554679 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.connection = **** {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.554837 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.554926 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.555094 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.555174 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.555351 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.555438 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.555595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.555675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.connection = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.555835 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.555925 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.556078 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.556159 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.556319 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.556475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.556551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.556622 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.556794 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.556873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.557041 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.557129 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.557281 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.557359 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.557517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.557594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.557792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.557888 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.558037 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.558116 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.558282 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.558360 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.558517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.558605 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.558761 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.558841 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.559000 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.559086 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.559160 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80357) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 02:15:20.559240 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.559468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.559715 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.559959 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 02:15:20.560136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80358) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 02:15:20.590551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.590783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.590972 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.591056 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.591214 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.591450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.599922 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.600387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.628666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.628903 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.630221 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.630456 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.771075 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.771473 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.821058 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.821175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.821298 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.821383 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.885717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.885959 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.886088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.886189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.886268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.886397 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.886481 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.886612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.886693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.886830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.886922 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.887043 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.912230 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.912359 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.912442 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.912578 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.912672 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.912810 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.912893 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.913038 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.913124 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.913260 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.913344 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.913476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.913566 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.913691 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.924678 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.924903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.938239 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.938458 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.938559 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.938692 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.938775 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.938919 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.939002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.939139 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.939222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.939354 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.939435 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.939567 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.939656 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80358) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.939784 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80357) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 02:15:20.957280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.957491 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 02:15:20.957750 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.957868 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.957967 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 02:15:20.958076 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 02:15:20.958292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.958373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.958497 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 02:15:20.958587 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.958768 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.958850 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.959032 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.959114 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.959294 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.959554 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.970218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.970500 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.970699 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.970801 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.970979 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.971063 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.971251 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.971531 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.979303 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:20.979802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:20.982645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:20.982931 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.983107 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:20.983223 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.983387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.983623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.983706 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.983916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.984051 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.984185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.984340 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.984465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.984607 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.984748 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.984883 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.985027 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.985159 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.985307 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.985433 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.985582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.985740 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:20.986008 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.012876 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.013090 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.014534 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.014737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.014833 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.015014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.020643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.020903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.020985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.021223 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.021315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.021468 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.028571 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.028804 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.028887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.029087 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.033494 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.033741 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.033838 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.034032 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.034123 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.034321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.034402 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.034608 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.034689 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.035238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.035371 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.035371 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.035502 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.035574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.035646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.035754 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.055047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.055164 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.055329 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.055444 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.059896 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.059996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.063690 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.063795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.063990 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.064081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.069075 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.069160 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.072714 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.072798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.076484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.076569 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.076786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.076868 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.077073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.077167 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.077359 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.077443 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.077656 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.077764 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.077972 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.078054 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.097468 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.097564 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.097873 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.097958 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.098149 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.098230 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.098413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.098494 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.106363 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.106447 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.108066 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.108147 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.108344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.108437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.111411 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.111496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.111715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.111796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.112007 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.112100 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.112292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.112374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.112571 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.112659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.126601 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.126758 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.126884 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.127046 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.127167 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.127334 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.127449 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.127620 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.127729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.127910 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.127999 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.128211 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.128291 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.128525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.148199 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.148533 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.151529 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.151862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.154885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.155210 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.156500 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.156848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.158172 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.158454 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.158544 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.158741 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.158847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.159064 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.166724 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.167090 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.168340 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.168711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.171648 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.171942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.172088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.172206 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.172381 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.172465 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.172671 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.172954 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.182053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.182339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.182553 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.182638 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.182845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.183132 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.190497 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80357) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.190778 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.191056 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80358) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 02:15:21.191141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.191342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.191440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.191624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.191707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.191904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.191986 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.192176 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.192267 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.192442 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.192525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.192711 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.192793 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.192991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.193074 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.193280 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.193361 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.193551 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.193640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.193838 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.193932 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.194106 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80357) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.194189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.194380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.194662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80358) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 02:15:21.233054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5622866fa9c0 pid: 80357 (default app) Jul 18 02:15:21.233550 dv-cinder-850015-3-smb devstack@keystone.service[80358]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5622866fa9c0 pid: 80358 (default app) Jul 18 02:15:21.236423 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155930e-a4d2-400c-b645-4a90d96f2dee None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:21.236721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155930e-a4d2-400c-b645-4a90d96f2dee None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:21.237004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155930e-a4d2-400c-b645-4a90d96f2dee None None] PATH_INFO: `/v3` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:21.241283 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 791 bytes} [Mon Jul 18 02:15:21 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:29.864516 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60d063-b6d3-4f8e-9cd5-68d87cec0a05 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:29.865076 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60d063-b6d3-4f8e-9cd5-68d87cec0a05 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:29.865076 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee60d063-b6d3-4f8e-9cd5-68d87cec0a05 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:29.869579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:29.875240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ff20b-a985-4fd2-bab6-d68381e3fb71 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:29.875643 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ff20b-a985-4fd2-bab6-d68381e3fb71 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:29.875799 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ff20b-a985-4fd2-bab6-d68381e3fb71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:29.944605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: INFO dbcounter [None req-8d3ff20b-a985-4fd2-bab6-d68381e3fb71 None None] Registered counter for database keystone Jul 18 02:15:29.965534 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG oslo_db.sqlalchemy.engines [None req-8d3ff20b-a985-4fd2-bab6-d68381e3fb71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80357) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:15:29.971727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writer thread running {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:15:30.164645 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG passlib.handlers.bcrypt [None req-8d3ff20b-a985-4fd2-bab6-d68381e3fb71 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80357) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 18 02:15:30.165058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG passlib.handlers.bcrypt [None req-8d3ff20b-a985-4fd2-bab6-d68381e3fb71 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80357) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 18 02:15:30.219961 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-8d3ff20b-a985-4fd2-bab6-d68381e3fb71 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:30.221583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8d3ff20b-a985-4fd2-bab6-d68381e3fb71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:30.342089 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 18 02:15:30.448111 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60d063-b6d3-4f8e-9cd5-68d87cec0a05 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:30.516386 dv-cinder-850015-3-smb devstack@keystone.service[80358]: INFO dbcounter [None req-ee60d063-b6d3-4f8e-9cd5-68d87cec0a05 None None] Registered counter for database keystone Jul 18 02:15:30.535972 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG oslo_db.sqlalchemy.engines [None req-ee60d063-b6d3-4f8e-9cd5-68d87cec0a05 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80358) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 02:15:30.542088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writer thread running {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 02:15:30.660670 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee60d063-b6d3-4f8e-9cd5-68d87cec0a05 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:30.664897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9438a-bfc4-45d8-8979-d10b6311543d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:30.665563 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9438a-bfc4-45d8-8979-d10b6311543d admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:30.665882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9438a-bfc4-45d8-8979-d10b6311543d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:30.666165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9438a-bfc4-45d8-8979-d10b6311543d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:30.674281 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9438a-bfc4-45d8-8979-d10b6311543d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:30.728355 dv-cinder-850015-3-smb devstack@keystone.service[80358]: WARNING keystone.common.rbac_enforcer.enforcer [None req-71c9438a-bfc4-45d8-8979-d10b6311543d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 18 02:15:30.728620 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9438a-bfc4-45d8-8979-d10b6311543d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:30.744702 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1324 bytes} [Mon Jul 18 02:15:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 02:15:30.746273 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ff20b-a985-4fd2-bab6-d68381e3fb71 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:30.763771 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ff20b-a985-4fd2-bab6-d68381e3fb71 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:30.768249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e15e07-0217-489f-b6e1-3259306d50dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:30.769430 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e15e07-0217-489f-b6e1-3259306d50dd admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:30.769751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e15e07-0217-489f-b6e1-3259306d50dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:30.770045 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e15e07-0217-489f-b6e1-3259306d50dd admin admin] PATH_INFO: `/v3/projects/588ca26de9454c75b0a1f50762b8b0a2` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:30.774226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e15e07-0217-489f-b6e1-3259306d50dd admin admin] RBAC: Authorizing `identity:get_project(project_id=588ca26de9454c75b0a1f50762b8b0a2)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:30.825774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d2e15e07-0217-489f-b6e1-3259306d50dd admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 18 02:15:30.826135 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e15e07-0217-489f-b6e1-3259306d50dd admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:30.830919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 3/5] 10.222.0.64 () {56 vars in 1207 bytes} [Mon Jul 18 02:15:30 2022] GET /identity/v3/projects/588ca26de9454c75b0a1f50762b8b0a2 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:32.803168 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee93be-9c2c-4876-b763-ce19f97b0c57 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:32.803704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee93be-9c2c-4876-b763-ce19f97b0c57 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:32.803810 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee93be-9c2c-4876-b763-ce19f97b0c57 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:32.807871 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 3/6] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:32.813182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39bd28-69aa-4967-b86e-90e963613dd8 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:32.813586 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39bd28-69aa-4967-b86e-90e963613dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:32.813785 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39bd28-69aa-4967-b86e-90e963613dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:32.832253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9f39bd28-69aa-4967-b86e-90e963613dd8 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:32.833817 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9f39bd28-69aa-4967-b86e-90e963613dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:32.841735 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 18 02:15:32.863961 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee93be-9c2c-4876-b763-ce19f97b0c57 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:32.875955 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee93be-9c2c-4876-b763-ce19f97b0c57 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:32.880145 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594fc99-34b6-4a0f-bd38-605613858de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:32.880774 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594fc99-34b6-4a0f-bd38-605613858de4 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:32.881064 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594fc99-34b6-4a0f-bd38-605613858de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:32.881344 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594fc99-34b6-4a0f-bd38-605613858de4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:32.889059 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594fc99-34b6-4a0f-bd38-605613858de4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:32.890957 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594fc99-34b6-4a0f-bd38-605613858de4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:32.900180 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1324 bytes} [Mon Jul 18 02:15:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 02:15:32.905169 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39bd28-69aa-4967-b86e-90e963613dd8 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:32.914664 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39bd28-69aa-4967-b86e-90e963613dd8 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:32.919062 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151f207-a541-4880-918d-14981ac50f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:32.919915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151f207-a541-4880-918d-14981ac50f9d admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:32.920208 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151f207-a541-4880-918d-14981ac50f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:32.920492 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151f207-a541-4880-918d-14981ac50f9d admin admin] PATH_INFO: `/v3/users/66adc49d0e444db3bd259768a9d10521` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:32.921912 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151f207-a541-4880-918d-14981ac50f9d admin admin] RBAC: Authorizing `identity:get_user(user_id=66adc49d0e444db3bd259768a9d10521)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:32.923731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151f207-a541-4880-918d-14981ac50f9d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:32.925858 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 5/9] 10.222.0.64 () {56 vars in 1198 bytes} [Mon Jul 18 02:15:32 2022] GET /identity/v3/users/66adc49d0e444db3bd259768a9d10521 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:34.996093 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107d79e-35e6-434c-a591-da117f5b3bb1 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:34.996604 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107d79e-35e6-434c-a591-da117f5b3bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:34.996678 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107d79e-35e6-434c-a591-da117f5b3bb1 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:34.998075 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:35.003758 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e8cf0-32fa-45a0-82c3-7b63d97c0518 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:35.004170 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e8cf0-32fa-45a0-82c3-7b63d97c0518 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:35.004315 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e8cf0-32fa-45a0-82c3-7b63d97c0518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:35.006175 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6ec02-7a30-4273-911c-b6402fca7463 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:35.006468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6ec02-7a30-4273-911c-b6402fca7463 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:35.006750 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c6ec02-7a30-4273-911c-b6402fca7463 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:35.008060 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 6/11] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:15:35.013358 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd113f-f67e-4809-8f31-abc4b11898a8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:35.013648 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd113f-f67e-4809-8f31-abc4b11898a8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:35.013976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd113f-f67e-4809-8f31-abc4b11898a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:35.021867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-805e8cf0-32fa-45a0-82c3-7b63d97c0518 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:35.023067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-805e8cf0-32fa-45a0-82c3-7b63d97c0518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:35.054956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG passlib.handlers.bcrypt [None req-f8dd113f-f67e-4809-8f31-abc4b11898a8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80358) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 18 02:15:35.055374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG passlib.handlers.bcrypt [None req-f8dd113f-f67e-4809-8f31-abc4b11898a8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80358) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 18 02:15:35.100578 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f8dd113f-f67e-4809-8f31-abc4b11898a8 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:35.102204 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f8dd113f-f67e-4809-8f31-abc4b11898a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:35.102824 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:15:35.125083 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e8cf0-32fa-45a0-82c3-7b63d97c0518 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:35.150061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:35.204797 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:15:35.228363 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd113f-f67e-4809-8f31-abc4b11898a8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:35.230651 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e8cf0-32fa-45a0-82c3-7b63d97c0518 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:35.264611 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265600e6-32eb-4209-bbd4-245126c2c28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:35.265195 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265600e6-32eb-4209-bbd4-245126c2c28f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:35.265483 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265600e6-32eb-4209-bbd4-245126c2c28f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:35.265793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265600e6-32eb-4209-bbd4-245126c2c28f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:35.327584 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd113f-f67e-4809-8f31-abc4b11898a8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:35.330002 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:35.331740 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265600e6-32eb-4209-bbd4-245126c2c28f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:35.333231 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265600e6-32eb-4209-bbd4-245126c2c28f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:35.356964 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:35.364653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352ae71-2115-47bc-9661-6a12f8ff599a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:35.365722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352ae71-2115-47bc-9661-6a12f8ff599a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:35.366029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352ae71-2115-47bc-9661-6a12f8ff599a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:35.366315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2352ae71-2115-47bc-9661-6a12f8ff599a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:35.378513 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2352ae71-2115-47bc-9661-6a12f8ff599a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:15:35.390881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-2352ae71-2115-47bc-9661-6a12f8ff599a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:15:35.390881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:15:35.390881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:15:35.390881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:15:35.390881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:15:35.390881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:15:35.390881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:15:35.390881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:15:35.390881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:15:35.390881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:15:35.390881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:15:35.390881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:15:35.390881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:15:35.390881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:15:35.390881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:15:35.390881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:15:35.393887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:15:35.393887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:15:35.393887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:15:35.393887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:15:35.393887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:15:35.393887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:15:35.393887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:15:35.393887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:15:35.393887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:15:35.393887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:15:35.393887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:15:35.393887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:15:35.393887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:15:35.393887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:15:35.393887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:15:35.393887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:15:35.394757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:15:35.394757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:15:35.394757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:15:35.394757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:15:35.394757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:15:35.394757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:15:35.394757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:15:35.394757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:15:35.394757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:15:35.394757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:15:35.394757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:15:35.394757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:15:35.394757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 8/14] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:15:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:15:35.397988 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352ae71-2115-47bc-9661-6a12f8ff599a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:35.435993 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 7/15] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:15:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 02:15:35.441534 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265600e6-32eb-4209-bbd4-245126c2c28f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:35.497805 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2352ae71-2115-47bc-9661-6a12f8ff599a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:35.531893 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9db891-9686-4168-800f-5143426f1da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:35.532486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9db891-9686-4168-800f-5143426f1da5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:35.532772 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9db891-9686-4168-800f-5143426f1da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:35.533050 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9db891-9686-4168-800f-5143426f1da5 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:35.533836 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9db891-9686-4168-800f-5143426f1da5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:15:35.534147 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9db891-9686-4168-800f-5143426f1da5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:35.535584 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9db891-9686-4168-800f-5143426f1da5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:35.539822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265600e6-32eb-4209-bbd4-245126c2c28f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:35.547447 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 9/16] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:15:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:15:35.553251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9db891-9686-4168-800f-5143426f1da5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:35.562901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:35.574674 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d50a2-e25e-41bf-9e2d-caca87083646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:35.575966 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d50a2-e25e-41bf-9e2d-caca87083646 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:35.575966 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d50a2-e25e-41bf-9e2d-caca87083646 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:35.576134 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d50a2-e25e-41bf-9e2d-caca87083646 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:35.582268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:35.585955 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d50a2-e25e-41bf-9e2d-caca87083646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:35.587506 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d50a2-e25e-41bf-9e2d-caca87083646 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:35.609151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-bf3d50a2-e25e-41bf-9e2d-caca87083646 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:15:35.609151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:15:35.609151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:15:35.609151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:15:35.609151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:15:35.609151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:15:35.609151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:15:35.609151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:15:35.609151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:15:35.609151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:15:35.609151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:15:35.609151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:15:35.609151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:15:35.609151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:15:35.609151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:15:35.610054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:15:35.610054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:15:35.610054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:15:35.610054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:15:35.610054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:15:35.610054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:15:35.610054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:15:35.610054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:15:35.610054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:15:35.610054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:15:35.610054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:15:35.610054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:15:35.610054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:15:35.610054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:15:35.610054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:15:35.610054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:15:35.610054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:15:35.610848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:15:35.610848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:15:35.610848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:15:35.610848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:15:35.610848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 8/17] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:15:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:15:35.617047 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d50a2-e25e-41bf-9e2d-caca87083646 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:35.656378 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9db891-9686-4168-800f-5143426f1da5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:35.690556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efc49b-c002-40c8-bd51-ad638adf29d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:35.691439 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efc49b-c002-40c8-bd51-ad638adf29d8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:35.691721 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efc49b-c002-40c8-bd51-ad638adf29d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:35.691994 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efc49b-c002-40c8-bd51-ad638adf29d8 None admin] PATH_INFO: `/v3/users/66adc49d0e444db3bd259768a9d10521` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:35.693595 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efc49b-c002-40c8-bd51-ad638adf29d8 None admin] RBAC: Authorizing `identity:get_user(user_id=66adc49d0e444db3bd259768a9d10521)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:35.695088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efc49b-c002-40c8-bd51-ad638adf29d8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:35.696708 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 10/18] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:15:35 2022] GET /identity/v3/users/66adc49d0e444db3bd259768a9d10521 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:15:35.702121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efc49b-c002-40c8-bd51-ad638adf29d8 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:35.719532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d50a2-e25e-41bf-9e2d-caca87083646 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:35.754742 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdee29f-55ec-4594-a354-52c81e3d0965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:35.755412 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdee29f-55ec-4594-a354-52c81e3d0965 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:35.755695 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdee29f-55ec-4594-a354-52c81e3d0965 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:35.755973 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdee29f-55ec-4594-a354-52c81e3d0965 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:35.756698 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdee29f-55ec-4594-a354-52c81e3d0965 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:15:35.757009 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdee29f-55ec-4594-a354-52c81e3d0965 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:35.758455 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdee29f-55ec-4594-a354-52c81e3d0965 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:35.775879 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 9/19] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:15:35.796832 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:35.804197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efc49b-c002-40c8-bd51-ad638adf29d8 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:35.841662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84a0fd-a919-440f-979f-3a25b13d4867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:35.842512 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84a0fd-a919-440f-979f-3a25b13d4867 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:35.842864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84a0fd-a919-440f-979f-3a25b13d4867 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:35.843174 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84a0fd-a919-440f-979f-3a25b13d4867 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:35.844458 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84a0fd-a919-440f-979f-3a25b13d4867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:35.845988 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84a0fd-a919-440f-979f-3a25b13d4867 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:35.847705 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 11/20] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:15:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:35.853680 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdee29f-55ec-4594-a354-52c81e3d0965 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:35.889531 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:35.958415 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdee29f-55ec-4594-a354-52c81e3d0965 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:35.993182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b319288-303b-4bf1-ad79-ad1587861259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:35.993881 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b319288-303b-4bf1-ad79-ad1587861259 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:35.994175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b319288-303b-4bf1-ad79-ad1587861259 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:35.994459 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b319288-303b-4bf1-ad79-ad1587861259 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:35.995308 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b319288-303b-4bf1-ad79-ad1587861259 None admin] RBAC: Adding query filter params (role.id=5dfa34e7a4594751aed7c0495c9a2383, scope.domain.id=default, user.id=66adc49d0e444db3bd259768a9d10521) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:15:35.995641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b319288-303b-4bf1-ad79-ad1587861259 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:35.997091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b319288-303b-4bf1-ad79-ad1587861259 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:36.004701 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 10/21] 10.222.0.64 () {56 vars in 1322 bytes} [Mon Jul 18 02:15:35 2022] GET /identity/v3/role_assignments?user.id=66adc49d0e444db3bd259768a9d10521&scope.domain.id=default&role.id=5dfa34e7a4594751aed7c0495c9a2383 => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:38.246795 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba089c-36df-4a17-bf95-0aea5738c5c2 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:38.247348 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba089c-36df-4a17-bf95-0aea5738c5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:38.247348 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba089c-36df-4a17-bf95-0aea5738c5c2 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:38.249035 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 12/22] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:38.254245 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c691b-4755-4e37-b4fe-60032e075f46 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:38.254665 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c691b-4755-4e37-b4fe-60032e075f46 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:38.254856 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c691b-4755-4e37-b4fe-60032e075f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:38.278738 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-534c691b-4755-4e37-b4fe-60032e075f46 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:38.279961 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-534c691b-4755-4e37-b4fe-60032e075f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:38.364918 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 11/23] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:38.399609 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba089c-36df-4a17-bf95-0aea5738c5c2 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:38.414945 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d5bd0-837b-4175-8525-43c57c3b5f85 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:38.415247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d5bd0-837b-4175-8525-43c57c3b5f85 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:38.415524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d5bd0-837b-4175-8525-43c57c3b5f85 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:38.417079 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 12/24] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:38.433732 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e929c-9ca9-4f71-8885-b3a5ec74da8e None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:38.434027 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e929c-9ca9-4f71-8885-b3a5ec74da8e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:38.434315 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e929c-9ca9-4f71-8885-b3a5ec74da8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:38.458741 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-bd2e929c-9ca9-4f71-8885-b3a5ec74da8e None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:38.459962 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-bd2e929c-9ca9-4f71-8885-b3a5ec74da8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:38.502088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:38.526293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba089c-36df-4a17-bf95-0aea5738c5c2 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:38.562286 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dbff3-b5fc-420b-8aa8-9f81f2a23062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:38.563091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dbff3-b5fc-420b-8aa8-9f81f2a23062 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:38.563385 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dbff3-b5fc-420b-8aa8-9f81f2a23062 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:38.563668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dbff3-b5fc-420b-8aa8-9f81f2a23062 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:38.575344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 13/25] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:15:38.576434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f94cb-871f-4bf9-82a7-32bd244dc4e6 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:38.576705 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f94cb-871f-4bf9-82a7-32bd244dc4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:38.576991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f94cb-871f-4bf9-82a7-32bd244dc4e6 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:38.578471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 14/26] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:38.584143 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50564176-17f6-40de-b83f-a43bba26e6f5 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:38.584443 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50564176-17f6-40de-b83f-a43bba26e6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:38.584728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50564176-17f6-40de-b83f-a43bba26e6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:38.589833 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353dbff3-b5fc-420b-8aa8-9f81f2a23062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:38.595280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353dbff3-b5fc-420b-8aa8-9f81f2a23062 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:38.618935 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-50564176-17f6-40de-b83f-a43bba26e6f5 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:38.620182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-50564176-17f6-40de-b83f-a43bba26e6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:38.627079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-353dbff3-b5fc-420b-8aa8-9f81f2a23062 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:15:38.627079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:15:38.627079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:15:38.627079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:15:38.627079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:15:38.627079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:15:38.627079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:15:38.627079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:15:38.627079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:15:38.627079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:15:38.627079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:15:38.627079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:15:38.627079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:15:38.627079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:15:38.627079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:15:38.628375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:15:38.628375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:15:38.628375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:15:38.628375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:15:38.628375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:15:38.628375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:15:38.628375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:15:38.628375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:15:38.628375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:15:38.628375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:15:38.628375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:15:38.628375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:15:38.628375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:15:38.628375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:15:38.628375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:15:38.628375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:15:38.628375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:15:38.629587 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:15:38.629587 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:15:38.629587 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:15:38.629587 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:15:38.629587 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 13/27] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:15:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:15:38.629937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dbff3-b5fc-420b-8aa8-9f81f2a23062 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:38.654156 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:38.745456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dbff3-b5fc-420b-8aa8-9f81f2a23062 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:38.751272 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 15/28] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:15:38.751919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50564176-17f6-40de-b83f-a43bba26e6f5 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:38.820604 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d232c67-8862-452b-90f5-63097253f668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:38.821284 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d232c67-8862-452b-90f5-63097253f668 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:38.821572 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d232c67-8862-452b-90f5-63097253f668 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:38.821885 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d232c67-8862-452b-90f5-63097253f668 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:38.822646 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d232c67-8862-452b-90f5-63097253f668 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:38.824054 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d232c67-8862-452b-90f5-63097253f668 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:38.880335 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:38.892706 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50564176-17f6-40de-b83f-a43bba26e6f5 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:38.937438 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a820db3-2118-4573-8e63-2a8d8a2a7d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:38.938553 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a820db3-2118-4573-8e63-2a8d8a2a7d5a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:38.939070 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a820db3-2118-4573-8e63-2a8d8a2a7d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:38.939604 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a820db3-2118-4573-8e63-2a8d8a2a7d5a None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:38.940586 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a820db3-2118-4573-8e63-2a8d8a2a7d5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:15:38.941104 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a820db3-2118-4573-8e63-2a8d8a2a7d5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:38.942922 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a820db3-2118-4573-8e63-2a8d8a2a7d5a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:38.957782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 16/29] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:38.958968 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a820db3-2118-4573-8e63-2a8d8a2a7d5a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:39.043690 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 14/30] 10.222.0.64 () {60 vars in 1131 bytes} [Mon Jul 18 02:15:38 2022] POST /identity/v3/roles => generated 219 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:15:39.045010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e22c7e-5fc4-4b9d-9204-dd0b245561e2 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:39.045309 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e22c7e-5fc4-4b9d-9204-dd0b245561e2 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:39.045597 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e22c7e-5fc4-4b9d-9204-dd0b245561e2 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:39.055644 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 15/31] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:39 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:39.056502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e22c7e-5fc4-4b9d-9204-dd0b245561e2 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:39.078042 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a820db3-2118-4573-8e63-2a8d8a2a7d5a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:39.122329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63b84c-7631-4c39-961e-d62380ac8c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:39.123680 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63b84c-7631-4c39-961e-d62380ac8c63 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:39.124185 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63b84c-7631-4c39-961e-d62380ac8c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:39.124654 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63b84c-7631-4c39-961e-d62380ac8c63 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:39.125633 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63b84c-7631-4c39-961e-d62380ac8c63 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:39.128348 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63b84c-7631-4c39-961e-d62380ac8c63 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:39.210714 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:39.256094 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e22c7e-5fc4-4b9d-9204-dd0b245561e2 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:39.293856 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0da93-fd15-4a1c-b61a-c864e697a3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:39.294538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0da93-fd15-4a1c-b61a-c864e697a3f6 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:39.294830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0da93-fd15-4a1c-b61a-c864e697a3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:39.295117 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae0da93-fd15-4a1c-b61a-c864e697a3f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:39.295845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0da93-fd15-4a1c-b61a-c864e697a3f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:39.297443 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae0da93-fd15-4a1c-b61a-c864e697a3f6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:39.334766 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 17/32] 10.222.0.64 () {60 vars in 1131 bytes} [Mon Jul 18 02:15:38 2022] POST /identity/v3/roles => generated 225 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:15:39.336411 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b187c6-a845-43fd-8f60-2e12b0452dc4 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:39.336708 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b187c6-a845-43fd-8f60-2e12b0452dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:39.336990 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b187c6-a845-43fd-8f60-2e12b0452dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:39.359370 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-90b187c6-a845-43fd-8f60-2e12b0452dc4 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:39.361045 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-90b187c6-a845-43fd-8f60-2e12b0452dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:39.363864 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:39.419546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 16/33] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jul 18 02:15:39 2022] POST /identity/v3/projects => generated 301 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:15:39.452027 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 18/34] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:39.476510 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0da93-fd15-4a1c-b61a-c864e697a3f6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:39.612243 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae0da93-fd15-4a1c-b61a-c864e697a3f6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:39.640739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:39.650550 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5fa7c-73f2-4faf-bded-88f848641c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:39.651378 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5fa7c-73f2-4faf-bded-88f848641c50 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:39.651657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5fa7c-73f2-4faf-bded-88f848641c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:39.651940 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5fa7c-73f2-4faf-bded-88f848641c50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:39.665389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5fa7c-73f2-4faf-bded-88f848641c50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:15:39.673465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-25b5fa7c-73f2-4faf-bded-88f848641c50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:15:39.673465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:15:39.673465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:15:39.673465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:15:39.673465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:15:39.673465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:15:39.673465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:15:39.673465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:15:39.673465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:15:39.673465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:15:39.673465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:15:39.673465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:15:39.673465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:15:39.673465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:15:39.673465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:15:39.673465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:15:39.675043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:15:39.675043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:15:39.675043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:15:39.675043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:15:39.675043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:15:39.675043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:15:39.675043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:15:39.675043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:15:39.675043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:15:39.675043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:15:39.675043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:15:39.675043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:15:39.675043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:15:39.675043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:15:39.675043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:15:39.675043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:15:39.676020 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:15:39.676020 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:15:39.676020 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:15:39.676020 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:15:39.676020 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:15:39.676020 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:15:39.676020 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:15:39.676020 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:15:39.676020 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:15:39.676020 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:15:39.676020 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:15:39.676020 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:15:39.676717 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc499a1d-9982-41cd-b77d-5f760bf41023 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:39.676717 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc499a1d-9982-41cd-b77d-5f760bf41023 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:39.676717 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc499a1d-9982-41cd-b77d-5f760bf41023 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:39.676943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 17/35] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:15:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:15:39.677275 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 19/36] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:39.682370 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b512543-0d32-478b-8c94-b553b7920750 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:39.682662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b512543-0d32-478b-8c94-b553b7920750 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:39.683010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b512543-0d32-478b-8c94-b553b7920750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:39.685644 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc499a1d-9982-41cd-b77d-5f760bf41023 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:39.703778 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5b512543-0d32-478b-8c94-b553b7920750 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:39.705328 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5b512543-0d32-478b-8c94-b553b7920750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:39.791081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 18/37] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:15:39.814301 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b512543-0d32-478b-8c94-b553b7920750 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:39.825277 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc499a1d-9982-41cd-b77d-5f760bf41023 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:39.861262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdb919-f40d-4cac-8f86-d395639c81e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:39.862776 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdb919-f40d-4cac-8f86-d395639c81e0 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:39.863060 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdb919-f40d-4cac-8f86-d395639c81e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:39.863339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdb919-f40d-4cac-8f86-d395639c81e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:39.864104 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdb919-f40d-4cac-8f86-d395639c81e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:15:39.864417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdb919-f40d-4cac-8f86-d395639c81e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:39.865961 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdb919-f40d-4cac-8f86-d395639c81e0 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:39.874690 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:39.879375 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 20/38] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:15:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:39.884838 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdb919-f40d-4cac-8f86-d395639c81e0 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:39.925449 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b512543-0d32-478b-8c94-b553b7920750 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:39.942209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:39.960476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdac505-b3a5-4aa2-b8f9-c24ba5b8f304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:39.961147 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdac505-b3a5-4aa2-b8f9-c24ba5b8f304 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:39.961439 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdac505-b3a5-4aa2-b8f9-c24ba5b8f304 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:39.961753 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdac505-b3a5-4aa2-b8f9-c24ba5b8f304 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:39.962506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdac505-b3a5-4aa2-b8f9-c24ba5b8f304 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:39.963992 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdac505-b3a5-4aa2-b8f9-c24ba5b8f304 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:39.984694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdb919-f40d-4cac-8f86-d395639c81e0 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:40.038103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 19/39] 10.222.0.64 () {60 vars in 1131 bytes} [Mon Jul 18 02:15:39 2022] POST /identity/v3/roles => generated 223 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:15:40.039306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3b8b9-afaf-47e9-bfdd-09d23351e6e9 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:40.039603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3b8b9-afaf-47e9-bfdd-09d23351e6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:40.039882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b3b8b9-afaf-47e9-bfdd-09d23351e6e9 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:40.061931 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 20/40] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:40.061931 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c33075-d434-46da-a2ba-4f037cfafe3e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:40.061931 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c33075-d434-46da-a2ba-4f037cfafe3e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:40.061931 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c33075-d434-46da-a2ba-4f037cfafe3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:40.067519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-73c33075-d434-46da-a2ba-4f037cfafe3e None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:40.068781 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-73c33075-d434-46da-a2ba-4f037cfafe3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:40.134212 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2bd71-027f-400d-a0c8-b6735de6e5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:40.135117 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2bd71-027f-400d-a0c8-b6735de6e5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:40.135403 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2bd71-027f-400d-a0c8-b6735de6e5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:40.136174 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2bd71-027f-400d-a0c8-b6735de6e5e5 None admin] PATH_INFO: `/v3/users/66adc49d0e444db3bd259768a9d10521` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:40.137181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2bd71-027f-400d-a0c8-b6735de6e5e5 None admin] RBAC: Authorizing `identity:get_user(user_id=66adc49d0e444db3bd259768a9d10521)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:40.138600 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2bd71-027f-400d-a0c8-b6735de6e5e5 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:40.140517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 21/41] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:15:39 2022] GET /identity/v3/users/66adc49d0e444db3bd259768a9d10521 => generated 247 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:15:40.146574 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2bd71-027f-400d-a0c8-b6735de6e5e5 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:40.169728 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 21/42] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:15:40.182758 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c33075-d434-46da-a2ba-4f037cfafe3e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:40.240523 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:40.279747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2bd71-027f-400d-a0c8-b6735de6e5e5 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:40.298434 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c33075-d434-46da-a2ba-4f037cfafe3e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:40.306944 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:40.314004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7119d-9b15-4003-a44c-8985251ee0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:40.314776 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7119d-9b15-4003-a44c-8985251ee0cc None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:40.315071 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7119d-9b15-4003-a44c-8985251ee0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:40.315355 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7119d-9b15-4003-a44c-8985251ee0cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:40.316541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7119d-9b15-4003-a44c-8985251ee0cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:40.318033 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c7119d-9b15-4003-a44c-8985251ee0cc None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:40.321638 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 22/43] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:15:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:40.325265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7119d-9b15-4003-a44c-8985251ee0cc None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:40.333199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959371b4-b4f5-4d85-98cd-bca00088a496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:40.334043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959371b4-b4f5-4d85-98cd-bca00088a496 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:40.334338 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959371b4-b4f5-4d85-98cd-bca00088a496 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:40.334622 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959371b4-b4f5-4d85-98cd-bca00088a496 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:40.335809 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959371b4-b4f5-4d85-98cd-bca00088a496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:40.337263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959371b4-b4f5-4d85-98cd-bca00088a496 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:40.339329 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 22/44] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:15:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:15:40.344310 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959371b4-b4f5-4d85-98cd-bca00088a496 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:40.423492 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7119d-9b15-4003-a44c-8985251ee0cc None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:40.443402 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959371b4-b4f5-4d85-98cd-bca00088a496 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:40.457330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bd566-a36a-4fc9-875f-2ddee939b2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:40.458305 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bd566-a36a-4fc9-875f-2ddee939b2bf None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:40.458593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bd566-a36a-4fc9-875f-2ddee939b2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:40.458882 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bd566-a36a-4fc9-875f-2ddee939b2bf None admin] PATH_INFO: `/v3/domains/default/users/66adc49d0e444db3bd259768a9d10521/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:40.460927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bd566-a36a-4fc9-875f-2ddee939b2bf None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=66adc49d0e444db3bd259768a9d10521, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:40.462428 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bd566-a36a-4fc9-875f-2ddee939b2bf None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:40.466500 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:40.477588 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acaad27-47a5-422d-a7f3-e75edf734b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:40.478681 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acaad27-47a5-422d-a7f3-e75edf734b03 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:40.479194 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acaad27-47a5-422d-a7f3-e75edf734b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:40.479685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acaad27-47a5-422d-a7f3-e75edf734b03 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:40.480406 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acaad27-47a5-422d-a7f3-e75edf734b03 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:40.482423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acaad27-47a5-422d-a7f3-e75edf734b03 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:40.533719 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 23/45] 10.222.0.64 () {58 vars in 1361 bytes} [Mon Jul 18 02:15:40 2022] PUT /identity/v3/domains/default/users/66adc49d0e444db3bd259768a9d10521/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:15:40.613826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 23/46] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jul 18 02:15:40 2022] POST /identity/v3/projects => generated 312 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:15:42.508016 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32193e7e-430a-4871-bc57-32f6d3aa910e None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:42.508519 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32193e7e-430a-4871-bc57-32f6d3aa910e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:42.508519 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32193e7e-430a-4871-bc57-32f6d3aa910e None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:42.509933 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 24/47] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:42.515150 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baa2ea-a534-410a-9723-45f00754e948 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:42.515533 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baa2ea-a534-410a-9723-45f00754e948 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:42.515714 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baa2ea-a534-410a-9723-45f00754e948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:42.533404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-09baa2ea-a534-410a-9723-45f00754e948 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:42.534646 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-09baa2ea-a534-410a-9723-45f00754e948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:42.554570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:42.625296 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a149b4-f1e3-4fbb-87cd-f2e5f8ecd860 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:42.625587 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a149b4-f1e3-4fbb-87cd-f2e5f8ecd860 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:42.625910 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a149b4-f1e3-4fbb-87cd-f2e5f8ecd860 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:42.627894 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 25/48] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:15:42.633752 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14c3bd-ff17-4980-8ff2-a2cfae45aebb None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:42.634068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14c3bd-ff17-4980-8ff2-a2cfae45aebb None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:42.634359 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14c3bd-ff17-4980-8ff2-a2cfae45aebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:42.651757 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0b14c3bd-ff17-4980-8ff2-a2cfae45aebb None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:42.653024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0b14c3bd-ff17-4980-8ff2-a2cfae45aebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:42.705158 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 24/49] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:42.722751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 26/50] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:15:42.727418 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baa2ea-a534-410a-9723-45f00754e948 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:42.745472 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14c3bd-ff17-4980-8ff2-a2cfae45aebb None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:42.825525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baa2ea-a534-410a-9723-45f00754e948 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:42.843682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14c3bd-ff17-4980-8ff2-a2cfae45aebb None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:42.859626 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed1dd5-5a4f-4776-9b73-21b31f22b122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:42.860430 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed1dd5-5a4f-4776-9b73-21b31f22b122 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:42.860718 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed1dd5-5a4f-4776-9b73-21b31f22b122 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:42.860996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed1dd5-5a4f-4776-9b73-21b31f22b122 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:42.868714 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:42.871461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed1dd5-5a4f-4776-9b73-21b31f22b122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:15:42.877020 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea2ac7-930a-4299-9c5f-933caf9394a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:42.880976 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea2ac7-930a-4299-9c5f-933caf9394a0 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:42.880976 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea2ac7-930a-4299-9c5f-933caf9394a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:42.880976 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea2ac7-930a-4299-9c5f-933caf9394a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:42.881257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-b4ed1dd5-5a4f-4776-9b73-21b31f22b122 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:15:42.881257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:15:42.881257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:15:42.881257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:15:42.881257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:15:42.881257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:15:42.881257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:15:42.881257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:15:42.881257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:15:42.881257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:15:42.881257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:15:42.881257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:15:42.881257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:15:42.881257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:15:42.881257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:15:42.881257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:15:42.882047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:15:42.882047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:15:42.882047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:15:42.882047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:15:42.882047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:15:42.882047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:15:42.882047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:15:42.882047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:15:42.882047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:15:42.882047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:15:42.882047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:15:42.882047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:15:42.882047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:15:42.882047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:15:42.882047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:15:42.882047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:15:42.882791 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:15:42.882791 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:15:42.882791 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:15:42.882791 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:15:42.882791 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:15:42.882791 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:15:42.882791 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:15:42.882791 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:15:42.882791 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:15:42.882791 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:15:42.882791 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:15:42.882791 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:15:42.883347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea2ac7-930a-4299-9c5f-933caf9394a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:42.883411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 25/51] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:15:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:15:42.883486 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea2ac7-930a-4299-9c5f-933caf9394a0 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:42.883486 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 27/52] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:15:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:15:42.886391 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed1dd5-5a4f-4776-9b73-21b31f22b122 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:42.888085 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea2ac7-930a-4299-9c5f-933caf9394a0 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:42.905466 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:42.986269 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea2ac7-930a-4299-9c5f-933caf9394a0 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:42.987616 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed1dd5-5a4f-4776-9b73-21b31f22b122 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:43.019580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9936e71-4248-4ce1-9f4d-1e7d074b4197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:43.020244 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9936e71-4248-4ce1-9f4d-1e7d074b4197 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:43.020534 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9936e71-4248-4ce1-9f4d-1e7d074b4197 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:43.020814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9936e71-4248-4ce1-9f4d-1e7d074b4197 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:43.021060 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b008081-a364-4d8b-9858-250759d70f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:43.021530 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9936e71-4248-4ce1-9f4d-1e7d074b4197 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:43.021743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b008081-a364-4d8b-9858-250759d70f1c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:43.022037 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b008081-a364-4d8b-9858-250759d70f1c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:43.022316 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b008081-a364-4d8b-9858-250759d70f1c None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:43.023027 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9936e71-4248-4ce1-9f4d-1e7d074b4197 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:43.023198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b008081-a364-4d8b-9858-250759d70f1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:15:43.023510 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b008081-a364-4d8b-9858-250759d70f1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:43.024924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b008081-a364-4d8b-9858-250759d70f1c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:43.033198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 26/53] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:15:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:43.039330 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b008081-a364-4d8b-9858-250759d70f1c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:43.115988 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:43.137225 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b008081-a364-4d8b-9858-250759d70f1c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:43.170452 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ca900-01cf-4a27-baee-9e1de84887b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:43.171326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ca900-01cf-4a27-baee-9e1de84887b8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:43.171614 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ca900-01cf-4a27-baee-9e1de84887b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:43.171894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07ca900-01cf-4a27-baee-9e1de84887b8 None admin] PATH_INFO: `/v3/users/66adc49d0e444db3bd259768a9d10521` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:43.173145 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ca900-01cf-4a27-baee-9e1de84887b8 None admin] RBAC: Authorizing `identity:get_user(user_id=66adc49d0e444db3bd259768a9d10521)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:43.174794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07ca900-01cf-4a27-baee-9e1de84887b8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:43.176422 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 27/54] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:15:43 2022] GET /identity/v3/users/66adc49d0e444db3bd259768a9d10521 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:15:43.181939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ca900-01cf-4a27-baee-9e1de84887b8 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:43.232783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 28/55] 10.222.0.64 () {60 vars in 1140 bytes} [Mon Jul 18 02:15:42 2022] POST /identity/v3/projects => generated 298 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:15:43.284837 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07ca900-01cf-4a27-baee-9e1de84887b8 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:43.322381 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c73a86-c396-42f5-89c8-8974d8899931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:43.323222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c73a86-c396-42f5-89c8-8974d8899931 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:43.323518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c73a86-c396-42f5-89c8-8974d8899931 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:43.323808 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c73a86-c396-42f5-89c8-8974d8899931 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:43.325043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c73a86-c396-42f5-89c8-8974d8899931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:43.326569 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c73a86-c396-42f5-89c8-8974d8899931 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:43.328247 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 28/56] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:15:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:15:43.335022 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9936e71-4248-4ce1-9f4d-1e7d074b4197 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:43.384794 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:43.437567 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9936e71-4248-4ce1-9f4d-1e7d074b4197 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:43.474178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c59f7-eb7d-4767-90d0-d92301214ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:43.474853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c59f7-eb7d-4767-90d0-d92301214ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:43.475146 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c59f7-eb7d-4767-90d0-d92301214ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:43.475430 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c59f7-eb7d-4767-90d0-d92301214ff9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:43.476282 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c59f7-eb7d-4767-90d0-d92301214ff9 None admin] RBAC: Adding query filter params (role.id=5dfa34e7a4594751aed7c0495c9a2383, scope.domain.id=default, user.id=66adc49d0e444db3bd259768a9d10521) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:15:43.476602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c59f7-eb7d-4767-90d0-d92301214ff9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:43.478104 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c59f7-eb7d-4767-90d0-d92301214ff9 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:43.487643 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 29/57] 10.222.0.64 () {56 vars in 1322 bytes} [Mon Jul 18 02:15:43 2022] GET /identity/v3/role_assignments?user.id=66adc49d0e444db3bd259768a9d10521&scope.domain.id=default&role.id=5dfa34e7a4594751aed7c0495c9a2383 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:45.235118 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47bcfc-da15-42a0-9531-7f4534dee598 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:45.235624 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47bcfc-da15-42a0-9531-7f4534dee598 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:45.235741 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47bcfc-da15-42a0-9531-7f4534dee598 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:45.237065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 29/58] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:45.242385 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc15410-0a81-4aec-b8cf-0c7fa2fa6af3 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:45.242768 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc15410-0a81-4aec-b8cf-0c7fa2fa6af3 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:45.242956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc15410-0a81-4aec-b8cf-0c7fa2fa6af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:45.259799 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-fdc15410-0a81-4aec-b8cf-0c7fa2fa6af3 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:45.260999 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-fdc15410-0a81-4aec-b8cf-0c7fa2fa6af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:45.325034 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 30/59] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:45.349225 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47bcfc-da15-42a0-9531-7f4534dee598 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:45.364978 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:45.448105 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47bcfc-da15-42a0-9531-7f4534dee598 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:45.480597 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34228e85-8d48-46d8-8741-29d067715088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:45.481382 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34228e85-8d48-46d8-8741-29d067715088 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:45.481670 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34228e85-8d48-46d8-8741-29d067715088 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:45.481988 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34228e85-8d48-46d8-8741-29d067715088 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:45.484150 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34228e85-8d48-46d8-8741-29d067715088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:45.485586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34228e85-8d48-46d8-8741-29d067715088 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:45.487278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 30/60] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:15:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:45.492885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc15410-0a81-4aec-b8cf-0c7fa2fa6af3 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:45.532918 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:45.588730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc15410-0a81-4aec-b8cf-0c7fa2fa6af3 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:45.621258 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d90690-118e-4998-8eca-5d7a75910e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:45.621949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d90690-118e-4998-8eca-5d7a75910e4c None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:45.622240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d90690-118e-4998-8eca-5d7a75910e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:45.622525 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d90690-118e-4998-8eca-5d7a75910e4c None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:45.623231 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d90690-118e-4998-8eca-5d7a75910e4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:45.624702 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d90690-118e-4998-8eca-5d7a75910e4c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:45.716485 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 31/61] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jul 18 02:15:45 2022] POST /identity/v3/users => generated 275 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:15:48.845662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0b4df-dde8-44a4-9c42-cc0de90a8a88 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:48.846264 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0b4df-dde8-44a4-9c42-cc0de90a8a88 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:48.846346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0b4df-dde8-44a4-9c42-cc0de90a8a88 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:48.848116 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 31/62] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:48.866260 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915b7f5-e33d-4db2-84c3-e0f4bb0a3355 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:48.866724 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915b7f5-e33d-4db2-84c3-e0f4bb0a3355 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:48.867024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915b7f5-e33d-4db2-84c3-e0f4bb0a3355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:48.894490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0915b7f5-e33d-4db2-84c3-e0f4bb0a3355 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:48.895710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0915b7f5-e33d-4db2-84c3-e0f4bb0a3355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:48.944223 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900548c2-8408-4891-9c19-0e8dde6d8cc6 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:48.944521 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900548c2-8408-4891-9c19-0e8dde6d8cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:48.944792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900548c2-8408-4891-9c19-0e8dde6d8cc6 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:48.946207 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 32/63] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:15:48.955481 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451e831-b1d4-4eb2-8366-33b5d3c60c90 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:48.955778 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451e831-b1d4-4eb2-8366-33b5d3c60c90 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:48.956066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451e831-b1d4-4eb2-8366-33b5d3c60c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:48.983897 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 32/64] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:48.994769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a451e831-b1d4-4eb2-8366-33b5d3c60c90 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:48.996023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a451e831-b1d4-4eb2-8366-33b5d3c60c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:49.037505 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915b7f5-e33d-4db2-84c3-e0f4bb0a3355 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:49.086097 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:49.103611 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 33/65] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:49.121349 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451e831-b1d4-4eb2-8366-33b5d3c60c90 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:49.139475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:49.199960 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915b7f5-e33d-4db2-84c3-e0f4bb0a3355 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:49.235210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278882f4-691d-4aa2-b1a2-b6581bfe15d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:49.236494 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278882f4-691d-4aa2-b1a2-b6581bfe15d5 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:49.236923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278882f4-691d-4aa2-b1a2-b6581bfe15d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:49.237337 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278882f4-691d-4aa2-b1a2-b6581bfe15d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:49.249102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278882f4-691d-4aa2-b1a2-b6581bfe15d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:15:49.258965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-278882f4-691d-4aa2-b1a2-b6581bfe15d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:15:49.258965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:15:49.258965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:15:49.258965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:15:49.258965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:15:49.258965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:15:49.258965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:15:49.258965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:15:49.258965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:15:49.258965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:15:49.258965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:15:49.258965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:15:49.258965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:15:49.258965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:15:49.258965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:15:49.258965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:15:49.260002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:15:49.260002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:15:49.260002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:15:49.260002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:15:49.260002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:15:49.260002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:15:49.260002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:15:49.260002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:15:49.260002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:15:49.260002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:15:49.260002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:15:49.260002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:15:49.260002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:15:49.260002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:15:49.260002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:15:49.260002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:15:49.261053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:15:49.261053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:15:49.261053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:15:49.261053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:15:49.261053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:15:49.261053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:15:49.261053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:15:49.261053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:15:49.261053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:15:49.261053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:15:49.261053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:15:49.261053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:15:49.263070 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 33/66] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:15:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:15:49.285094 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278882f4-691d-4aa2-b1a2-b6581bfe15d5 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:49.296284 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451e831-b1d4-4eb2-8366-33b5d3c60c90 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:49.335335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91800071-0511-46ea-b344-7a55be6e12a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:49.336546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91800071-0511-46ea-b344-7a55be6e12a8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:49.336998 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91800071-0511-46ea-b344-7a55be6e12a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:49.337416 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91800071-0511-46ea-b344-7a55be6e12a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:49.349923 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91800071-0511-46ea-b344-7a55be6e12a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:15:49.358343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-91800071-0511-46ea-b344-7a55be6e12a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:15:49.358343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:15:49.358343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:15:49.358343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:15:49.358343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:15:49.358343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:15:49.358343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:15:49.358343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:15:49.358343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:15:49.358343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:15:49.358343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:15:49.358343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:15:49.358343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:15:49.358343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:15:49.358343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:15:49.358343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:15:49.359337 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:15:49.359337 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:15:49.359337 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:15:49.359337 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:15:49.359337 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:15:49.359337 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:15:49.359337 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:15:49.359337 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:15:49.359337 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:15:49.359337 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:15:49.359337 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:15:49.359337 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:15:49.359337 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:15:49.359337 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:15:49.359337 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:15:49.359337 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:15:49.360085 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:15:49.360085 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:15:49.360085 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:15:49.360085 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:15:49.360085 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:15:49.360085 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:15:49.360085 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:15:49.360085 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:15:49.360085 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:15:49.360085 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:15:49.360085 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:15:49.360085 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:15:49.362453 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 34/67] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:15:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:15:49.368567 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3bcbd-d0d3-46b6-ac6c-e52ae636721e None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:49.369063 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3bcbd-d0d3-46b6-ac6c-e52ae636721e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:49.369515 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3bcbd-d0d3-46b6-ac6c-e52ae636721e None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:49.371547 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 35/68] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:49.372447 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3bcbd-d0d3-46b6-ac6c-e52ae636721e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:49.408882 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:49.425377 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278882f4-691d-4aa2-b1a2-b6581bfe15d5 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:49.453230 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:49.458663 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ae424-abd9-4ef4-913b-9246021d429c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:49.459528 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ae424-abd9-4ef4-913b-9246021d429c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:49.459971 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ae424-abd9-4ef4-913b-9246021d429c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:49.460629 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ae424-abd9-4ef4-913b-9246021d429c None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:49.461481 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ae424-abd9-4ef4-913b-9246021d429c None admin] RBAC: Adding query filter params (name=member) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:15:49.461829 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ae424-abd9-4ef4-913b-9246021d429c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:49.463405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ae424-abd9-4ef4-913b-9246021d429c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:49.471972 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 34/69] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:15:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:49.480263 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52e163-d1f1-4ed7-8998-083610d1187a None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:49.480263 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52e163-d1f1-4ed7-8998-083610d1187a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:49.480263 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da52e163-d1f1-4ed7-8998-083610d1187a None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:49.480263 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 35/70] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:49.480263 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208c33b-a712-4270-be6d-cdbfcd3bd3f9 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:49.480263 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208c33b-a712-4270-be6d-cdbfcd3bd3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:49.480657 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208c33b-a712-4270-be6d-cdbfcd3bd3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:49.489449 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3bcbd-d0d3-46b6-ac6c-e52ae636721e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:49.493287 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-8208c33b-a712-4270-be6d-cdbfcd3bd3f9 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:49.494520 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8208c33b-a712-4270-be6d-cdbfcd3bd3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:49.523602 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a75901-0707-4b72-b745-fa9b61798d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:49.524286 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a75901-0707-4b72-b745-fa9b61798d91 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:49.524584 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a75901-0707-4b72-b745-fa9b61798d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:49.524868 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a75901-0707-4b72-b745-fa9b61798d91 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:49.525623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a75901-0707-4b72-b745-fa9b61798d91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:15:49.525971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a75901-0707-4b72-b745-fa9b61798d91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:49.527372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a75901-0707-4b72-b745-fa9b61798d91 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:49.535765 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 36/71] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:15:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:49.537029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aabbe2-5260-4a17-8bb0-178dcc471ab2 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:49.537293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aabbe2-5260-4a17-8bb0-178dcc471ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:49.537579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aabbe2-5260-4a17-8bb0-178dcc471ab2 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:49.538878 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 37/72] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:49.542064 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aabbe2-5260-4a17-8bb0-178dcc471ab2 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:49.566538 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 36/73] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:49.567820 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdffa67-ddd3-43a6-8da9-702e3f0ee1f8 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:49.568113 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdffa67-ddd3-43a6-8da9-702e3f0ee1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:49.568398 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdffa67-ddd3-43a6-8da9-702e3f0ee1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:49.600260 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-dbdffa67-ddd3-43a6-8da9-702e3f0ee1f8 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:49.601486 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-dbdffa67-ddd3-43a6-8da9-702e3f0ee1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:49.650948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aabbe2-5260-4a17-8bb0-178dcc471ab2 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:49.670013 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 37/74] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:49.682480 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdffa67-ddd3-43a6-8da9-702e3f0ee1f8 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:49.682480 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:49.698516 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3cdd4-dcc3-494d-859d-fcc926d2b6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:49.699390 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3cdd4-dcc3-494d-859d-fcc926d2b6ea None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:49.699672 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3cdd4-dcc3-494d-859d-fcc926d2b6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:49.699944 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3cdd4-dcc3-494d-859d-fcc926d2b6ea None admin] PATH_INFO: `/v3/users/9757b88abf7e4e979b2025f40c29fca2` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:49.701977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:49.716038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3cdd4-dcc3-494d-859d-fcc926d2b6ea None admin] RBAC: Authorizing `identity:get_user(user_id=9757b88abf7e4e979b2025f40c29fca2)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:49.717530 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3cdd4-dcc3-494d-859d-fcc926d2b6ea None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:49.719286 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 38/75] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:15:49 2022] GET /identity/v3/users/9757b88abf7e4e979b2025f40c29fca2 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:49.721049 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148a164-3c40-4abf-881e-2e2360e4012a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:49.721415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148a164-3c40-4abf-881e-2e2360e4012a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:49.721715 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148a164-3c40-4abf-881e-2e2360e4012a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:49.737457 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a148a164-3c40-4abf-881e-2e2360e4012a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:49.738705 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a148a164-3c40-4abf-881e-2e2360e4012a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:49.772067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdffa67-ddd3-43a6-8da9-702e3f0ee1f8 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:49.804841 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c56cc-2fef-4e46-9ee3-7bcb14cfd9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:49.805021 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 39/76] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:49.805891 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148a164-3c40-4abf-881e-2e2360e4012a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:49.806530 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c56cc-2fef-4e46-9ee3-7bcb14cfd9d5 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:49.806833 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c56cc-2fef-4e46-9ee3-7bcb14cfd9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:49.807123 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c56cc-2fef-4e46-9ee3-7bcb14cfd9d5 None admin] PATH_INFO: `/v3/users/66adc49d0e444db3bd259768a9d10521` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:49.808546 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c56cc-2fef-4e46-9ee3-7bcb14cfd9d5 None admin] RBAC: Authorizing `identity:get_user(user_id=66adc49d0e444db3bd259768a9d10521)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:49.810823 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c56cc-2fef-4e46-9ee3-7bcb14cfd9d5 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:49.812612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 38/77] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:15:49 2022] GET /identity/v3/users/66adc49d0e444db3bd259768a9d10521 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:49.813238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c56cc-2fef-4e46-9ee3-7bcb14cfd9d5 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:49.891838 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:49.906636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148a164-3c40-4abf-881e-2e2360e4012a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:49.915014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c56cc-2fef-4e46-9ee3-7bcb14cfd9d5 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:49.949482 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89673fb6-910f-480a-8445-470d4ab18db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:49.949733 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:49.950335 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89673fb6-910f-480a-8445-470d4ab18db9 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:49.950658 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89673fb6-910f-480a-8445-470d4ab18db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:49.950939 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89673fb6-910f-480a-8445-470d4ab18db9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:49.962034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58150d0d-1b06-44e5-9cb1-814f0c6200f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:49.962858 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58150d0d-1b06-44e5-9cb1-814f0c6200f2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:49.965788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58150d0d-1b06-44e5-9cb1-814f0c6200f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:49.965788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58150d0d-1b06-44e5-9cb1-814f0c6200f2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:49.966001 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89673fb6-910f-480a-8445-470d4ab18db9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:15:49.974371 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58150d0d-1b06-44e5-9cb1-814f0c6200f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:15:49.974775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-89673fb6-910f-480a-8445-470d4ab18db9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:15:49.974775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:15:49.974775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:15:49.974775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:15:49.974775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:15:49.974775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:15:49.974775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:15:49.974775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:15:49.974775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:15:49.974775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:15:49.974775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:15:49.974775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:15:49.974775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:15:49.974775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:15:49.974775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:15:49.974775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:15:49.975729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:15:49.975729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:15:49.975729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:15:49.975729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:15:49.975729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:15:49.975729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:15:49.975729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:15:49.975729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:15:49.975729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:15:49.975729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:15:49.975729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:15:49.975729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:15:49.975729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:15:49.975729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:15:49.975729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:15:49.975729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:15:49.976653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:15:49.976653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:15:49.976653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:15:49.976653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:15:49.976653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:15:49.976653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:15:49.976653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:15:49.976653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:15:49.976653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:15:49.976653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:15:49.976653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:15:49.976653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:15:49.976653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 39/78] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:15:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:15:49.977459 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89673fb6-910f-480a-8445-470d4ab18db9 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:49.984806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-58150d0d-1b06-44e5-9cb1-814f0c6200f2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:15:49.984806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:15:49.984806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:15:49.984806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:15:49.984806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:15:49.984806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:15:49.984806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:15:49.984806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:15:49.984806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:15:49.984806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:15:49.984806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:15:49.984806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:15:49.984806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:15:49.984806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:15:49.984806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:15:49.984806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:15:49.985796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:15:49.985796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:15:49.985796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:15:49.985796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:15:49.985796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:15:49.985796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:15:49.985796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:15:49.985796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:15:49.985796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:15:49.985796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:15:49.985796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:15:49.985796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:15:49.985796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:15:49.985796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:15:49.985796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:15:49.985796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:15:49.987436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:15:49.987436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:15:49.987436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:15:49.987436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:15:49.987436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:15:49.987436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:15:49.987436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:15:49.987436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:15:49.987436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:15:49.987436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:15:49.987436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:15:49.987436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:15:49.987436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 40/79] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jul 18 02:15:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:15:49.987436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58150d0d-1b06-44e5-9cb1-814f0c6200f2 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:50.079522 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89673fb6-910f-480a-8445-470d4ab18db9 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:50.090139 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58150d0d-1b06-44e5-9cb1-814f0c6200f2 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:50.112904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe73abd-a950-4baf-a616-5f704c46dfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:50.113561 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe73abd-a950-4baf-a616-5f704c46dfe2 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:50.113894 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe73abd-a950-4baf-a616-5f704c46dfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:50.114181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe73abd-a950-4baf-a616-5f704c46dfe2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:50.117621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:50.122681 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4446a-5d20-4742-9d28-eb127082f4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:50.123360 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4446a-5d20-4742-9d28-eb127082f4be None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:50.123649 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4446a-5d20-4742-9d28-eb127082f4be None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:50.123932 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb4446a-5d20-4742-9d28-eb127082f4be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:50.174600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:50.184168 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe73abd-a950-4baf-a616-5f704c46dfe2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:50.185680 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe73abd-a950-4baf-a616-5f704c46dfe2 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:50.192886 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4446a-5d20-4742-9d28-eb127082f4be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:50.194405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb4446a-5d20-4742-9d28-eb127082f4be None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:50.283587 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 40/80] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:15:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:50.284457 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe73abd-a950-4baf-a616-5f704c46dfe2 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:50.294742 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 41/81] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:15:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:50.295941 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4446a-5d20-4742-9d28-eb127082f4be None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:50.326169 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:50.380704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:50.391374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe73abd-a950-4baf-a616-5f704c46dfe2 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:50.399224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb4446a-5d20-4742-9d28-eb127082f4be None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:50.425088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965eb42-2811-456c-ae3f-23878b046470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:50.425860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965eb42-2811-456c-ae3f-23878b046470 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:50.426151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965eb42-2811-456c-ae3f-23878b046470 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:50.426436 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965eb42-2811-456c-ae3f-23878b046470 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:50.427861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965eb42-2811-456c-ae3f-23878b046470 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:50.429333 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4965eb42-2811-456c-ae3f-23878b046470 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:50.430998 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 41/82] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:15:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:50.433308 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b6fe1-822a-4bfe-ac65-7b67a038a556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:50.434019 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b6fe1-822a-4bfe-ac65-7b67a038a556 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:50.434311 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b6fe1-822a-4bfe-ac65-7b67a038a556 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:50.434559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965eb42-2811-456c-ae3f-23878b046470 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:50.434672 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b6fe1-822a-4bfe-ac65-7b67a038a556 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:50.435547 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b6fe1-822a-4bfe-ac65-7b67a038a556 None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:15:50.435719 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b6fe1-822a-4bfe-ac65-7b67a038a556 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:50.437092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b6fe1-822a-4bfe-ac65-7b67a038a556 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:50.445361 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 42/83] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:15:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:50.446253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b6fe1-822a-4bfe-ac65-7b67a038a556 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:50.534902 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4965eb42-2811-456c-ae3f-23878b046470 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:50.537181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:50.544274 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b6fe1-822a-4bfe-ac65-7b67a038a556 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:50.568879 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41682c4-f18c-472a-8bdb-b7d094835ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:50.569548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41682c4-f18c-472a-8bdb-b7d094835ccc None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:50.569889 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41682c4-f18c-472a-8bdb-b7d094835ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:50.570174 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41682c4-f18c-472a-8bdb-b7d094835ccc None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:50.570921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41682c4-f18c-472a-8bdb-b7d094835ccc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:15:50.571236 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41682c4-f18c-472a-8bdb-b7d094835ccc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:50.572620 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41682c4-f18c-472a-8bdb-b7d094835ccc None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:50.577522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02842f-ec4d-49cb-9ede-d564677f752f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:50.578400 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02842f-ec4d-49cb-9ede-d564677f752f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:50.578690 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02842f-ec4d-49cb-9ede-d564677f752f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:50.578969 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02842f-ec4d-49cb-9ede-d564677f752f None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:50.580707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02842f-ec4d-49cb-9ede-d564677f752f None admin] RBAC: Authorizing `identity:get_project(project_id=48537ad736fa4427a5c6de586bc429e5)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:50.580992 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 42/84] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:15:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:50.585902 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41682c4-f18c-472a-8bdb-b7d094835ccc None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:50.585986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02842f-ec4d-49cb-9ede-d564677f752f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:50.585986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 43/85] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:15:50 2022] GET /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:50.585986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02842f-ec4d-49cb-9ede-d564677f752f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:50.599904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:50.682281 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41682c4-f18c-472a-8bdb-b7d094835ccc None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:50.684561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02842f-ec4d-49cb-9ede-d564677f752f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:50.715479 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2e08f-cc5f-44c3-a52d-00627609e65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:50.716337 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2e08f-cc5f-44c3-a52d-00627609e65d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:50.716628 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2e08f-cc5f-44c3-a52d-00627609e65d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:50.716908 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2e08f-cc5f-44c3-a52d-00627609e65d None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:50.717848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdad01-fc4a-4ef3-aa87-6e0c6bce0cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:50.718112 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2e08f-cc5f-44c3-a52d-00627609e65d None admin] RBAC: Authorizing `identity:get_project(project_id=48537ad736fa4427a5c6de586bc429e5)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:50.718517 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdad01-fc4a-4ef3-aa87-6e0c6bce0cf5 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:50.718810 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdad01-fc4a-4ef3-aa87-6e0c6bce0cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:50.719093 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cdad01-fc4a-4ef3-aa87-6e0c6bce0cf5 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:50.719568 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb2e08f-cc5f-44c3-a52d-00627609e65d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:50.719804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cdad01-fc4a-4ef3-aa87-6e0c6bce0cf5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:50.721812 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cdad01-fc4a-4ef3-aa87-6e0c6bce0cf5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:50.721948 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 43/86] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:15:50 2022] GET /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:50.722572 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2e08f-cc5f-44c3-a52d-00627609e65d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:50.758438 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:50.802383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 44/87] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jul 18 02:15:50 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:15:50.803478 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdad01-fc4a-4ef3-aa87-6e0c6bce0cf5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:50.824593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2e08f-cc5f-44c3-a52d-00627609e65d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:50.861855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a21c84-41ea-486d-9713-eb7bf4c4c1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:50.862829 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a21c84-41ea-486d-9713-eb7bf4c4c1dc None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:50.863131 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a21c84-41ea-486d-9713-eb7bf4c4c1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:50.863416 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a21c84-41ea-486d-9713-eb7bf4c4c1dc None admin] PATH_INFO: `/v3/users/9757b88abf7e4e979b2025f40c29fca2` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:50.865664 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a21c84-41ea-486d-9713-eb7bf4c4c1dc None admin] RBAC: Authorizing `identity:get_user(user_id=9757b88abf7e4e979b2025f40c29fca2)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:50.867324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a21c84-41ea-486d-9713-eb7bf4c4c1dc None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:50.869375 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 44/88] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:15:50 2022] GET /identity/v3/users/9757b88abf7e4e979b2025f40c29fca2 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:50.870289 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a21c84-41ea-486d-9713-eb7bf4c4c1dc None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:50.904781 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:50.941778 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cdad01-fc4a-4ef3-aa87-6e0c6bce0cf5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:50.987428 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d8dd5-a9b4-4c4a-a7b3-bd8c50c7c965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:50.988323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d8dd5-a9b4-4c4a-a7b3-bd8c50c7c965 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:50.988617 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d8dd5-a9b4-4c4a-a7b3-bd8c50c7c965 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:50.988963 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d8dd5-a9b4-4c4a-a7b3-bd8c50c7c965 None admin] PATH_INFO: `/v3/users/9757b88abf7e4e979b2025f40c29fca2` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:50.991102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d8dd5-a9b4-4c4a-a7b3-bd8c50c7c965 None admin] RBAC: Authorizing `identity:get_user(user_id=9757b88abf7e4e979b2025f40c29fca2)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:50.991756 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d8dd5-a9b4-4c4a-a7b3-bd8c50c7c965 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:50.992384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a21c84-41ea-486d-9713-eb7bf4c4c1dc None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:50.998050 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 45/89] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:15:50 2022] GET /identity/v3/users/9757b88abf7e4e979b2025f40c29fca2 => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:50.998202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:50.998290 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d8dd5-a9b4-4c4a-a7b3-bd8c50c7c965 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:51.030507 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1612d-526d-427b-be25-38873e0da3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:51.031410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1612d-526d-427b-be25-38873e0da3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:51.031710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1612d-526d-427b-be25-38873e0da3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:51.031992 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1612d-526d-427b-be25-38873e0da3a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:51.032898 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1612d-526d-427b-be25-38873e0da3a8 None admin] RBAC: Adding query filter params (role.id=7db255e54afa4cecac2d6c93da70795e, scope.project.id=48537ad736fa4427a5c6de586bc429e5, user.id=9757b88abf7e4e979b2025f40c29fca2) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:15:51.033269 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1612d-526d-427b-be25-38873e0da3a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:51.034719 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1612d-526d-427b-be25-38873e0da3a8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:51.040430 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 45/90] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:15:50 2022] GET /identity/v3/role_assignments?user.id=9757b88abf7e4e979b2025f40c29fca2&scope.project.id=48537ad736fa4427a5c6de586bc429e5&role.id=7db255e54afa4cecac2d6c93da70795e => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:51.041228 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1612d-526d-427b-be25-38873e0da3a8 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:51.185972 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d8dd5-a9b4-4c4a-a7b3-bd8c50c7c965 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:51.231667 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861846f-18e9-4be1-8a21-4634f52b7f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:51.232276 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861846f-18e9-4be1-8a21-4634f52b7f80 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:51.232571 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861846f-18e9-4be1-8a21-4634f52b7f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:51.232862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861846f-18e9-4be1-8a21-4634f52b7f80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:51.233313 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1612d-526d-427b-be25-38873e0da3a8 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:51.233731 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861846f-18e9-4be1-8a21-4634f52b7f80 None admin] RBAC: Adding query filter params (role.id=5dfa34e7a4594751aed7c0495c9a2383, scope.project.id=48537ad736fa4427a5c6de586bc429e5, user.id=66adc49d0e444db3bd259768a9d10521) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:15:51.234079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861846f-18e9-4be1-8a21-4634f52b7f80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:51.235564 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861846f-18e9-4be1-8a21-4634f52b7f80 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:51.243239 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:51.248486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 46/91] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:15:50 2022] GET /identity/v3/role_assignments?user.id=66adc49d0e444db3bd259768a9d10521&scope.project.id=48537ad736fa4427a5c6de586bc429e5&role.id=5dfa34e7a4594751aed7c0495c9a2383 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:51.249852 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861846f-18e9-4be1-8a21-4634f52b7f80 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:51.298109 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb8c40-7ce9-4af8-b8fb-5ea473e7b9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:51.301731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb8c40-7ce9-4af8-b8fb-5ea473e7b9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:51.301731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb8c40-7ce9-4af8-b8fb-5ea473e7b9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:51.301731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb8c40-7ce9-4af8-b8fb-5ea473e7b9a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:51.388978 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861846f-18e9-4be1-8a21-4634f52b7f80 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:51.396575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:51.433319 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b665c2f-ff6f-489d-893b-cf641461bf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:51.434304 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b665c2f-ff6f-489d-893b-cf641461bf3d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:51.434601 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b665c2f-ff6f-489d-893b-cf641461bf3d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:51.434892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b665c2f-ff6f-489d-893b-cf641461bf3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:51.512046 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb8c40-7ce9-4af8-b8fb-5ea473e7b9a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:51.513482 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb8c40-7ce9-4af8-b8fb-5ea473e7b9a6 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:51.539246 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b665c2f-ff6f-489d-893b-cf641461bf3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:51.540813 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b665c2f-ff6f-489d-893b-cf641461bf3d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:51.562267 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:51.616893 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 46/92] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:15:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:51.622473 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb8c40-7ce9-4af8-b8fb-5ea473e7b9a6 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:51.707328 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 47/93] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:15:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:51.719036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b665c2f-ff6f-489d-893b-cf641461bf3d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:51.769961 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:51.840666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb8c40-7ce9-4af8-b8fb-5ea473e7b9a6 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:51.889352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:51.893891 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b665c2f-ff6f-489d-893b-cf641461bf3d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:51.910201 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8797a3-4835-4f18-8e27-a6442088e98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:51.911146 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8797a3-4835-4f18-8e27-a6442088e98a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:51.911444 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8797a3-4835-4f18-8e27-a6442088e98a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:51.911723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8797a3-4835-4f18-8e27-a6442088e98a None admin] PATH_INFO: `/v3/projects/e48a95df903142ff822f7db19eabf2cb` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:51.914508 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8797a3-4835-4f18-8e27-a6442088e98a None admin] RBAC: Authorizing `identity:get_project(project_id=e48a95df903142ff822f7db19eabf2cb)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:51.916027 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8797a3-4835-4f18-8e27-a6442088e98a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:51.918101 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 47/94] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:15:51 2022] GET /identity/v3/projects/e48a95df903142ff822f7db19eabf2cb => generated 312 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:15:51.924264 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8797a3-4835-4f18-8e27-a6442088e98a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:51.953813 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f708c-ae71-4a4f-8e58-dccc6465781c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:51.955524 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f708c-ae71-4a4f-8e58-dccc6465781c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:51.955824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f708c-ae71-4a4f-8e58-dccc6465781c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:51.956113 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f708c-ae71-4a4f-8e58-dccc6465781c None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:51.957362 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f708c-ae71-4a4f-8e58-dccc6465781c None admin] RBAC: Authorizing `identity:get_project(project_id=48537ad736fa4427a5c6de586bc429e5)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:51.958880 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f708c-ae71-4a4f-8e58-dccc6465781c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:51.961804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 48/95] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:15:51 2022] GET /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:51.968035 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f708c-ae71-4a4f-8e58-dccc6465781c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:52.108035 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f708c-ae71-4a4f-8e58-dccc6465781c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:52.157181 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be33704-0d0f-4852-bae8-414590d9fb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:52.158443 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be33704-0d0f-4852-bae8-414590d9fb53 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:52.158692 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be33704-0d0f-4852-bae8-414590d9fb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:52.158975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be33704-0d0f-4852-bae8-414590d9fb53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:52.159808 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be33704-0d0f-4852-bae8-414590d9fb53 None admin] RBAC: Adding query filter params (role.id=aa317d762bd64a9d864e54d074507f94, scope.project.id=48537ad736fa4427a5c6de586bc429e5, user.id=9757b88abf7e4e979b2025f40c29fca2) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:15:52.160125 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be33704-0d0f-4852-bae8-414590d9fb53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:52.161575 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be33704-0d0f-4852-bae8-414590d9fb53 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:52.172020 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 49/96] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:15:51 2022] GET /identity/v3/role_assignments?user.id=9757b88abf7e4e979b2025f40c29fca2&scope.project.id=48537ad736fa4427a5c6de586bc429e5&role.id=aa317d762bd64a9d864e54d074507f94 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:15:52.209978 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8797a3-4835-4f18-8e27-a6442088e98a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:52.269012 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc456d9d-daf9-4431-bd72-684102b0c3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:52.269683 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc456d9d-daf9-4431-bd72-684102b0c3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:52.269997 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc456d9d-daf9-4431-bd72-684102b0c3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:52.270278 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc456d9d-daf9-4431-bd72-684102b0c3b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:52.271127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc456d9d-daf9-4431-bd72-684102b0c3b1 None admin] RBAC: Adding query filter params (role.id=7db255e54afa4cecac2d6c93da70795e, scope.project.id=e48a95df903142ff822f7db19eabf2cb, user.id=9757b88abf7e4e979b2025f40c29fca2) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:15:52.271444 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc456d9d-daf9-4431-bd72-684102b0c3b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:52.272906 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc456d9d-daf9-4431-bd72-684102b0c3b1 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:52.274940 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:52.282257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 48/97] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:15:51 2022] GET /identity/v3/role_assignments?user.id=9757b88abf7e4e979b2025f40c29fca2&scope.project.id=e48a95df903142ff822f7db19eabf2cb&role.id=7db255e54afa4cecac2d6c93da70795e => generated 259 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:15:53.626210 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6efd05-e647-4962-9a86-6f5b227018b8 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:53.627734 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6efd05-e647-4962-9a86-6f5b227018b8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:53.628217 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6efd05-e647-4962-9a86-6f5b227018b8 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:53.629818 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 50/98] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:53.635279 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40b65e-ab41-46ac-92c0-2e41159a544a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:53.636107 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40b65e-ab41-46ac-92c0-2e41159a544a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:53.636586 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be40b65e-ab41-46ac-92c0-2e41159a544a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:53.662727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-be40b65e-ab41-46ac-92c0-2e41159a544a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:53.664243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-be40b65e-ab41-46ac-92c0-2e41159a544a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:53.751851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 49/99] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:53.785818 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6efd05-e647-4962-9a86-6f5b227018b8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:53.824300 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:53.857907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50357c02-8e22-4369-9989-12a94944ce99 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:53.858225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50357c02-8e22-4369-9989-12a94944ce99 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:53.858470 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50357c02-8e22-4369-9989-12a94944ce99 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:53.859845 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 50/100] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:15:53.865437 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b299f81-09f0-4d9b-8cca-3b4b5a3c66d4 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:53.865751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b299f81-09f0-4d9b-8cca-3b4b5a3c66d4 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:53.866041 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b299f81-09f0-4d9b-8cca-3b4b5a3c66d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:53.894710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-6b299f81-09f0-4d9b-8cca-3b4b5a3c66d4 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:53.896389 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6b299f81-09f0-4d9b-8cca-3b4b5a3c66d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:53.911106 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6efd05-e647-4962-9a86-6f5b227018b8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:53.946327 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e714ce-eb69-46cf-b148-c9ec9ce1b050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:53.947355 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e714ce-eb69-46cf-b148-c9ec9ce1b050 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:53.947836 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e714ce-eb69-46cf-b148-c9ec9ce1b050 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:53.948280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e714ce-eb69-46cf-b148-c9ec9ce1b050 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:53.959239 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e714ce-eb69-46cf-b148-c9ec9ce1b050 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:15:53.967268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-37e714ce-eb69-46cf-b148-c9ec9ce1b050 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 02:15:53.967268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:15:53.967268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:15:53.967268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:15:53.967268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:15:53.967268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:15:53.967268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:15:53.967268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:15:53.967268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:15:53.967268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:15:53.967268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:15:53.967268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:15:53.967268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:15:53.967268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:15:53.967268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:15:53.967268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:15:53.968103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:15:53.968103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:15:53.968103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:15:53.968103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:15:53.968103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:15:53.968103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:15:53.968103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:15:53.968103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:15:53.968103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:15:53.968103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:15:53.968103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:15:53.968103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:15:53.968103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:15:53.968103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:15:53.968103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:15:53.968103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:15:53.968834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:15:53.968834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:15:53.968834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:15:53.968834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:15:53.968834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:15:53.968834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:15:53.968834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:15:53.968834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:15:53.968834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:15:53.968834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:15:53.968834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 02:15:53.968834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:15:53.971330 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 51/101] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:15:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:15:53.977993 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e714ce-eb69-46cf-b148-c9ec9ce1b050 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:54.023214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 51/102] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:15:54.074758 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b299f81-09f0-4d9b-8cca-3b4b5a3c66d4 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:54.191062 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:54.195174 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:54.210343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e714ce-eb69-46cf-b148-c9ec9ce1b050 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:54.264042 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b299f81-09f0-4d9b-8cca-3b4b5a3c66d4 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:54.297743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b008cd2-8622-4941-862c-1f4b5534aaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:54.298755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b008cd2-8622-4941-862c-1f4b5534aaa1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:54.299183 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b008cd2-8622-4941-862c-1f4b5534aaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:54.299625 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b008cd2-8622-4941-862c-1f4b5534aaa1 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:54.300532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b008cd2-8622-4941-862c-1f4b5534aaa1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:15:54.300991 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b008cd2-8622-4941-862c-1f4b5534aaa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:54.309736 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b008cd2-8622-4941-862c-1f4b5534aaa1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:54.309875 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344206c5-d727-4ff3-8d80-c0cb26687628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:54.310603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344206c5-d727-4ff3-8d80-c0cb26687628 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:54.311103 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344206c5-d727-4ff3-8d80-c0cb26687628 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:54.311594 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344206c5-d727-4ff3-8d80-c0cb26687628 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:54.323314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344206c5-d727-4ff3-8d80-c0cb26687628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:15:54.329068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 52/103] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:15:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:15:54.337727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-344206c5-d727-4ff3-8d80-c0cb26687628 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:15:54.337727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:15:54.337727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:15:54.337727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:15:54.337727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:15:54.337727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:15:54.337727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:15:54.337727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:15:54.337727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:15:54.337727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:15:54.337727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:15:54.337727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:15:54.337727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:15:54.337727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:15:54.337727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:15:54.337727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:15:54.338622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:15:54.338622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:15:54.338622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:15:54.338622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:15:54.338622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:15:54.338622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:15:54.338622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:15:54.338622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:15:54.338622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:15:54.338622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:15:54.338622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:15:54.338622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:15:54.338622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:15:54.338622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:15:54.338622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:15:54.338622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:15:54.339374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:15:54.339374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:15:54.339374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:15:54.339374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:15:54.339374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:15:54.339374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:15:54.339374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:15:54.339374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:15:54.339374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:15:54.339374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:15:54.339374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:15:54.339374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:15:54.339941 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b008cd2-8622-4941-862c-1f4b5534aaa1 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:54.341970 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 52/104] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:15:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:15:54.355095 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344206c5-d727-4ff3-8d80-c0cb26687628 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:54.471242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b008cd2-8622-4941-862c-1f4b5534aaa1 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:54.471432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344206c5-d727-4ff3-8d80-c0cb26687628 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:54.489725 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:54.506611 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c59588-203e-4a45-8ee3-3754005e8591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:54.509889 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c59588-203e-4a45-8ee3-3754005e8591 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:54.509889 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c59588-203e-4a45-8ee3-3754005e8591 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:54.509889 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c59588-203e-4a45-8ee3-3754005e8591 None admin] PATH_INFO: `/v3/users/99e2f2e318f94903bb19738696e1da20` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:54.510180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f4b1e5-08d9-44e7-89ef-7d30ff8f11dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:54.510180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4b1e5-08d9-44e7-89ef-7d30ff8f11dc None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:54.510180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4b1e5-08d9-44e7-89ef-7d30ff8f11dc None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:54.510180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f4b1e5-08d9-44e7-89ef-7d30ff8f11dc None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:54.511407 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4b1e5-08d9-44e7-89ef-7d30ff8f11dc None admin] RBAC: Adding query filter params (name=member) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:15:54.511916 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4b1e5-08d9-44e7-89ef-7d30ff8f11dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:54.513519 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f4b1e5-08d9-44e7-89ef-7d30ff8f11dc None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:54.522509 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c59588-203e-4a45-8ee3-3754005e8591 None admin] RBAC: Authorizing `identity:get_user(user_id=99e2f2e318f94903bb19738696e1da20)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:54.522890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 53/105] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:15:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:15:54.524361 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4490fcc-af1f-4964-93ad-04799787baee None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:54.524559 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c59588-203e-4a45-8ee3-3754005e8591 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:54.524951 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4490fcc-af1f-4964-93ad-04799787baee None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:54.525335 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4490fcc-af1f-4964-93ad-04799787baee None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:54.526747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 54/106] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:54.533727 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 53/107] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:15:54 2022] GET /identity/v3/users/99e2f2e318f94903bb19738696e1da20 => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:54.533867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7b2c5-f0f0-4aec-b9c7-000b423711ff None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:54.533867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7b2c5-f0f0-4aec-b9c7-000b423711ff None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:54.533867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7b2c5-f0f0-4aec-b9c7-000b423711ff None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:54.533867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 55/108] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:54.533867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7b2c5-f0f0-4aec-b9c7-000b423711ff None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:54.535909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fee86-baf5-4231-aa4e-f6b8e47a8207 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:54.536362 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fee86-baf5-4231-aa4e-f6b8e47a8207 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:54.536779 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517fee86-baf5-4231-aa4e-f6b8e47a8207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:54.555383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-517fee86-baf5-4231-aa4e-f6b8e47a8207 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:54.556837 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-517fee86-baf5-4231-aa4e-f6b8e47a8207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:54.565309 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:54.637759 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 54/109] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:54.637759 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fee86-baf5-4231-aa4e-f6b8e47a8207 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:54.673767 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7b2c5-f0f0-4aec-b9c7-000b423711ff None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:54.726393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1a7c6-8c3c-41ad-a832-72c25aec126b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:54.727568 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1a7c6-8c3c-41ad-a832-72c25aec126b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:54.727932 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1a7c6-8c3c-41ad-a832-72c25aec126b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:54.728311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1a7c6-8c3c-41ad-a832-72c25aec126b None admin] PATH_INFO: `/v3/users/9757b88abf7e4e979b2025f40c29fca2` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:54.730058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1a7c6-8c3c-41ad-a832-72c25aec126b None admin] RBAC: Authorizing `identity:get_user(user_id=9757b88abf7e4e979b2025f40c29fca2)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:54.731992 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1a7c6-8c3c-41ad-a832-72c25aec126b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:54.734144 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 56/110] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:15:54 2022] GET /identity/v3/users/9757b88abf7e4e979b2025f40c29fca2 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:54.735347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9da3c-0379-4455-826d-b91dd587bee4 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:54.736141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9da3c-0379-4455-826d-b91dd587bee4 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:54.736437 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9da3c-0379-4455-826d-b91dd587bee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:54.751366 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517fee86-baf5-4231-aa4e-f6b8e47a8207 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:54.753411 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-27e9da3c-0379-4455-826d-b91dd587bee4 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:54.754859 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-27e9da3c-0379-4455-826d-b91dd587bee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:54.797947 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982900a3-0b00-44b4-82b9-522e65555622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:54.799145 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982900a3-0b00-44b4-82b9-522e65555622 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:54.799441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982900a3-0b00-44b4-82b9-522e65555622 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:54.799722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982900a3-0b00-44b4-82b9-522e65555622 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:54.803255 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:54.816066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:54.827375 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 57/111] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:54.828431 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9da3c-0379-4455-826d-b91dd587bee4 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:54.882528 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982900a3-0b00-44b4-82b9-522e65555622 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:54.884024 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982900a3-0b00-44b4-82b9-522e65555622 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:54.947171 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9da3c-0379-4455-826d-b91dd587bee4 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:54.982285 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85697d2c-212d-4d9f-9b2c-f571850f6fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:54.983018 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85697d2c-212d-4d9f-9b2c-f571850f6fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:54.983312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85697d2c-212d-4d9f-9b2c-f571850f6fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:54.983590 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85697d2c-212d-4d9f-9b2c-f571850f6fc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:54.993814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85697d2c-212d-4d9f-9b2c-f571850f6fc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:15:54.996490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 55/112] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:15:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:54.997612 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982900a3-0b00-44b4-82b9-522e65555622 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:55.002220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-85697d2c-212d-4d9f-9b2c-f571850f6fc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:15:55.002220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:15:55.002220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:15:55.002220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:15:55.002220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:15:55.002220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:15:55.002220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:15:55.002220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:15:55.002220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:15:55.002220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:15:55.002220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:15:55.002220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:15:55.002220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:15:55.002220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:15:55.002220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:15:55.002220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:15:55.003175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:15:55.003175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:15:55.003175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:15:55.003175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:15:55.003175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:15:55.003175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:15:55.003175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:15:55.003175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:15:55.003175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:15:55.003175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:15:55.003175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:15:55.003175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:15:55.003175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:15:55.003175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:15:55.003175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:15:55.003175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:15:55.003947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:15:55.003947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:15:55.003947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:15:55.003947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:15:55.003947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:15:55.003947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:15:55.003947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:15:55.003947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:15:55.003947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:15:55.003947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:15:55.003947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:15:55.003947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:15:55.003947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 58/113] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:15:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:15:55.005991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10670c2-4aa1-44db-87d1-fc2006a7b0a0 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:55.005991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10670c2-4aa1-44db-87d1-fc2006a7b0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:55.005991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10670c2-4aa1-44db-87d1-fc2006a7b0a0 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:55.006506 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 59/114] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:55.007197 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10670c2-4aa1-44db-87d1-fc2006a7b0a0 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:55.051573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:55.054817 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:55.108619 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982900a3-0b00-44b4-82b9-522e65555622 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:55.127041 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10670c2-4aa1-44db-87d1-fc2006a7b0a0 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:55.152664 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca0dbf-c4c5-40c2-99cb-870492cb864e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:55.153551 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca0dbf-c4c5-40c2-99cb-870492cb864e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:55.153878 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca0dbf-c4c5-40c2-99cb-870492cb864e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:55.154159 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca0dbf-c4c5-40c2-99cb-870492cb864e None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:55.155525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca0dbf-c4c5-40c2-99cb-870492cb864e None admin] RBAC: Authorizing `identity:get_project(project_id=48537ad736fa4427a5c6de586bc429e5)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:55.156975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca0dbf-c4c5-40c2-99cb-870492cb864e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:55.158765 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 56/115] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:15:54 2022] GET /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:55.159536 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca0dbf-c4c5-40c2-99cb-870492cb864e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:55.172343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2fb91-b5be-4575-8432-1a80eb77029f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:55.173196 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2fb91-b5be-4575-8432-1a80eb77029f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:55.173490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2fb91-b5be-4575-8432-1a80eb77029f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:55.174172 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef2fb91-b5be-4575-8432-1a80eb77029f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:55.175704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2fb91-b5be-4575-8432-1a80eb77029f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:55.177768 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef2fb91-b5be-4575-8432-1a80eb77029f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:55.184801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 60/116] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:15:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:55.184801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2fb91-b5be-4575-8432-1a80eb77029f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:55.268030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca0dbf-c4c5-40c2-99cb-870492cb864e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:55.279052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:55.289900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef2fb91-b5be-4575-8432-1a80eb77029f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:55.296878 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:55.302322 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e084e2-5888-42c1-9c32-914e5b846a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:55.303447 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e084e2-5888-42c1-9c32-914e5b846a94 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:55.303733 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e084e2-5888-42c1-9c32-914e5b846a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:55.304012 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e084e2-5888-42c1-9c32-914e5b846a94 None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:55.305191 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e084e2-5888-42c1-9c32-914e5b846a94 None admin] RBAC: Authorizing `identity:get_project(project_id=48537ad736fa4427a5c6de586bc429e5)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:55.306668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e084e2-5888-42c1-9c32-914e5b846a94 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:55.308434 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 57/117] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:15:55 2022] GET /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:55.313380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78be08b-cfa7-4611-9f96-4e8303085972 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:55.313380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78be08b-cfa7-4611-9f96-4e8303085972 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:55.313380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78be08b-cfa7-4611-9f96-4e8303085972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:55.328786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cdcb8-cf8f-4c3f-8ca1-1da052c233d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:55.329294 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b78be08b-cfa7-4611-9f96-4e8303085972 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:55.329532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cdcb8-cf8f-4c3f-8ca1-1da052c233d5 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:55.329862 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cdcb8-cf8f-4c3f-8ca1-1da052c233d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:55.330148 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cdcb8-cf8f-4c3f-8ca1-1da052c233d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:55.330573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b78be08b-cfa7-4611-9f96-4e8303085972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:55.330904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cdcb8-cf8f-4c3f-8ca1-1da052c233d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:15:55.331219 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cdcb8-cf8f-4c3f-8ca1-1da052c233d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:55.332610 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cdcb8-cf8f-4c3f-8ca1-1da052c233d5 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:55.341298 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 61/118] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:15:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:55.343120 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cdcb8-cf8f-4c3f-8ca1-1da052c233d5 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:55.399036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 58/119] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:55.399936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78be08b-cfa7-4611-9f96-4e8303085972 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:55.443481 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cdcb8-cf8f-4c3f-8ca1-1da052c233d5 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:55.477529 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada7cc7-2228-4973-9cba-fdb99f18254d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:55.478486 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada7cc7-2228-4973-9cba-fdb99f18254d None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:55.478838 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada7cc7-2228-4973-9cba-fdb99f18254d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:55.479120 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada7cc7-2228-4973-9cba-fdb99f18254d None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5/users/9757b88abf7e4e979b2025f40c29fca2/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:55.481108 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada7cc7-2228-4973-9cba-fdb99f18254d None admin] RBAC: Authorizing `identity:create_grant(project_id=48537ad736fa4427a5c6de586bc429e5, user_id=9757b88abf7e4e979b2025f40c29fca2, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:55.482847 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada7cc7-2228-4973-9cba-fdb99f18254d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:55.504830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78be08b-cfa7-4611-9f96-4e8303085972 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:55.514012 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:55.538400 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515ab22-c749-4753-adc1-c04e9815e6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:55.539003 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515ab22-c749-4753-adc1-c04e9815e6b7 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:55.539287 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515ab22-c749-4753-adc1-c04e9815e6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:55.539566 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515ab22-c749-4753-adc1-c04e9815e6b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:55.540273 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515ab22-c749-4753-adc1-c04e9815e6b7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:55.541726 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515ab22-c749-4753-adc1-c04e9815e6b7 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:55.556345 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 62/120] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:15:55 2022] PUT /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5/users/9757b88abf7e4e979b2025f40c29fca2/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:15:55.557217 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada7cc7-2228-4973-9cba-fdb99f18254d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:55.589053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:55.636304 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 59/121] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jul 18 02:15:55 2022] POST /identity/v3/projects => generated 302 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:15:55.646600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b28ac-cb6f-47ee-b113-cca1e0b666c7 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:55.647258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b28ac-cb6f-47ee-b113-cca1e0b666c7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:55.647258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b28ac-cb6f-47ee-b113-cca1e0b666c7 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:55.648579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 60/122] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:55.649259 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b28ac-cb6f-47ee-b113-cca1e0b666c7 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:55.671847 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada7cc7-2228-4973-9cba-fdb99f18254d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:55.727749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665028cf-6c7a-4f38-a60f-187e8ade8a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:55.728436 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665028cf-6c7a-4f38-a60f-187e8ade8a7f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:55.728729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665028cf-6c7a-4f38-a60f-187e8ade8a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:55.729006 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665028cf-6c7a-4f38-a60f-187e8ade8a7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:55.729916 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665028cf-6c7a-4f38-a60f-187e8ade8a7f None admin] RBAC: Adding query filter params (role.id=428c7cbed69f4893a907b0f69ab8eb98, scope.project.id=48537ad736fa4427a5c6de586bc429e5, user.id=99e2f2e318f94903bb19738696e1da20) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:15:55.730333 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665028cf-6c7a-4f38-a60f-187e8ade8a7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:55.731908 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665028cf-6c7a-4f38-a60f-187e8ade8a7f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:55.738410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 63/123] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:15:55 2022] GET /identity/v3/role_assignments?user.id=99e2f2e318f94903bb19738696e1da20&scope.project.id=48537ad736fa4427a5c6de586bc429e5&role.id=428c7cbed69f4893a907b0f69ab8eb98 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:55.739443 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665028cf-6c7a-4f38-a60f-187e8ade8a7f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:55.812265 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7b28ac-cb6f-47ee-b113-cca1e0b666c7 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:55.854211 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:55.865540 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665028cf-6c7a-4f38-a60f-187e8ade8a7f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:55.868508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c9e62-1e8f-4067-9710-6c59f5e00251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:55.869743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c9e62-1e8f-4067-9710-6c59f5e00251 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:55.870206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c9e62-1e8f-4067-9710-6c59f5e00251 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:55.870745 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c9e62-1e8f-4067-9710-6c59f5e00251 None admin] PATH_INFO: `/v3/users/66adc49d0e444db3bd259768a9d10521` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:55.872309 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c9e62-1e8f-4067-9710-6c59f5e00251 None admin] RBAC: Authorizing `identity:get_user(user_id=66adc49d0e444db3bd259768a9d10521)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:55.874042 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c9e62-1e8f-4067-9710-6c59f5e00251 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:55.876150 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 61/124] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:15:55 2022] GET /identity/v3/users/66adc49d0e444db3bd259768a9d10521 => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:55.878376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1fc7b-5ceb-4d14-b8bb-aac5bef9750e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:55.878939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1fc7b-5ceb-4d14-b8bb-aac5bef9750e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:55.879482 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1fc7b-5ceb-4d14-b8bb-aac5bef9750e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:55.899336 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-59a1fc7b-5ceb-4d14-b8bb-aac5bef9750e None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:55.900912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-59a1fc7b-5ceb-4d14-b8bb-aac5bef9750e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:55.923074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64102499-2b09-4593-a56b-d9a93efa4b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:55.924028 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64102499-2b09-4593-a56b-d9a93efa4b55 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:55.924327 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64102499-2b09-4593-a56b-d9a93efa4b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:55.924611 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64102499-2b09-4593-a56b-d9a93efa4b55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:55.933234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:55.940790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64102499-2b09-4593-a56b-d9a93efa4b55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:15:55.954155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-64102499-2b09-4593-a56b-d9a93efa4b55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:15:55.954155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:15:55.954155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:15:55.954155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:15:55.954155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:15:55.954155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:15:55.954155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:15:55.954155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:15:55.954155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:15:55.954155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:15:55.954155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:15:55.954155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:15:55.954155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:15:55.954155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:15:55.954155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:15:55.954155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:15:55.955262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:15:55.955262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:15:55.955262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:15:55.955262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:15:55.955262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:15:55.955262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:15:55.955262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:15:55.955262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:15:55.955262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:15:55.955262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:15:55.955262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:15:55.955262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:15:55.955262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:15:55.955262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:15:55.955262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:15:55.955262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:15:55.956091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:15:55.956091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:15:55.956091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:15:55.956091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:15:55.956091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:15:55.956091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:15:55.956091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:15:55.956091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:15:55.956091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:15:55.956091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:15:55.956091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:15:55.956091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:15:55.956091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 64/125] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:15:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:15:55.957258 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64102499-2b09-4593-a56b-d9a93efa4b55 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:55.997640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 62/126] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:56.002894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1fc7b-5ceb-4d14-b8bb-aac5bef9750e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:56.137615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64102499-2b09-4593-a56b-d9a93efa4b55 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:56.169747 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1fc7b-5ceb-4d14-b8bb-aac5bef9750e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:56.174434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6850bc-10b0-4291-b016-eb7812d2ac13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:56.175569 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6850bc-10b0-4291-b016-eb7812d2ac13 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:56.176051 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6850bc-10b0-4291-b016-eb7812d2ac13 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:56.176547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6850bc-10b0-4291-b016-eb7812d2ac13 None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:56.178237 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6850bc-10b0-4291-b016-eb7812d2ac13 None admin] RBAC: Authorizing `identity:get_project(project_id=48537ad736fa4427a5c6de586bc429e5)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:56.179923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6850bc-10b0-4291-b016-eb7812d2ac13 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:56.182194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 65/127] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:15:55 2022] GET /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:56.183159 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6850bc-10b0-4291-b016-eb7812d2ac13 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:56.207481 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:56.212967 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92709bb0-1265-4f7d-a611-23b39d78810d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:56.213867 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92709bb0-1265-4f7d-a611-23b39d78810d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:56.214298 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92709bb0-1265-4f7d-a611-23b39d78810d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:56.214744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92709bb0-1265-4f7d-a611-23b39d78810d None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:56.219928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92709bb0-1265-4f7d-a611-23b39d78810d None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:15:56.219928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92709bb0-1265-4f7d-a611-23b39d78810d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:56.219928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92709bb0-1265-4f7d-a611-23b39d78810d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:56.227216 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 63/128] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:15:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:56.228470 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92709bb0-1265-4f7d-a611-23b39d78810d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:56.262485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:56.335347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92709bb0-1265-4f7d-a611-23b39d78810d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:56.347210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6850bc-10b0-4291-b016-eb7812d2ac13 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:56.374250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27d5bf-8812-4a8f-b6c4-99e5793eea32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:56.375680 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27d5bf-8812-4a8f-b6c4-99e5793eea32 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:56.377645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27d5bf-8812-4a8f-b6c4-99e5793eea32 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:56.378291 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27d5bf-8812-4a8f-b6c4-99e5793eea32 None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5/users/66adc49d0e444db3bd259768a9d10521/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:56.382364 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27d5bf-8812-4a8f-b6c4-99e5793eea32 None admin] RBAC: Authorizing `identity:create_grant(project_id=48537ad736fa4427a5c6de586bc429e5, user_id=66adc49d0e444db3bd259768a9d10521, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:56.385196 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27d5bf-8812-4a8f-b6c4-99e5793eea32 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:56.410890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a84e16-0d06-4231-b79f-96e098c2a1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:56.412066 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a84e16-0d06-4231-b79f-96e098c2a1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:56.412581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a84e16-0d06-4231-b79f-96e098c2a1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:56.413062 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a84e16-0d06-4231-b79f-96e098c2a1d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:56.425252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a84e16-0d06-4231-b79f-96e098c2a1d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:15:56.434257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-46a84e16-0d06-4231-b79f-96e098c2a1d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:15:56.434257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:15:56.434257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:15:56.434257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:15:56.434257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:15:56.434257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:15:56.434257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:15:56.434257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:15:56.434257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:15:56.434257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:15:56.434257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:15:56.434257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:15:56.434257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:15:56.434257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:15:56.434257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:15:56.434257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:15:56.436514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:15:56.436514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:15:56.436514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:15:56.436514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:15:56.436514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:15:56.436514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:15:56.436514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:15:56.436514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:15:56.436514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:15:56.436514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:15:56.436514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:15:56.436514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:15:56.436514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:15:56.436514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:15:56.436514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:15:56.436514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:15:56.437464 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:15:56.437464 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:15:56.437464 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:15:56.437464 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:15:56.437464 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:15:56.437464 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:15:56.437464 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:15:56.437464 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:15:56.437464 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:15:56.437464 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:15:56.437464 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:15:56.437464 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:15:56.437464 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 66/129] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jul 18 02:15:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:15:56.438270 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a84e16-0d06-4231-b79f-96e098c2a1d6 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:56.493364 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 64/130] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:15:56 2022] PUT /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5/users/66adc49d0e444db3bd259768a9d10521/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:15:56.498689 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27d5bf-8812-4a8f-b6c4-99e5793eea32 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:56.568767 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:56.630223 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a84e16-0d06-4231-b79f-96e098c2a1d6 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:56.684171 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:56.700296 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806cdc0-6e4c-4e57-92da-c5dc6ac71c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:56.701378 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806cdc0-6e4c-4e57-92da-c5dc6ac71c1f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:56.701804 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806cdc0-6e4c-4e57-92da-c5dc6ac71c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:56.702191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5806cdc0-6e4c-4e57-92da-c5dc6ac71c1f None admin] PATH_INFO: `/v3/users/9757b88abf7e4e979b2025f40c29fca2` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:56.706758 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806cdc0-6e4c-4e57-92da-c5dc6ac71c1f None admin] RBAC: Authorizing `identity:get_user(user_id=9757b88abf7e4e979b2025f40c29fca2)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:56.708550 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5806cdc0-6e4c-4e57-92da-c5dc6ac71c1f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:56.711121 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 67/131] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:15:56 2022] GET /identity/v3/users/9757b88abf7e4e979b2025f40c29fca2 => generated 275 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:56.717591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806cdc0-6e4c-4e57-92da-c5dc6ac71c1f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:56.726967 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27d5bf-8812-4a8f-b6c4-99e5793eea32 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:56.797323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87c31d-abea-4536-bec6-301ab50261df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:56.798258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87c31d-abea-4536-bec6-301ab50261df None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:56.799704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87c31d-abea-4536-bec6-301ab50261df None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:56.800097 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87c31d-abea-4536-bec6-301ab50261df None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:56.801184 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87c31d-abea-4536-bec6-301ab50261df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:15:56.802313 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87c31d-abea-4536-bec6-301ab50261df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:56.804234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d87c31d-abea-4536-bec6-301ab50261df None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:56.820123 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 65/132] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:15:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:56.826749 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87c31d-abea-4536-bec6-301ab50261df None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:56.874802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5806cdc0-6e4c-4e57-92da-c5dc6ac71c1f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:56.922643 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93629274-bf90-43df-b338-f4f6ea6d1563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:56.923740 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93629274-bf90-43df-b338-f4f6ea6d1563 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:56.924099 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93629274-bf90-43df-b338-f4f6ea6d1563 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:56.924482 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93629274-bf90-43df-b338-f4f6ea6d1563 None admin] PATH_INFO: `/v3/projects/e48a95df903142ff822f7db19eabf2cb` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:56.927240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93629274-bf90-43df-b338-f4f6ea6d1563 None admin] RBAC: Authorizing `identity:get_project(project_id=e48a95df903142ff822f7db19eabf2cb)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:56.929098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93629274-bf90-43df-b338-f4f6ea6d1563 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:56.931766 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 68/133] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:15:56 2022] GET /identity/v3/projects/e48a95df903142ff822f7db19eabf2cb => generated 312 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:15:56.937511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93629274-bf90-43df-b338-f4f6ea6d1563 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:56.959114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:57.085357 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93629274-bf90-43df-b338-f4f6ea6d1563 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:57.112452 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87c31d-abea-4536-bec6-301ab50261df None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:57.138922 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606b921-5911-45d8-a5d3-a100521ba042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:57.140529 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606b921-5911-45d8-a5d3-a100521ba042 None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:57.140966 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606b921-5911-45d8-a5d3-a100521ba042 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:57.141353 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606b921-5911-45d8-a5d3-a100521ba042 None admin] PATH_INFO: `/v3/projects/e48a95df903142ff822f7db19eabf2cb/users/9757b88abf7e4e979b2025f40c29fca2/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:57.147843 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606b921-5911-45d8-a5d3-a100521ba042 None admin] RBAC: Authorizing `identity:create_grant(project_id=e48a95df903142ff822f7db19eabf2cb, user_id=9757b88abf7e4e979b2025f40c29fca2, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:57.149858 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606b921-5911-45d8-a5d3-a100521ba042 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:57.187367 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c975cd7-4e94-42d3-a0c5-d3759d4ca0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:57.188313 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c975cd7-4e94-42d3-a0c5-d3759d4ca0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:57.188566 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c975cd7-4e94-42d3-a0c5-d3759d4ca0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:57.188886 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c975cd7-4e94-42d3-a0c5-d3759d4ca0e0 None admin] PATH_INFO: `/v3/users/9757b88abf7e4e979b2025f40c29fca2` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:57.192162 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c975cd7-4e94-42d3-a0c5-d3759d4ca0e0 None admin] RBAC: Authorizing `identity:get_user(user_id=9757b88abf7e4e979b2025f40c29fca2)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:57.193684 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c975cd7-4e94-42d3-a0c5-d3759d4ca0e0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:57.195583 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 66/134] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:15:56 2022] GET /identity/v3/users/9757b88abf7e4e979b2025f40c29fca2 => generated 275 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:57.200683 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c975cd7-4e94-42d3-a0c5-d3759d4ca0e0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:57.228545 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:57.240750 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 69/135] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:15:56 2022] PUT /identity/v3/projects/e48a95df903142ff822f7db19eabf2cb/users/9757b88abf7e4e979b2025f40c29fca2/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:15:57.350502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c975cd7-4e94-42d3-a0c5-d3759d4ca0e0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:57.399465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef523802-a354-49d3-8a0e-1db965bf3347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:57.400373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef523802-a354-49d3-8a0e-1db965bf3347 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:57.400670 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef523802-a354-49d3-8a0e-1db965bf3347 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:57.400949 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef523802-a354-49d3-8a0e-1db965bf3347 None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:57.402274 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef523802-a354-49d3-8a0e-1db965bf3347 None admin] RBAC: Authorizing `identity:get_project(project_id=48537ad736fa4427a5c6de586bc429e5)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:57.403752 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef523802-a354-49d3-8a0e-1db965bf3347 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:57.405740 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 67/136] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:15:57 2022] GET /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:15:57.412389 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606b921-5911-45d8-a5d3-a100521ba042 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:57.509146 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:57.535131 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606b921-5911-45d8-a5d3-a100521ba042 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:57.570839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9871def-0770-4827-84fe-22feb5c1e5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:57.571752 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9871def-0770-4827-84fe-22feb5c1e5d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:57.572044 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9871def-0770-4827-84fe-22feb5c1e5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:57.572329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9871def-0770-4827-84fe-22feb5c1e5d1 None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5/users/9757b88abf7e4e979b2025f40c29fca2/roles/aa317d762bd64a9d864e54d074507f94` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:57.578510 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9871def-0770-4827-84fe-22feb5c1e5d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=48537ad736fa4427a5c6de586bc429e5, user_id=9757b88abf7e4e979b2025f40c29fca2, role_id=aa317d762bd64a9d864e54d074507f94)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:57.580058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9871def-0770-4827-84fe-22feb5c1e5d1 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:57.665389 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 70/137] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:15:57 2022] PUT /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5/users/9757b88abf7e4e979b2025f40c29fca2/roles/aa317d762bd64a9d864e54d074507f94 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:15:58.285501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09942c4e-bbbe-42bb-b0c3-20d8c2d762ed None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:58.286088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09942c4e-bbbe-42bb-b0c3-20d8c2d762ed None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:58.286088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09942c4e-bbbe-42bb-b0c3-20d8c2d762ed None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:58.287626 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 68/138] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:58.292834 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd807a1-5b84-455f-aa61-8c8bca770ee8 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:58.293252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd807a1-5b84-455f-aa61-8c8bca770ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:58.293426 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd807a1-5b84-455f-aa61-8c8bca770ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:58.315500 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9cd807a1-5b84-455f-aa61-8c8bca770ee8 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:58.316717 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9cd807a1-5b84-455f-aa61-8c8bca770ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:58.404527 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 71/139] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:58.407523 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de31309-59a1-4dbd-b9f2-8efafd3fcc4e None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:58.408040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de31309-59a1-4dbd-b9f2-8efafd3fcc4e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:58.408543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de31309-59a1-4dbd-b9f2-8efafd3fcc4e None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:58.410152 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 69/140] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:58.415600 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a17217-d4a9-4be3-8230-2dba3da68d59 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:58.416227 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a17217-d4a9-4be3-8230-2dba3da68d59 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:58.416714 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a17217-d4a9-4be3-8230-2dba3da68d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:58.434488 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b2a17217-d4a9-4be3-8230-2dba3da68d59 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:58.436009 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b2a17217-d4a9-4be3-8230-2dba3da68d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:58.441541 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de31309-59a1-4dbd-b9f2-8efafd3fcc4e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:58.539657 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:58.540770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 72/141] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:15:58.542110 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e8ed2-a267-4b69-a8e9-74a2cb129750 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:58.542405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e8ed2-a267-4b69-a8e9-74a2cb129750 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:58.542683 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e8ed2-a267-4b69-a8e9-74a2cb129750 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:58.550057 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 73/142] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:58.563300 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6781e-1145-43b8-bad2-fcc577e3c29d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:58.563642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6781e-1145-43b8-bad2-fcc577e3c29d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:58.563986 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6781e-1145-43b8-bad2-fcc577e3c29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:58.576680 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:58.596344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-36a6781e-1145-43b8-bad2-fcc577e3c29d None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:58.597553 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-36a6781e-1145-43b8-bad2-fcc577e3c29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:15:58.626766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de31309-59a1-4dbd-b9f2-8efafd3fcc4e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:58.691562 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e6fd1-3b34-4d4f-8235-86c35458801e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:58.692344 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e6fd1-3b34-4d4f-8235-86c35458801e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:58.692639 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e6fd1-3b34-4d4f-8235-86c35458801e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:58.692923 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e6fd1-3b34-4d4f-8235-86c35458801e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:58.714741 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e6fd1-3b34-4d4f-8235-86c35458801e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:15:58.721467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 74/143] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:15:58.722227 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6781e-1145-43b8-bad2-fcc577e3c29d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:58.735029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-354e6fd1-3b34-4d4f-8235-86c35458801e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:15:58.735029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:15:58.735029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:15:58.735029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:15:58.735029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:15:58.735029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:15:58.735029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:15:58.735029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:15:58.735029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:15:58.735029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:15:58.735029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:15:58.735029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:15:58.735029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:15:58.735029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:15:58.735029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:15:58.735029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:15:58.735928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:15:58.735928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:15:58.735928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:15:58.735928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:15:58.735928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:15:58.735928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:15:58.735928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:15:58.735928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:15:58.735928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:15:58.735928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:15:58.735928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:15:58.735928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:15:58.735928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:15:58.735928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:15:58.735928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:15:58.735928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:15:58.736687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:15:58.736687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:15:58.736687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:15:58.736687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:15:58.736687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:15:58.736687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:15:58.736687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:15:58.736687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:15:58.736687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:15:58.736687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:15:58.736687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:15:58.736687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:15:58.736687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 70/144] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:15:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:15:58.749428 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e6fd1-3b34-4d4f-8235-86c35458801e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:58.878120 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6781e-1145-43b8-bad2-fcc577e3c29d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:58.919545 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e6fd1-3b34-4d4f-8235-86c35458801e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:58.930070 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:58.952730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86352492-b75f-47eb-b086-8ed1cc782b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:58.952730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86352492-b75f-47eb-b086-8ed1cc782b09 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:58.952730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86352492-b75f-47eb-b086-8ed1cc782b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:58.952730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86352492-b75f-47eb-b086-8ed1cc782b09 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:58.961499 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f8146-d5eb-4bc2-ac8a-368fff6ec9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:58.962219 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f8146-d5eb-4bc2-ac8a-368fff6ec9ba None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:58.962509 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f8146-d5eb-4bc2-ac8a-368fff6ec9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:58.962796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f8146-d5eb-4bc2-ac8a-368fff6ec9ba None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:58.963555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f8146-d5eb-4bc2-ac8a-368fff6ec9ba None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:15:58.963868 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f8146-d5eb-4bc2-ac8a-368fff6ec9ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:58.965264 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f8146-d5eb-4bc2-ac8a-368fff6ec9ba None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:58.976172 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 71/145] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:15:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:58.977037 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86352492-b75f-47eb-b086-8ed1cc782b09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:15:58.977161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f8146-d5eb-4bc2-ac8a-368fff6ec9ba None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:58.978242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:58.988787 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-86352492-b75f-47eb-b086-8ed1cc782b09 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 02:15:58.988787 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:15:58.988787 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:15:58.988787 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:15:58.988787 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:15:58.988787 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:15:58.988787 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:15:58.988787 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:15:58.988787 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:15:58.988787 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:15:58.988787 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:15:58.988787 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:15:58.988787 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:15:58.988787 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:15:58.988787 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:15:58.988787 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:15:58.989624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:15:58.989624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:15:58.989624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:15:58.989624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:15:58.989624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:15:58.989624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:15:58.989624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:15:58.989624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:15:58.989624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:15:58.989624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:15:58.989624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:15:58.989624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:15:58.989624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:15:58.989624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:15:58.989624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:15:58.989624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:15:58.999177 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:15:58.999177 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:15:58.999177 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:15:58.999177 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:15:58.999177 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:15:58.999177 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:15:58.999177 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:15:58.999177 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:15:58.999177 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:15:58.999177 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:15:58.999177 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 02:15:58.999177 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:15:58.999177 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 75/146] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:15:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:15:58.999177 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86352492-b75f-47eb-b086-8ed1cc782b09 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:59.146402 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f8146-d5eb-4bc2-ac8a-368fff6ec9ba None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:59.179255 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86352492-b75f-47eb-b086-8ed1cc782b09 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:59.196863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fbcd1-81c4-4c26-b9b2-57545b79cd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:59.197750 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fbcd1-81c4-4c26-b9b2-57545b79cd22 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:59.198046 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fbcd1-81c4-4c26-b9b2-57545b79cd22 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:59.198329 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317fbcd1-81c4-4c26-b9b2-57545b79cd22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:59.200138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317fbcd1-81c4-4c26-b9b2-57545b79cd22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:59.201619 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317fbcd1-81c4-4c26-b9b2-57545b79cd22 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:59.203484 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 72/147] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:15:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:59.204029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fbcd1-81c4-4c26-b9b2-57545b79cd22 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:59.288011 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:59.290394 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea52fc4-4662-4396-a5a2-b9397c0123c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:59.291303 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea52fc4-4662-4396-a5a2-b9397c0123c9 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:59.291594 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea52fc4-4662-4396-a5a2-b9397c0123c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:59.291873 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea52fc4-4662-4396-a5a2-b9397c0123c9 None admin] PATH_INFO: `/v3/users/9757b88abf7e4e979b2025f40c29fca2` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:59.298951 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea52fc4-4662-4396-a5a2-b9397c0123c9 None admin] RBAC: Authorizing `identity:get_user(user_id=9757b88abf7e4e979b2025f40c29fca2)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:59.300436 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea52fc4-4662-4396-a5a2-b9397c0123c9 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:59.302756 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 76/148] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:15:58 2022] GET /identity/v3/users/9757b88abf7e4e979b2025f40c29fca2 => generated 275 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:15:59.303583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea52fc4-4662-4396-a5a2-b9397c0123c9 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:59.312111 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317fbcd1-81c4-4c26-b9b2-57545b79cd22 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:59.360989 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3b880-c72a-4e31-8747-ab2d3ed5916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:59.361966 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3b880-c72a-4e31-8747-ab2d3ed5916e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:59.362408 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3b880-c72a-4e31-8747-ab2d3ed5916e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:59.362835 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3b880-c72a-4e31-8747-ab2d3ed5916e None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:59.363735 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3b880-c72a-4e31-8747-ab2d3ed5916e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:15:59.364189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3b880-c72a-4e31-8747-ab2d3ed5916e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:59.365915 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f3b880-c72a-4e31-8747-ab2d3ed5916e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:59.378216 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 73/149] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:15:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:59.381980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3b880-c72a-4e31-8747-ab2d3ed5916e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:59.419379 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:59.500040 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea52fc4-4662-4396-a5a2-b9397c0123c9 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:59.569100 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3b880-c72a-4e31-8747-ab2d3ed5916e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:59.572712 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edd6e2-655e-468b-9f89-0ea2b44c7a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:59.573403 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edd6e2-655e-468b-9f89-0ea2b44c7a4c None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:59.573688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edd6e2-655e-468b-9f89-0ea2b44c7a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:59.573995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edd6e2-655e-468b-9f89-0ea2b44c7a4c None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:59.574717 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7edd6e2-655e-468b-9f89-0ea2b44c7a4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:59.576187 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7edd6e2-655e-468b-9f89-0ea2b44c7a4c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:59.607204 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:59.613725 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccc669-035e-49df-a1cf-080dd8557638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:59.614453 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccc669-035e-49df-a1cf-080dd8557638 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:59.614744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccc669-035e-49df-a1cf-080dd8557638 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:59.615034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccc669-035e-49df-a1cf-080dd8557638 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:59.686675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 77/150] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jul 18 02:15:59 2022] POST /identity/v3/users => generated 283 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:15:59.687323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ccc669-035e-49df-a1cf-080dd8557638 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:59.688370 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edd6e2-655e-468b-9f89-0ea2b44c7a4c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:59.689543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ccc669-035e-49df-a1cf-080dd8557638 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:59.886645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 74/151] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:15:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:15:59.887989 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cb949-6d0a-4799-abef-78bec69a7de1 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:59.888286 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cb949-6d0a-4799-abef-78bec69a7de1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:59.888570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71cb949-6d0a-4799-abef-78bec69a7de1 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:59.890591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edd6e2-655e-468b-9f89-0ea2b44c7a4c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:15:59.896696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 75/152] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:15:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:15:59.898042 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cb949-6d0a-4799-abef-78bec69a7de1 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:15:59.906890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:59.934417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:15:59.937166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1b9115-0634-47c1-b9b2-5dc97c953696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:15:59.938345 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b9115-0634-47c1-b9b2-5dc97c953696 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:59.938956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b9115-0634-47c1-b9b2-5dc97c953696 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:59.939450 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1b9115-0634-47c1-b9b2-5dc97c953696 None admin] PATH_INFO: `/v3/users/99e2f2e318f94903bb19738696e1da20` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:59.941534 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b9115-0634-47c1-b9b2-5dc97c953696 None admin] RBAC: Authorizing `identity:get_user(user_id=99e2f2e318f94903bb19738696e1da20)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:15:59.943320 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1b9115-0634-47c1-b9b2-5dc97c953696 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:15:59.945368 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 78/153] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:15:59 2022] GET /identity/v3/users/99e2f2e318f94903bb19738696e1da20 => generated 289 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:15:59.948506 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a2225-f7e3-41e6-aa33-a0e732b94912 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:15:59.949302 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a2225-f7e3-41e6-aa33-a0e732b94912 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:15:59.950005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a2225-f7e3-41e6-aa33-a0e732b94912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:15:59.972301 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-674a2225-f7e3-41e6-aa33-a0e732b94912 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:15:59.973898 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-674a2225-f7e3-41e6-aa33-a0e732b94912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:00.017571 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71cb949-6d0a-4799-abef-78bec69a7de1 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:00.065281 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b726b5-994c-474f-86f6-93ce357ffea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:00.065281 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b726b5-994c-474f-86f6-93ce357ffea1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:00.065281 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b726b5-994c-474f-86f6-93ce357ffea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:00.065281 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b726b5-994c-474f-86f6-93ce357ffea1 None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:00.066062 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 79/154] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:00.067082 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b726b5-994c-474f-86f6-93ce357ffea1 None admin] RBAC: Authorizing `identity:get_project(project_id=48537ad736fa4427a5c6de586bc429e5)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:00.067342 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a2225-f7e3-41e6-aa33-a0e732b94912 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:00.068551 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b726b5-994c-474f-86f6-93ce357ffea1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:00.071379 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 76/155] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:15:59 2022] GET /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:00.077072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b726b5-994c-474f-86f6-93ce357ffea1 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:00.202575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a2225-f7e3-41e6-aa33-a0e732b94912 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:00.214532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:00.215996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:00.223378 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b726b5-994c-474f-86f6-93ce357ffea1 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:00.254815 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b241e-21ef-4c6b-a0b0-53aebc06bc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:00.255692 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b241e-21ef-4c6b-a0b0-53aebc06bc5e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:00.255975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b241e-21ef-4c6b-a0b0-53aebc06bc5e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:00.256285 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b241e-21ef-4c6b-a0b0-53aebc06bc5e None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:00.258734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b241e-21ef-4c6b-a0b0-53aebc06bc5e None admin] RBAC: Authorizing `identity:get_project(project_id=48537ad736fa4427a5c6de586bc429e5)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:00.260212 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b241e-21ef-4c6b-a0b0-53aebc06bc5e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:00.264001 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 80/156] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:00 2022] GET /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:00.264001 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79275090-acaa-48d1-b141-3ae65af42e0e None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:00.264001 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79275090-acaa-48d1-b141-3ae65af42e0e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:00.264242 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79275090-acaa-48d1-b141-3ae65af42e0e None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:00.265415 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 81/157] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:00.270490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79275090-acaa-48d1-b141-3ae65af42e0e None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:00.276255 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67556a-b5f3-4df6-bf83-989d5e1a1b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:00.276927 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67556a-b5f3-4df6-bf83-989d5e1a1b7d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:00.277217 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67556a-b5f3-4df6-bf83-989d5e1a1b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:00.277495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f67556a-b5f3-4df6-bf83-989d5e1a1b7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:00.279305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67556a-b5f3-4df6-bf83-989d5e1a1b7d None admin] RBAC: Adding query filter params (role.id=7db255e54afa4cecac2d6c93da70795e, scope.project.id=48537ad736fa4427a5c6de586bc429e5, user.id=9757b88abf7e4e979b2025f40c29fca2) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:00.282019 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67556a-b5f3-4df6-bf83-989d5e1a1b7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:00.284412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f67556a-b5f3-4df6-bf83-989d5e1a1b7d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:00.299279 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 77/158] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:16:00 2022] GET /identity/v3/role_assignments?user.id=9757b88abf7e4e979b2025f40c29fca2&scope.project.id=48537ad736fa4427a5c6de586bc429e5&role.id=7db255e54afa4cecac2d6c93da70795e => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:00.300323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67556a-b5f3-4df6-bf83-989d5e1a1b7d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:00.397435 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79275090-acaa-48d1-b141-3ae65af42e0e None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:00.445095 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8286dd-7b15-4125-ac12-110420a52584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:00.445975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8286dd-7b15-4125-ac12-110420a52584 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:00.446260 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8286dd-7b15-4125-ac12-110420a52584 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:00.446537 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8286dd-7b15-4125-ac12-110420a52584 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:00.451298 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f67556a-b5f3-4df6-bf83-989d5e1a1b7d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:00.461387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8286dd-7b15-4125-ac12-110420a52584 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:00.471957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-ec8286dd-7b15-4125-ac12-110420a52584 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:16:00.471957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:00.471957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:00.471957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:00.471957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:00.471957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:00.471957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:00.471957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:00.471957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:00.471957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:00.471957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:00.471957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:00.471957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:00.471957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:00.471957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:00.471957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:00.472885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:00.472885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:00.472885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:00.472885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:00.472885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:00.472885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:00.472885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:00.472885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:00.472885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:00.472885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:00.472885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:00.472885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:00.472885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:00.472885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:00.472885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:00.472885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:00.473642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:00.473642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:00.473642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:00.473642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:00.473642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:00.473642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:00.473642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:00.473642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:00.473642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:00.473642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:00.473642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:16:00.473642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:00.473642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 82/159] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:16:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:00.474384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed37440-c2e6-420f-881a-fd31ec70bf38 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:00.474971 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed37440-c2e6-420f-881a-fd31ec70bf38 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:00.474971 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed37440-c2e6-420f-881a-fd31ec70bf38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:00.497393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-5ed37440-c2e6-420f-881a-fd31ec70bf38 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:00.498353 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5ed37440-c2e6-420f-881a-fd31ec70bf38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:00.501661 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496b812-c61e-4db8-a0c1-59f42a7453b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:00.503025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496b812-c61e-4db8-a0c1-59f42a7453b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:00.503530 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496b812-c61e-4db8-a0c1-59f42a7453b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:00.504087 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496b812-c61e-4db8-a0c1-59f42a7453b1 None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5/users/99e2f2e318f94903bb19738696e1da20/roles/428c7cbed69f4893a907b0f69ab8eb98` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:00.507033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496b812-c61e-4db8-a0c1-59f42a7453b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=48537ad736fa4427a5c6de586bc429e5, user_id=99e2f2e318f94903bb19738696e1da20, role_id=428c7cbed69f4893a907b0f69ab8eb98)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:00.508998 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496b812-c61e-4db8-a0c1-59f42a7453b1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:00.535112 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:00.588072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 78/160] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:16:00 2022] PUT /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5/users/99e2f2e318f94903bb19738696e1da20/roles/428c7cbed69f4893a907b0f69ab8eb98 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:16:00.589266 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496b812-c61e-4db8-a0c1-59f42a7453b1 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:00.597726 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 83/161] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:00.597726 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f94a7-662c-4fd2-8585-98082422e7c8 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:00.597726 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f94a7-662c-4fd2-8585-98082422e7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:00.597726 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f94a7-662c-4fd2-8585-98082422e7c8 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:00.598796 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 84/162] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:00.605080 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b157391-f5f8-4d2a-b456-d7bce6f5d763 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:00.605477 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b157391-f5f8-4d2a-b456-d7bce6f5d763 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:00.605798 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b157391-f5f8-4d2a-b456-d7bce6f5d763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:00.631265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-5b157391-f5f8-4d2a-b456-d7bce6f5d763 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:00.632780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5b157391-f5f8-4d2a-b456-d7bce6f5d763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:00.644887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:00.732864 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 85/163] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:00.733668 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b157391-f5f8-4d2a-b456-d7bce6f5d763 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:00.748241 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496b812-c61e-4db8-a0c1-59f42a7453b1 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:00.789831 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff095512-340c-47e5-8503-e68a41a9f810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:00.790946 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff095512-340c-47e5-8503-e68a41a9f810 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:00.791445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff095512-340c-47e5-8503-e68a41a9f810 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:00.792229 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff095512-340c-47e5-8503-e68a41a9f810 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:00.793191 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff095512-340c-47e5-8503-e68a41a9f810 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:00.793725 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff095512-340c-47e5-8503-e68a41a9f810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:00.795354 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff095512-340c-47e5-8503-e68a41a9f810 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:00.806849 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 79/164] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:00.808078 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff095512-340c-47e5-8503-e68a41a9f810 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:00.864260 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b157391-f5f8-4d2a-b456-d7bce6f5d763 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:00.874110 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:00.914417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14630e8b-ccf9-491d-81aa-40196511981e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:00.915245 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14630e8b-ccf9-491d-81aa-40196511981e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:00.915524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14630e8b-ccf9-491d-81aa-40196511981e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:00.915797 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14630e8b-ccf9-491d-81aa-40196511981e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:00.940701 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14630e8b-ccf9-491d-81aa-40196511981e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:00.948851 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:00.955516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-14630e8b-ccf9-491d-81aa-40196511981e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:00.955516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:00.955516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:00.955516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:00.955516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:00.955516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:00.955516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:00.955516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:00.955516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:00.955516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:00.955516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:00.955516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:00.955516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:00.955516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:00.955516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:00.955516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:00.959084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:00.959084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:00.959084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:00.959084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:00.959084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:00.959084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:00.959084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:00.959084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:00.959084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:00.959084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:00.959084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:00.959084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:00.959084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:00.959084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:00.959084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:00.959084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:00.959850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:00.959850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:00.959850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:00.959850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:00.959850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:00.959850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:00.959850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:00.959850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:00.959850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:00.959850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:00.959850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:00.959850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:00.964303 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 86/165] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:00.966364 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14630e8b-ccf9-491d-81aa-40196511981e None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:00.986806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff095512-340c-47e5-8503-e68a41a9f810 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:01.031740 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d531ecd-4536-4ca7-8df6-aafe989dc197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:01.033101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d531ecd-4536-4ca7-8df6-aafe989dc197 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:01.033424 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d531ecd-4536-4ca7-8df6-aafe989dc197 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:01.033718 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d531ecd-4536-4ca7-8df6-aafe989dc197 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:01.059314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d531ecd-4536-4ca7-8df6-aafe989dc197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:01.070739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-8d531ecd-4536-4ca7-8df6-aafe989dc197 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:16:01.070739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:01.070739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:01.070739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:01.070739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:01.070739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:01.070739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:01.070739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:01.070739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:01.070739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:01.070739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:01.070739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:01.070739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:01.070739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:01.070739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:01.070739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:01.072800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:01.072800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:01.072800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:01.072800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:01.072800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:01.072800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:01.072800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:01.072800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:01.072800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:01.072800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:01.072800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:01.072800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:01.072800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:01.072800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:01.072800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:01.072800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:01.074693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:01.074693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:01.074693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:01.074693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:01.074693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:01.074693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:01.074693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:01.074693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:01.074693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:01.074693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:01.074693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:16:01.074693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:01.078408 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 80/166] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jul 18 02:16:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:01.078408 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d531ecd-4536-4ca7-8df6-aafe989dc197 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:01.125623 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14630e8b-ccf9-491d-81aa-40196511981e None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:01.212145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea81711-e03e-4ce2-af43-6d755d5325a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:01.213284 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea81711-e03e-4ce2-af43-6d755d5325a7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:01.213776 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea81711-e03e-4ce2-af43-6d755d5325a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:01.214205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea81711-e03e-4ce2-af43-6d755d5325a7 None admin] PATH_INFO: `/v3/users/66adc49d0e444db3bd259768a9d10521` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:01.215564 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea81711-e03e-4ce2-af43-6d755d5325a7 None admin] RBAC: Authorizing `identity:get_user(user_id=66adc49d0e444db3bd259768a9d10521)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:01.217204 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea81711-e03e-4ce2-af43-6d755d5325a7 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:01.219351 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 87/167] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:16:00 2022] GET /identity/v3/users/66adc49d0e444db3bd259768a9d10521 => generated 247 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:01.220917 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea81711-e03e-4ce2-af43-6d755d5325a7 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:01.262839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:01.305577 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d531ecd-4536-4ca7-8df6-aafe989dc197 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:01.371343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32735cd1-65e1-45bd-8ce2-175280095172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:01.372029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32735cd1-65e1-45bd-8ce2-175280095172 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:01.372313 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32735cd1-65e1-45bd-8ce2-175280095172 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:01.372591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32735cd1-65e1-45bd-8ce2-175280095172 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:01.373347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32735cd1-65e1-45bd-8ce2-175280095172 None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:01.373660 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32735cd1-65e1-45bd-8ce2-175280095172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:01.375072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32735cd1-65e1-45bd-8ce2-175280095172 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:01.378584 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea81711-e03e-4ce2-af43-6d755d5325a7 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:01.393824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 81/168] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:16:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:01.394732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32735cd1-65e1-45bd-8ce2-175280095172 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:01.418058 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:01.426414 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13497a99-6ff3-4ae5-a05d-9dfececaf23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:01.430246 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13497a99-6ff3-4ae5-a05d-9dfececaf23d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:01.430246 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13497a99-6ff3-4ae5-a05d-9dfececaf23d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:01.430246 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13497a99-6ff3-4ae5-a05d-9dfececaf23d None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:01.430246 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13497a99-6ff3-4ae5-a05d-9dfececaf23d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:01.430246 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13497a99-6ff3-4ae5-a05d-9dfececaf23d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:01.430580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13497a99-6ff3-4ae5-a05d-9dfececaf23d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:01.438887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 88/169] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:16:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:01.439712 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13497a99-6ff3-4ae5-a05d-9dfececaf23d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:01.580414 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:01.594192 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13497a99-6ff3-4ae5-a05d-9dfececaf23d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:01.634489 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c55669-5d14-4f2c-bf2d-35c0d079af82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:01.635479 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c55669-5d14-4f2c-bf2d-35c0d079af82 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:01.635767 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c55669-5d14-4f2c-bf2d-35c0d079af82 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:01.636044 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c55669-5d14-4f2c-bf2d-35c0d079af82 None admin] PATH_INFO: `/v3/users/9757b88abf7e4e979b2025f40c29fca2` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:01.637300 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c55669-5d14-4f2c-bf2d-35c0d079af82 None admin] RBAC: Authorizing `identity:get_user(user_id=9757b88abf7e4e979b2025f40c29fca2)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:01.638809 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c55669-5d14-4f2c-bf2d-35c0d079af82 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:01.640574 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 89/170] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:16:01 2022] GET /identity/v3/users/9757b88abf7e4e979b2025f40c29fca2 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:01.646492 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c55669-5d14-4f2c-bf2d-35c0d079af82 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:01.679657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32735cd1-65e1-45bd-8ce2-175280095172 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:01.754314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af72cb-8d49-404a-81e3-ddfb0e0d06cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:01.756414 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af72cb-8d49-404a-81e3-ddfb0e0d06cb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:01.757659 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af72cb-8d49-404a-81e3-ddfb0e0d06cb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:01.758693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af72cb-8d49-404a-81e3-ddfb0e0d06cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:01.831868 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c55669-5d14-4f2c-bf2d-35c0d079af82 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:01.882877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af72cb-8d49-404a-81e3-ddfb0e0d06cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:01.885871 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af72cb-8d49-404a-81e3-ddfb0e0d06cb None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:01.896494 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:01.899172 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789aac8-156a-40e6-a7e1-c97ac752232e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:01.900307 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789aac8-156a-40e6-a7e1-c97ac752232e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:01.900876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789aac8-156a-40e6-a7e1-c97ac752232e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:01.901358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789aac8-156a-40e6-a7e1-c97ac752232e None admin] PATH_INFO: `/v3/users/9757b88abf7e4e979b2025f40c29fca2` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:01.903000 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789aac8-156a-40e6-a7e1-c97ac752232e None admin] RBAC: Authorizing `identity:get_user(user_id=9757b88abf7e4e979b2025f40c29fca2)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:01.904811 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789aac8-156a-40e6-a7e1-c97ac752232e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:01.906702 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 90/171] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:16:01 2022] GET /identity/v3/users/9757b88abf7e4e979b2025f40c29fca2 => generated 275 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:01.908168 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789aac8-156a-40e6-a7e1-c97ac752232e None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:01.977457 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:02.119262 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 82/172] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:02.120549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af72cb-8d49-404a-81e3-ddfb0e0d06cb None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:02.140480 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789aac8-156a-40e6-a7e1-c97ac752232e None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:02.220262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8ff26-28b2-4d21-ba8c-f85b1a6e7205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:02.220930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8ff26-28b2-4d21-ba8c-f85b1a6e7205 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:02.221217 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8ff26-28b2-4d21-ba8c-f85b1a6e7205 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:02.221497 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d8ff26-28b2-4d21-ba8c-f85b1a6e7205 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:02.355166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8ff26-28b2-4d21-ba8c-f85b1a6e7205 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:02.356813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d8ff26-28b2-4d21-ba8c-f85b1a6e7205 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:02.401802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:02.411722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af72cb-8d49-404a-81e3-ddfb0e0d06cb None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:02.428305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:02.491575 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ded0fe-539b-4a36-9f8e-87dd2c06842a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:02.492262 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ded0fe-539b-4a36-9f8e-87dd2c06842a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:02.492551 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ded0fe-539b-4a36-9f8e-87dd2c06842a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:02.492831 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ded0fe-539b-4a36-9f8e-87dd2c06842a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:02.614405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 91/173] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:02.615507 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8ff26-28b2-4d21-ba8c-f85b1a6e7205 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:02.646791 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ded0fe-539b-4a36-9f8e-87dd2c06842a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:02.648272 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ded0fe-539b-4a36-9f8e-87dd2c06842a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:02.810657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 83/174] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:02.816551 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ded0fe-539b-4a36-9f8e-87dd2c06842a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:02.826203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:02.884537 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d8ff26-28b2-4d21-ba8c-f85b1a6e7205 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:02.932666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ded0fe-539b-4a36-9f8e-87dd2c06842a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:02.954629 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:02.972146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0832efc-5487-4f2a-a16b-fb69cf3be511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:02.973349 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0832efc-5487-4f2a-a16b-fb69cf3be511 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:02.973638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0832efc-5487-4f2a-a16b-fb69cf3be511 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:02.973948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0832efc-5487-4f2a-a16b-fb69cf3be511 None admin] PATH_INFO: `/v3/projects/e48a95df903142ff822f7db19eabf2cb` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:02.975295 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0832efc-5487-4f2a-a16b-fb69cf3be511 None admin] RBAC: Authorizing `identity:get_project(project_id=e48a95df903142ff822f7db19eabf2cb)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:02.976905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0832efc-5487-4f2a-a16b-fb69cf3be511 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:02.978812 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 84/175] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:02 2022] GET /identity/v3/projects/e48a95df903142ff822f7db19eabf2cb => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:02.979666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0832efc-5487-4f2a-a16b-fb69cf3be511 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:02.986554 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406a489-5d1f-4ef3-bc43-b4b2a322b96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:02.987725 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406a489-5d1f-4ef3-bc43-b4b2a322b96f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:02.988201 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406a489-5d1f-4ef3-bc43-b4b2a322b96f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:02.988707 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f406a489-5d1f-4ef3-bc43-b4b2a322b96f None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:02.990180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406a489-5d1f-4ef3-bc43-b4b2a322b96f None admin] RBAC: Authorizing `identity:get_project(project_id=48537ad736fa4427a5c6de586bc429e5)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:02.991817 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f406a489-5d1f-4ef3-bc43-b4b2a322b96f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:02.993753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 92/176] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:02 2022] GET /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5 => generated 298 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:02.994697 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406a489-5d1f-4ef3-bc43-b4b2a322b96f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:03.074437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:03.103765 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0832efc-5487-4f2a-a16b-fb69cf3be511 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:03.158490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f6baf-309e-4e5c-960c-38e34cfb1fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:03.159387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f6baf-309e-4e5c-960c-38e34cfb1fea None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:03.159671 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f6baf-309e-4e5c-960c-38e34cfb1fea None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:03.159947 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f6baf-309e-4e5c-960c-38e34cfb1fea None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:03.161182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f6baf-309e-4e5c-960c-38e34cfb1fea None admin] RBAC: Authorizing `identity:get_project(project_id=48537ad736fa4427a5c6de586bc429e5)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:03.162704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f6baf-309e-4e5c-960c-38e34cfb1fea None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:03.169394 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 85/177] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:02 2022] GET /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:03.170134 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f6baf-309e-4e5c-960c-38e34cfb1fea None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:03.227540 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f406a489-5d1f-4ef3-bc43-b4b2a322b96f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:03.276534 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f6baf-309e-4e5c-960c-38e34cfb1fea None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:03.293115 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452351a-bd21-45b1-9f2c-811d46549115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:03.294258 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452351a-bd21-45b1-9f2c-811d46549115 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:03.294796 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452351a-bd21-45b1-9f2c-811d46549115 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:03.295287 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452351a-bd21-45b1-9f2c-811d46549115 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:03.296385 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452351a-bd21-45b1-9f2c-811d46549115 None admin] RBAC: Adding query filter params (role.id=7db255e54afa4cecac2d6c93da70795e, scope.project.id=e48a95df903142ff822f7db19eabf2cb, user.id=9757b88abf7e4e979b2025f40c29fca2) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:03.296899 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452351a-bd21-45b1-9f2c-811d46549115 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:03.298716 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452351a-bd21-45b1-9f2c-811d46549115 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:03.305957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 93/178] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:16:02 2022] GET /identity/v3/role_assignments?user.id=9757b88abf7e4e979b2025f40c29fca2&scope.project.id=e48a95df903142ff822f7db19eabf2cb&role.id=7db255e54afa4cecac2d6c93da70795e => generated 608 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:03.307175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452351a-bd21-45b1-9f2c-811d46549115 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:03.325664 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d3db9-e394-4088-8836-dbeeee3955f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:03.326728 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d3db9-e394-4088-8836-dbeeee3955f6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:03.327498 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d3db9-e394-4088-8836-dbeeee3955f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:03.328890 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d3db9-e394-4088-8836-dbeeee3955f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:03.330263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d3db9-e394-4088-8836-dbeeee3955f6 None admin] RBAC: Adding query filter params (role.id=5dfa34e7a4594751aed7c0495c9a2383, scope.project.id=48537ad736fa4427a5c6de586bc429e5, user.id=66adc49d0e444db3bd259768a9d10521) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:03.331711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d3db9-e394-4088-8836-dbeeee3955f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:03.333675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d3db9-e394-4088-8836-dbeeee3955f6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:03.350782 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 86/179] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:16:03 2022] GET /identity/v3/role_assignments?user.id=66adc49d0e444db3bd259768a9d10521&scope.project.id=48537ad736fa4427a5c6de586bc429e5&role.id=5dfa34e7a4594751aed7c0495c9a2383 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:03.352572 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c696fce-5b4b-46a8-aa81-86faafa38f1b None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:03.353404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c696fce-5b4b-46a8-aa81-86faafa38f1b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:03.354826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c696fce-5b4b-46a8-aa81-86faafa38f1b None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:03.356816 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 87/180] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:03.360132 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c480cbc-bc0f-405b-9296-18a55c3e9851 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:03.361688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c480cbc-bc0f-405b-9296-18a55c3e9851 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:03.362947 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c480cbc-bc0f-405b-9296-18a55c3e9851 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:03.364866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 88/181] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:03.368133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232440a-3d4d-4751-bd39-44c6f359a0f9 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:03.370053 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232440a-3d4d-4751-bd39-44c6f359a0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:03.371448 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9232440a-3d4d-4751-bd39-44c6f359a0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:03.394775 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:03.407406 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-9232440a-3d4d-4751-bd39-44c6f359a0f9 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:03.409937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9232440a-3d4d-4751-bd39-44c6f359a0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:03.427173 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:03.486987 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452351a-bd21-45b1-9f2c-811d46549115 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:03.537270 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3444fb-f0ec-4f38-822b-ee003d9c16bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:03.538629 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3444fb-f0ec-4f38-822b-ee003d9c16bf None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:03.539400 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3444fb-f0ec-4f38-822b-ee003d9c16bf None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:03.540362 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3444fb-f0ec-4f38-822b-ee003d9c16bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:03.541829 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3444fb-f0ec-4f38-822b-ee003d9c16bf None admin] RBAC: Adding query filter params (role.id=aa317d762bd64a9d864e54d074507f94, scope.project.id=48537ad736fa4427a5c6de586bc429e5, user.id=9757b88abf7e4e979b2025f40c29fca2) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:03.542642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3444fb-f0ec-4f38-822b-ee003d9c16bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:03.545125 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3444fb-f0ec-4f38-822b-ee003d9c16bf None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:03.549255 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 89/182] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:03.553389 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 94/183] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:16:03 2022] GET /identity/v3/role_assignments?user.id=9757b88abf7e4e979b2025f40c29fca2&scope.project.id=48537ad736fa4427a5c6de586bc429e5&role.id=aa317d762bd64a9d864e54d074507f94 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:03.554647 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cbe90-aee7-4332-91b5-059063b1f925 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:03.554994 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cbe90-aee7-4332-91b5-059063b1f925 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:03.555284 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cbe90-aee7-4332-91b5-059063b1f925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:03.555620 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeba679-0a36-414d-86c7-0ece0636d5c0 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:03.556119 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeba679-0a36-414d-86c7-0ece0636d5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:03.556713 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeba679-0a36-414d-86c7-0ece0636d5c0 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:03.558604 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 95/184] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:03.567338 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa21e3-9082-4bb1-b777-0240dac23193 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:03.567941 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa21e3-9082-4bb1-b777-0240dac23193 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:03.568418 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa21e3-9082-4bb1-b777-0240dac23193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:03.583775 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-4a0cbe90-aee7-4332-91b5-059063b1f925 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:03.584963 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4a0cbe90-aee7-4332-91b5-059063b1f925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:03.589327 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-7caa21e3-9082-4bb1-b777-0240dac23193 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:03.592184 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7caa21e3-9082-4bb1-b777-0240dac23193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:03.685956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 90/185] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:03.686972 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cbe90-aee7-4332-91b5-059063b1f925 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:03.700671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 96/186] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:03.736186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa21e3-9082-4bb1-b777-0240dac23193 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:03.768918 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:03.803536 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:03.816451 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cbe90-aee7-4332-91b5-059063b1f925 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:03.861810 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691059ca-902f-4389-a8c4-2b1976b0bcd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:03.862588 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691059ca-902f-4389-a8c4-2b1976b0bcd2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:03.862852 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691059ca-902f-4389-a8c4-2b1976b0bcd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:03.863131 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691059ca-902f-4389-a8c4-2b1976b0bcd2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:03.864457 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691059ca-902f-4389-a8c4-2b1976b0bcd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:03.865949 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691059ca-902f-4389-a8c4-2b1976b0bcd2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:03.867597 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 91/187] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:03.868366 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691059ca-902f-4389-a8c4-2b1976b0bcd2 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:03.870356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa21e3-9082-4bb1-b777-0240dac23193 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:03.915398 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2801d0-44b1-4795-b40d-840ed487069d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:03.916574 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2801d0-44b1-4795-b40d-840ed487069d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:03.916866 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2801d0-44b1-4795-b40d-840ed487069d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:03.917148 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2801d0-44b1-4795-b40d-840ed487069d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:03.928490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2801d0-44b1-4795-b40d-840ed487069d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:03.936490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-9c2801d0-44b1-4795-b40d-840ed487069d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:16:03.936490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:03.936490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:03.936490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:03.936490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:03.936490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:03.936490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:03.936490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:03.936490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:03.936490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:03.936490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:03.936490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:03.936490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:03.936490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:03.936490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:03.936490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:03.937326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:03.937326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:03.937326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:03.937326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:03.937326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:03.937326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:03.937326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:03.937326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:03.937326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:03.937326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:03.937326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:03.937326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:03.937326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:03.937326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:03.937326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:03.937326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:03.938312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:03.938312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:03.938312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:03.938312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:03.938312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:03.938312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:03.938312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:03.938312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:03.938312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:03.938312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:03.938312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:16:03.938312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:03.938312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 97/188] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:16:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:16:03.939101 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2a86e-7872-41f3-8476-532d6b9f17f1 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:03.939341 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2a86e-7872-41f3-8476-532d6b9f17f1 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:03.939625 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c2a86e-7872-41f3-8476-532d6b9f17f1 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:03.940902 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 98/189] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:03.941582 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2a86e-7872-41f3-8476-532d6b9f17f1 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:03.985606 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691059ca-902f-4389-a8c4-2b1976b0bcd2 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:04.027367 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2ba99-e495-4c77-beb4-c9488d40fa61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:04.028191 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2ba99-e495-4c77-beb4-c9488d40fa61 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:04.028476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2ba99-e495-4c77-beb4-c9488d40fa61 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:04.028759 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc2ba99-e495-4c77-beb4-c9488d40fa61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:04.030698 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:04.039942 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc2ba99-e495-4c77-beb4-c9488d40fa61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:04.048030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-0dc2ba99-e495-4c77-beb4-c9488d40fa61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:16:04.048030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:04.048030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:04.048030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:04.048030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:04.048030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:04.048030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:04.048030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:04.048030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:04.048030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:04.048030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:04.048030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:04.048030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:04.048030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:04.048030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:04.048030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:04.048980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:04.048980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:04.048980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:04.048980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:04.048980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:04.048980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:04.048980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:04.048980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:04.048980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:04.048980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:04.048980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:04.048980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:04.048980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:04.048980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:04.048980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:04.048980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:04.049846 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:04.049846 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:04.049846 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:04.049846 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:04.049846 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:04.049846 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:04.049846 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:04.049846 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:04.049846 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:04.049846 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:04.049846 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:16:04.049846 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:04.049846 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 92/190] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jul 18 02:16:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:04.050906 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c2a86e-7872-41f3-8476-532d6b9f17f1 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:04.054758 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2ba99-e495-4c77-beb4-c9488d40fa61 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:04.060547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:04.086520 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4c9b7-c30a-408f-9d43-53280eac9d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:04.087194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4c9b7-c30a-408f-9d43-53280eac9d79 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:04.087476 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4c9b7-c30a-408f-9d43-53280eac9d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:04.087760 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4c9b7-c30a-408f-9d43-53280eac9d79 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:04.088469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4c9b7-c30a-408f-9d43-53280eac9d79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:04.089956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4c9b7-c30a-408f-9d43-53280eac9d79 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:04.154546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc2ba99-e495-4c77-beb4-c9488d40fa61 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:04.173095 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 99/191] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jul 18 02:16:03 2022] POST /identity/v3/users => generated 297 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:16:04.174669 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abd37d-9847-4bcd-85a4-df1bd3f60e13 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:04.174966 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abd37d-9847-4bcd-85a4-df1bd3f60e13 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:04.175250 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abd37d-9847-4bcd-85a4-df1bd3f60e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:04.193528 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-05abd37d-9847-4bcd-85a4-df1bd3f60e13 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:04.194836 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-05abd37d-9847-4bcd-85a4-df1bd3f60e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:04.198169 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90c58e-c36e-4d0b-98b7-467b1da27212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:04.198872 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90c58e-c36e-4d0b-98b7-467b1da27212 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:04.199186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90c58e-c36e-4d0b-98b7-467b1da27212 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:04.199463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90c58e-c36e-4d0b-98b7-467b1da27212 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:04.200249 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90c58e-c36e-4d0b-98b7-467b1da27212 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:04.200556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90c58e-c36e-4d0b-98b7-467b1da27212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:04.202030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90c58e-c36e-4d0b-98b7-467b1da27212 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:04.217642 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 93/192] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:04.217642 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90c58e-c36e-4d0b-98b7-467b1da27212 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:04.277864 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 100/193] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:04.278731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abd37d-9847-4bcd-85a4-df1bd3f60e13 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:04.279268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:04.341632 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90c58e-c36e-4d0b-98b7-467b1da27212 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:04.383635 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d559d-fd62-4975-94fc-b266a47838b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:04.384318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d559d-fd62-4975-94fc-b266a47838b4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:04.384607 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d559d-fd62-4975-94fc-b266a47838b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:04.385261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d559d-fd62-4975-94fc-b266a47838b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:04.386058 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d559d-fd62-4975-94fc-b266a47838b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:04.386690 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d559d-fd62-4975-94fc-b266a47838b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:04.388094 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d559d-fd62-4975-94fc-b266a47838b4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:04.401794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 94/194] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:16:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:04.401794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d559d-fd62-4975-94fc-b266a47838b4 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:04.408300 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:04.415066 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abd37d-9847-4bcd-85a4-df1bd3f60e13 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:04.457974 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8aa4e-65db-40e8-aa7f-69cced03c65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:04.459174 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8aa4e-65db-40e8-aa7f-69cced03c65e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:04.459435 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8aa4e-65db-40e8-aa7f-69cced03c65e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:04.459811 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa8aa4e-65db-40e8-aa7f-69cced03c65e None admin] PATH_INFO: `/v3/users/87ea694c5ee54adaa05fa5a5eb43ea4b` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:04.479829 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8aa4e-65db-40e8-aa7f-69cced03c65e None admin] RBAC: Authorizing `identity:get_user(user_id=87ea694c5ee54adaa05fa5a5eb43ea4b)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:04.481602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa8aa4e-65db-40e8-aa7f-69cced03c65e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:04.483628 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 101/195] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:16:04 2022] GET /identity/v3/users/87ea694c5ee54adaa05fa5a5eb43ea4b => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:04.484213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8aa4e-65db-40e8-aa7f-69cced03c65e None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:04.519007 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d559d-fd62-4975-94fc-b266a47838b4 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:04.538261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:04.559285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0e605-50ab-451f-b4fc-b609abdf0b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:04.560404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0e605-50ab-451f-b4fc-b609abdf0b52 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:04.560789 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0e605-50ab-451f-b4fc-b609abdf0b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:04.561575 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b0e605-50ab-451f-b4fc-b609abdf0b52 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:04.574264 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b0e605-50ab-451f-b4fc-b609abdf0b52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:04.583314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-25b0e605-50ab-451f-b4fc-b609abdf0b52 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 02:16:04.583314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:04.583314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:04.583314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:04.583314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:04.583314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:04.583314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:04.583314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:04.583314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:04.583314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:04.583314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:04.583314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:04.583314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:04.583314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:04.583314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:04.583314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:04.584374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:04.584374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:04.584374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:04.584374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:04.584374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:04.584374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:04.584374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:04.584374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:04.584374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:04.584374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:04.584374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:04.584374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:04.584374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:04.584374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:04.584374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:04.584374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:04.585332 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:04.585332 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:04.585332 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:04.585332 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:04.585332 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:04.585332 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:04.585332 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:04.585332 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:04.585332 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:04.585332 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:04.585332 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 02:16:04.585332 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:04.587205 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 95/196] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:04.587853 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0e605-50ab-451f-b4fc-b609abdf0b52 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:04.622512 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa8aa4e-65db-40e8-aa7f-69cced03c65e None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:04.671227 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7de59-6594-4658-b85a-c65ffe5ab6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:04.672352 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7de59-6594-4658-b85a-c65ffe5ab6af None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:04.672814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7de59-6594-4658-b85a-c65ffe5ab6af None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:04.673233 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7de59-6594-4658-b85a-c65ffe5ab6af None admin] PATH_INFO: `/v3/users/87ea694c5ee54adaa05fa5a5eb43ea4b` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:04.675149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7de59-6594-4658-b85a-c65ffe5ab6af None admin] RBAC: Authorizing `identity:get_user(user_id=87ea694c5ee54adaa05fa5a5eb43ea4b)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:04.677128 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7de59-6594-4658-b85a-c65ffe5ab6af None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:04.679873 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 102/197] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:16:04 2022] GET /identity/v3/users/87ea694c5ee54adaa05fa5a5eb43ea4b => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:04.681134 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7de59-6594-4658-b85a-c65ffe5ab6af None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:04.701482 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b0e605-50ab-451f-b4fc-b609abdf0b52 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:04.709970 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:04.749222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abc3b9-4807-4484-9aad-5cf11d1a6c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:04.750072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abc3b9-4807-4484-9aad-5cf11d1a6c20 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:04.750362 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abc3b9-4807-4484-9aad-5cf11d1a6c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:04.751169 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abc3b9-4807-4484-9aad-5cf11d1a6c20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:04.799163 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7de59-6594-4658-b85a-c65ffe5ab6af None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:04.810443 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:04.836510 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525e86b-ce48-4dd0-a90d-c6e1c58f2c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:04.837447 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525e86b-ce48-4dd0-a90d-c6e1c58f2c0e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:04.837562 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96abc3b9-4807-4484-9aad-5cf11d1a6c20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:04.838025 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525e86b-ce48-4dd0-a90d-c6e1c58f2c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:04.838554 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c525e86b-ce48-4dd0-a90d-c6e1c58f2c0e None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:04.839081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96abc3b9-4807-4484-9aad-5cf11d1a6c20 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:04.839670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525e86b-ce48-4dd0-a90d-c6e1c58f2c0e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:04.840120 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525e86b-ce48-4dd0-a90d-c6e1c58f2c0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:04.841668 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c525e86b-ce48-4dd0-a90d-c6e1c58f2c0e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:04.852592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 103/198] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:16:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:04.853674 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525e86b-ce48-4dd0-a90d-c6e1c58f2c0e None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:04.951877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 96/199] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:04.952954 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abc3b9-4807-4484-9aad-5cf11d1a6c20 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:04.960111 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:04.986573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c525e86b-ce48-4dd0-a90d-c6e1c58f2c0e None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:05.024293 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d1ba4-b625-493c-988a-604e01720d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:05.025406 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d1ba4-b625-493c-988a-604e01720d0e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:05.025907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d1ba4-b625-493c-988a-604e01720d0e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:05.026392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d1ba4-b625-493c-988a-604e01720d0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:05.045010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:05.072666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abc3b9-4807-4484-9aad-5cf11d1a6c20 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:05.105445 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d1ba4-b625-493c-988a-604e01720d0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:05.108186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d1ba4-b625-493c-988a-604e01720d0e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:05.123653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad03bb-e48a-4b56-9e05-603841c25a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:05.124947 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad03bb-e48a-4b56-9e05-603841c25a78 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:05.125353 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad03bb-e48a-4b56-9e05-603841c25a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:05.126321 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad03bb-e48a-4b56-9e05-603841c25a78 None admin] PATH_INFO: `/v3/users/99e2f2e318f94903bb19738696e1da20` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:05.127824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad03bb-e48a-4b56-9e05-603841c25a78 None admin] RBAC: Authorizing `identity:get_user(user_id=99e2f2e318f94903bb19738696e1da20)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:05.130211 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad03bb-e48a-4b56-9e05-603841c25a78 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:05.133060 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 97/200] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:16:04 2022] GET /identity/v3/users/99e2f2e318f94903bb19738696e1da20 => generated 289 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:05.133060 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad03bb-e48a-4b56-9e05-603841c25a78 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:05.214242 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:05.234694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 104/201] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:05.236290 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d1ba4-b625-493c-988a-604e01720d0e None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:05.268496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad03bb-e48a-4b56-9e05-603841c25a78 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:05.315569 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2fbb96-f15d-4e23-ae8b-6b689c4e8256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:05.316585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fbb96-f15d-4e23-ae8b-6b689c4e8256 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:05.316973 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fbb96-f15d-4e23-ae8b-6b689c4e8256 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:05.317354 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2fbb96-f15d-4e23-ae8b-6b689c4e8256 None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:05.318701 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2fbb96-f15d-4e23-ae8b-6b689c4e8256 None admin] RBAC: Authorizing `identity:get_project(project_id=1cca069e1cb44ca6baae94c18f1eb534)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:05.320769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2fbb96-f15d-4e23-ae8b-6b689c4e8256 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:05.323108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 98/202] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:05 2022] GET /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:05.324542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2fbb96-f15d-4e23-ae8b-6b689c4e8256 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:05.345146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:05.350387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d1ba4-b625-493c-988a-604e01720d0e None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:05.390907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f3f6b-0ac6-4b52-9f1d-a317702f774d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:05.392659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f3f6b-0ac6-4b52-9f1d-a317702f774d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:05.393083 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f3f6b-0ac6-4b52-9f1d-a317702f774d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:05.393496 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f3f6b-0ac6-4b52-9f1d-a317702f774d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:05.441931 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2fbb96-f15d-4e23-ae8b-6b689c4e8256 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:05.455829 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:05.470212 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f3f6b-0ac6-4b52-9f1d-a317702f774d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:05.470755 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f3f6b-0ac6-4b52-9f1d-a317702f774d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:05.491065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8792e88-0ded-456b-a0c5-5cd7f38324b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:05.492351 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8792e88-0ded-456b-a0c5-5cd7f38324b1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:05.492844 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8792e88-0ded-456b-a0c5-5cd7f38324b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:05.493965 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8792e88-0ded-456b-a0c5-5cd7f38324b1 None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:05.495894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8792e88-0ded-456b-a0c5-5cd7f38324b1 None admin] RBAC: Authorizing `identity:get_project(project_id=1cca069e1cb44ca6baae94c18f1eb534)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:05.498190 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8792e88-0ded-456b-a0c5-5cd7f38324b1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:05.505501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 99/203] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:05 2022] GET /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:05.505501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8792e88-0ded-456b-a0c5-5cd7f38324b1 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:05.588069 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 105/204] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:05.588889 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f3f6b-0ac6-4b52-9f1d-a317702f774d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:05.621670 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:05.649077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8792e88-0ded-456b-a0c5-5cd7f38324b1 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:05.676611 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:05.691097 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031fa67c-5f76-4453-9a22-3f4bd05bb882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:05.691760 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fa67c-5f76-4453-9a22-3f4bd05bb882 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:05.692049 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fa67c-5f76-4453-9a22-3f4bd05bb882 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:05.692328 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031fa67c-5f76-4453-9a22-3f4bd05bb882 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:05.694150 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031fa67c-5f76-4453-9a22-3f4bd05bb882 None admin] RBAC: Adding query filter params (role.id=5dfa34e7a4594751aed7c0495c9a2383, scope.project.id=1cca069e1cb44ca6baae94c18f1eb534, user.id=87ea694c5ee54adaa05fa5a5eb43ea4b) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:05.694150 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031fa67c-5f76-4453-9a22-3f4bd05bb882 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:05.695000 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031fa67c-5f76-4453-9a22-3f4bd05bb882 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:05.701228 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 100/205] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:16:05 2022] GET /identity/v3/role_assignments?user.id=87ea694c5ee54adaa05fa5a5eb43ea4b&scope.project.id=1cca069e1cb44ca6baae94c18f1eb534&role.id=5dfa34e7a4594751aed7c0495c9a2383 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:05.702221 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031fa67c-5f76-4453-9a22-3f4bd05bb882 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:05.706269 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f3f6b-0ac6-4b52-9f1d-a317702f774d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:05.749153 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d5ba6-29dc-4415-b882-8bb686931278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:05.751282 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d5ba6-29dc-4415-b882-8bb686931278 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:05.751878 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d5ba6-29dc-4415-b882-8bb686931278 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:05.752355 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d5ba6-29dc-4415-b882-8bb686931278 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:05.753431 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d5ba6-29dc-4415-b882-8bb686931278 None admin] RBAC: Adding query filter params (role.id=aa317d762bd64a9d864e54d074507f94, scope.project.id=1cca069e1cb44ca6baae94c18f1eb534, user.id=87ea694c5ee54adaa05fa5a5eb43ea4b) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:05.754109 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d5ba6-29dc-4415-b882-8bb686931278 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:05.755966 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8d5ba6-29dc-4415-b882-8bb686931278 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:05.762954 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 106/206] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:16:05 2022] GET /identity/v3/role_assignments?user.id=87ea694c5ee54adaa05fa5a5eb43ea4b&scope.project.id=1cca069e1cb44ca6baae94c18f1eb534&role.id=aa317d762bd64a9d864e54d074507f94 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:05.846043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031fa67c-5f76-4453-9a22-3f4bd05bb882 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:05.907179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91788a1b-7e64-4cc0-a059-5e144d3fe621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:05.908087 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91788a1b-7e64-4cc0-a059-5e144d3fe621 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:05.908373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91788a1b-7e64-4cc0-a059-5e144d3fe621 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:05.908651 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91788a1b-7e64-4cc0-a059-5e144d3fe621 None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:05.909980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91788a1b-7e64-4cc0-a059-5e144d3fe621 None admin] RBAC: Authorizing `identity:get_project(project_id=48537ad736fa4427a5c6de586bc429e5)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:05.911463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91788a1b-7e64-4cc0-a059-5e144d3fe621 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:05.913420 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 101/207] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:05 2022] GET /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:05.920016 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d5ba6-29dc-4415-b882-8bb686931278 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:06.077243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8d5ba6-29dc-4415-b882-8bb686931278 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:06.126656 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2d226-2aa9-4ee3-af2a-a7d2abb786b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:06.127740 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2d226-2aa9-4ee3-af2a-a7d2abb786b8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:06.128224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2d226-2aa9-4ee3-af2a-a7d2abb786b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:06.128696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2d226-2aa9-4ee3-af2a-a7d2abb786b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:06.134896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2d226-2aa9-4ee3-af2a-a7d2abb786b8 None admin] RBAC: Adding query filter params (role.id=428c7cbed69f4893a907b0f69ab8eb98, scope.project.id=48537ad736fa4427a5c6de586bc429e5, user.id=99e2f2e318f94903bb19738696e1da20) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:06.135496 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2d226-2aa9-4ee3-af2a-a7d2abb786b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:06.137178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2d226-2aa9-4ee3-af2a-a7d2abb786b8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:06.150654 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 107/208] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:16:05 2022] GET /identity/v3/role_assignments?user.id=99e2f2e318f94903bb19738696e1da20&scope.project.id=48537ad736fa4427a5c6de586bc429e5&role.id=428c7cbed69f4893a907b0f69ab8eb98 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:06.503972 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d9726-665b-488d-9951-b0ec5f228da4 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:06.504419 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d9726-665b-488d-9951-b0ec5f228da4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:06.504602 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2d9726-665b-488d-9951-b0ec5f228da4 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:06.505931 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 102/209] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:06.511549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c2708-99d3-4a49-8667-1f7267084858 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:06.511847 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c2708-99d3-4a49-8667-1f7267084858 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:06.512128 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c2708-99d3-4a49-8667-1f7267084858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:06.530429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-3c4c2708-99d3-4a49-8667-1f7267084858 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:06.532130 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3c4c2708-99d3-4a49-8667-1f7267084858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:06.535107 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:06.576100 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882eeae-2ba7-4feb-bfd4-9a655fee19db None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:06.576534 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882eeae-2ba7-4feb-bfd4-9a655fee19db None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:06.576937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f882eeae-2ba7-4feb-bfd4-9a655fee19db None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:06.578807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 103/210] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:06.584157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910a4ba-626a-4984-989f-21468354f785 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:06.585835 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910a4ba-626a-4984-989f-21468354f785 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:06.585835 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910a4ba-626a-4984-989f-21468354f785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:06.603125 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d910a4ba-626a-4984-989f-21468354f785 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:06.604691 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d910a4ba-626a-4984-989f-21468354f785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:06.615572 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:06.619630 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 108/211] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:16:06.651740 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c2708-99d3-4a49-8667-1f7267084858 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:06.694953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 104/212] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:16:06.721129 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910a4ba-626a-4984-989f-21468354f785 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:06.777458 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c2708-99d3-4a49-8667-1f7267084858 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:06.819298 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa53478-31a6-4538-acc7-3ffe2c38bef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:06.820110 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa53478-31a6-4538-acc7-3ffe2c38bef7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:06.820410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa53478-31a6-4538-acc7-3ffe2c38bef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:06.821085 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa53478-31a6-4538-acc7-3ffe2c38bef7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:06.831148 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:06.834689 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa53478-31a6-4538-acc7-3ffe2c38bef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:06.835647 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910a4ba-626a-4984-989f-21468354f785 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:06.843943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-0fa53478-31a6-4538-acc7-3ffe2c38bef7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:06.843943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:06.843943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:06.843943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:06.843943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:06.843943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:06.843943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:06.843943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:06.843943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:06.843943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:06.843943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:06.843943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:06.843943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:06.843943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:06.843943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:06.843943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:06.850736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:06.850736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:06.850736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:06.850736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:06.850736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:06.850736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:06.850736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:06.850736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:06.850736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:06.850736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:06.850736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:06.850736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:06.850736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:06.850736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:06.850736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:06.850736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:06.851517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:06.851517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:06.851517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:06.851517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:06.851517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:06.851517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:06.851517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:06.851517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:06.851517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:06.851517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:06.851517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:06.851517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:06.851517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 109/213] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:16:06.854872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa53478-31a6-4538-acc7-3ffe2c38bef7 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:06.877974 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bfe43-a155-4f0a-a10e-15500ac9dd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:06.879374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bfe43-a155-4f0a-a10e-15500ac9dd56 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:06.880300 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bfe43-a155-4f0a-a10e-15500ac9dd56 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:06.880778 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bfe43-a155-4f0a-a10e-15500ac9dd56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:06.882245 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bfe43-a155-4f0a-a10e-15500ac9dd56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:06.884818 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bfe43-a155-4f0a-a10e-15500ac9dd56 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:06.887603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 105/214] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:06.894171 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bfe43-a155-4f0a-a10e-15500ac9dd56 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:06.913339 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:06.986096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa53478-31a6-4538-acc7-3ffe2c38bef7 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:07.021400 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bfe43-a155-4f0a-a10e-15500ac9dd56 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:07.033009 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b2969-b981-4b0f-a1e1-76a2fe758fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:07.033614 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b2969-b981-4b0f-a1e1-76a2fe758fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:07.033954 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b2969-b981-4b0f-a1e1-76a2fe758fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:07.034239 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b2969-b981-4b0f-a1e1-76a2fe758fd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:07.035264 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b2969-b981-4b0f-a1e1-76a2fe758fd4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:07.035578 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b2969-b981-4b0f-a1e1-76a2fe758fd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:07.036981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b2969-b981-4b0f-a1e1-76a2fe758fd4 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:07.045885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 110/215] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:16:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:07.051865 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b2969-b981-4b0f-a1e1-76a2fe758fd4 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:07.065597 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac07f61-09c8-40ee-8861-b0dc0abea214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:07.066448 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac07f61-09c8-40ee-8861-b0dc0abea214 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:07.066804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac07f61-09c8-40ee-8861-b0dc0abea214 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:07.067183 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac07f61-09c8-40ee-8861-b0dc0abea214 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:07.068012 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac07f61-09c8-40ee-8861-b0dc0abea214 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:07.069639 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac07f61-09c8-40ee-8861-b0dc0abea214 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:07.144589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:07.176486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 106/216] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jul 18 02:16:06 2022] POST /identity/v3/users => generated 297 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:16:07.198337 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b2969-b981-4b0f-a1e1-76a2fe758fd4 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:07.241002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876c228-8a46-4669-80a1-cd7a65991c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:07.241955 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876c228-8a46-4669-80a1-cd7a65991c1a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:07.242242 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876c228-8a46-4669-80a1-cd7a65991c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:07.242518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876c228-8a46-4669-80a1-cd7a65991c1a None admin] PATH_INFO: `/v3/users/71fcc5f638e941cdac67adea70f49ef1` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:07.258461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876c228-8a46-4669-80a1-cd7a65991c1a None admin] RBAC: Authorizing `identity:get_user(user_id=71fcc5f638e941cdac67adea70f49ef1)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:07.260095 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876c228-8a46-4669-80a1-cd7a65991c1a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:07.262306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 111/217] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:16:07 2022] GET /identity/v3/users/71fcc5f638e941cdac67adea70f49ef1 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:07.272618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac07f61-09c8-40ee-8861-b0dc0abea214 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:07.349546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:07.384916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac07f61-09c8-40ee-8861-b0dc0abea214 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:07.421656 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ca30b-61bb-46a8-be07-9bbfed96a6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:07.422477 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ca30b-61bb-46a8-be07-9bbfed96a6ac None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:07.422838 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ca30b-61bb-46a8-be07-9bbfed96a6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:07.423185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ca30b-61bb-46a8-be07-9bbfed96a6ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:07.497437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ca30b-61bb-46a8-be07-9bbfed96a6ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:07.499126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ca30b-61bb-46a8-be07-9bbfed96a6ac None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:07.575359 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:07.614031 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 107/218] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:07.616210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876c228-8a46-4669-80a1-cd7a65991c1a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:07.727944 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876c228-8a46-4669-80a1-cd7a65991c1a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:07.749582 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:07.765100 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1dbbf-dc6b-44c1-aace-0816e962ed5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:07.766202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1dbbf-dc6b-44c1-aace-0816e962ed5f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:07.766484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1dbbf-dc6b-44c1-aace-0816e962ed5f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:07.766801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1dbbf-dc6b-44c1-aace-0816e962ed5f None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:07.768009 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1dbbf-dc6b-44c1-aace-0816e962ed5f None admin] RBAC: Authorizing `identity:get_project(project_id=1cca069e1cb44ca6baae94c18f1eb534)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:07.769533 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1dbbf-dc6b-44c1-aace-0816e962ed5f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:07.771353 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 112/219] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:07 2022] GET /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:07.777695 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ca30b-61bb-46a8-be07-9bbfed96a6ac None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:07.888467 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ca30b-61bb-46a8-be07-9bbfed96a6ac None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:07.926592 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920e666-c485-46b1-bb09-39d561baa30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:07.927575 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920e666-c485-46b1-bb09-39d561baa30b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:07.927864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920e666-c485-46b1-bb09-39d561baa30b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:07.928143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920e666-c485-46b1-bb09-39d561baa30b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:07.929047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920e666-c485-46b1-bb09-39d561baa30b None admin] RBAC: Adding query filter params (role.id=7db255e54afa4cecac2d6c93da70795e, scope.project.id=1cca069e1cb44ca6baae94c18f1eb534, user.id=71fcc5f638e941cdac67adea70f49ef1) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:07.929364 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920e666-c485-46b1-bb09-39d561baa30b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:07.931029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920e666-c485-46b1-bb09-39d561baa30b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:07.937134 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 108/220] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:16:07 2022] GET /identity/v3/role_assignments?user.id=71fcc5f638e941cdac67adea70f49ef1&scope.project.id=1cca069e1cb44ca6baae94c18f1eb534&role.id=7db255e54afa4cecac2d6c93da70795e => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:08.068609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5b110-57e7-4e9b-8799-b7935db185fb None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:08.069148 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5b110-57e7-4e9b-8799-b7935db185fb None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:08.069225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5b110-57e7-4e9b-8799-b7935db185fb None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:08.070890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 113/221] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:08.076688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b899ac1-0cfd-4b76-896c-76833943c3f9 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:08.076985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b899ac1-0cfd-4b76-896c-76833943c3f9 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:08.077265 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b899ac1-0cfd-4b76-896c-76833943c3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:08.088558 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42729f0d-a054-4fc2-a06f-c0104d3efe93 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:08.088901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42729f0d-a054-4fc2-a06f-c0104d3efe93 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:08.089189 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42729f0d-a054-4fc2-a06f-c0104d3efe93 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:08.090847 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 114/222] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:08.096688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48270f8-26c2-4e52-945e-1d6bdd658c7c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:08.096966 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48270f8-26c2-4e52-945e-1d6bdd658c7c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:08.097251 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48270f8-26c2-4e52-945e-1d6bdd658c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:08.103583 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2b899ac1-0cfd-4b76-896c-76833943c3f9 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:08.104867 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2b899ac1-0cfd-4b76-896c-76833943c3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:08.128802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c48270f8-26c2-4e52-945e-1d6bdd658c7c None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:08.135220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c48270f8-26c2-4e52-945e-1d6bdd658c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:08.136572 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:08.185652 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 109/223] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:08.211747 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b899ac1-0cfd-4b76-896c-76833943c3f9 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:08.214594 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 115/224] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:16:08.236997 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48270f8-26c2-4e52-945e-1d6bdd658c7c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:08.388866 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48270f8-26c2-4e52-945e-1d6bdd658c7c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:08.407339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:08.424986 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccbb6b-0ee7-459f-90f1-64fa5c014173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:08.425886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccbb6b-0ee7-459f-90f1-64fa5c014173 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:08.426319 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccbb6b-0ee7-459f-90f1-64fa5c014173 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:08.426497 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cccbb6b-0ee7-459f-90f1-64fa5c014173 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:08.437486 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cccbb6b-0ee7-459f-90f1-64fa5c014173 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:08.446030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-8cccbb6b-0ee7-459f-90f1-64fa5c014173 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:16:08.446030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:08.446030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:08.446030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:08.446030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:08.446030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:08.446030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:08.446030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:08.446030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:08.446030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:08.446030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:08.446030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:08.446030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:08.446030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:08.446030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:08.446030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:08.446904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:08.446904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:08.446904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:08.446904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:08.446904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:08.446904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:08.446904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:08.446904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:08.446904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:08.446904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:08.446904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:08.446904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:08.446904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:08.446904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:08.446904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:08.446904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:08.447666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:08.447666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:08.447666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:08.447666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:08.447666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:08.447666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:08.447666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:08.447666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:08.447666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:08.447666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:08.447666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:16:08.447666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:08.447666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 116/225] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:16:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:16:08.448305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b899ac1-0cfd-4b76-896c-76833943c3f9 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:08.453124 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccbb6b-0ee7-459f-90f1-64fa5c014173 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:08.540623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cc11d-6263-472c-b61b-5f5b7754903a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:08.541974 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cc11d-6263-472c-b61b-5f5b7754903a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:08.542485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cc11d-6263-472c-b61b-5f5b7754903a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:08.542961 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cc11d-6263-472c-b61b-5f5b7754903a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:08.556285 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cccbb6b-0ee7-459f-90f1-64fa5c014173 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:08.562648 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400cc11d-6263-472c-b61b-5f5b7754903a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:08.580103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-400cc11d-6263-472c-b61b-5f5b7754903a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:16:08.580103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:08.580103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:08.580103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:08.580103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:08.580103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:08.580103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:08.580103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:08.580103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:08.580103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:08.580103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:08.580103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:08.580103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:08.580103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:08.580103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:08.580103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:08.580996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:08.580996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:08.580996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:08.580996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:08.580996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:08.580996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:08.580996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:08.580996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:08.580996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:08.580996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:08.580996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:08.580996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:08.580996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:08.580996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:08.580996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:08.580996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:08.581820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:08.581820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:08.581820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:08.581820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:08.581820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:08.581820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:08.581820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:08.581820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:08.581820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:08.581820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:08.581820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:16:08.581820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:08.581820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 110/226] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jul 18 02:16:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:16:08.595318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cc11d-6263-472c-b61b-5f5b7754903a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:08.596332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a46e8-e089-46c6-9895-c1a03579658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:08.597023 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a46e8-e089-46c6-9895-c1a03579658c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:08.597313 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a46e8-e089-46c6-9895-c1a03579658c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:08.597591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a46e8-e089-46c6-9895-c1a03579658c None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:08.598385 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a46e8-e089-46c6-9895-c1a03579658c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:08.598698 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a46e8-e089-46c6-9895-c1a03579658c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:08.600102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a46e8-e089-46c6-9895-c1a03579658c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:08.613811 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 117/227] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:08.615389 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a46e8-e089-46c6-9895-c1a03579658c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:08.650083 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:08.668108 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:08.722160 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a46e8-e089-46c6-9895-c1a03579658c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:08.760109 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e9b56-d603-4098-a615-baa73407d7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:08.760999 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e9b56-d603-4098-a615-baa73407d7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:08.761284 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e9b56-d603-4098-a615-baa73407d7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:08.761565 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e9b56-d603-4098-a615-baa73407d7f1 None admin] PATH_INFO: `/v3/users/87ea694c5ee54adaa05fa5a5eb43ea4b` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:08.762817 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e9b56-d603-4098-a615-baa73407d7f1 None admin] RBAC: Authorizing `identity:get_user(user_id=87ea694c5ee54adaa05fa5a5eb43ea4b)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:08.765065 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e9b56-d603-4098-a615-baa73407d7f1 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:08.772008 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 118/228] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:16:08 2022] GET /identity/v3/users/87ea694c5ee54adaa05fa5a5eb43ea4b => generated 283 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:08.773203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e9b56-d603-4098-a615-baa73407d7f1 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:08.827752 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cc11d-6263-472c-b61b-5f5b7754903a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:08.884937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e9b56-d603-4098-a615-baa73407d7f1 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:08.898091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:08.925327 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c8afb-679f-4ff8-9bef-2ef7a83d8000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:08.926174 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c8afb-679f-4ff8-9bef-2ef7a83d8000 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:08.926461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c8afb-679f-4ff8-9bef-2ef7a83d8000 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:08.926744 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c8afb-679f-4ff8-9bef-2ef7a83d8000 None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:08.928202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c8afb-679f-4ff8-9bef-2ef7a83d8000 None admin] RBAC: Authorizing `identity:get_project(project_id=1cca069e1cb44ca6baae94c18f1eb534)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:08.929675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c8afb-679f-4ff8-9bef-2ef7a83d8000 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:08.936730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 119/229] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:08 2022] GET /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:08.938042 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c8afb-679f-4ff8-9bef-2ef7a83d8000 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:08.963027 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c6502-4dc5-4df4-bac4-f5c0b7b21161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:08.963713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c6502-4dc5-4df4-bac4-f5c0b7b21161 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:08.963994 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c6502-4dc5-4df4-bac4-f5c0b7b21161 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:08.964264 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8c6502-4dc5-4df4-bac4-f5c0b7b21161 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:08.965022 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c6502-4dc5-4df4-bac4-f5c0b7b21161 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:08.965323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c6502-4dc5-4df4-bac4-f5c0b7b21161 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:08.966751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8c6502-4dc5-4df4-bac4-f5c0b7b21161 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:08.988127 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 111/230] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:16:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:09.006732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c6502-4dc5-4df4-bac4-f5c0b7b21161 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:09.051498 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c8afb-679f-4ff8-9bef-2ef7a83d8000 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:09.087545 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ab148-577c-4c79-8a30-5f47a800b85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:09.088451 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ab148-577c-4c79-8a30-5f47a800b85c None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:09.088739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ab148-577c-4c79-8a30-5f47a800b85c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:09.089021 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ab148-577c-4c79-8a30-5f47a800b85c None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534/users/87ea694c5ee54adaa05fa5a5eb43ea4b/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:09.091157 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ab148-577c-4c79-8a30-5f47a800b85c None admin] RBAC: Authorizing `identity:create_grant(project_id=1cca069e1cb44ca6baae94c18f1eb534, user_id=87ea694c5ee54adaa05fa5a5eb43ea4b, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:09.092621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ab148-577c-4c79-8a30-5f47a800b85c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:09.170593 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:09.187285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8c6502-4dc5-4df4-bac4-f5c0b7b21161 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:09.205927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 120/231] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:16:08 2022] PUT /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534/users/87ea694c5ee54adaa05fa5a5eb43ea4b/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:16:09.242201 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce5cf6-3a2e-4ef2-a14b-ad62d1b5add5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:09.243175 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce5cf6-3a2e-4ef2-a14b-ad62d1b5add5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:09.243461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce5cf6-3a2e-4ef2-a14b-ad62d1b5add5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:09.243740 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce5cf6-3a2e-4ef2-a14b-ad62d1b5add5 None admin] PATH_INFO: `/v3/users/87ea694c5ee54adaa05fa5a5eb43ea4b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:09.248352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce5cf6-3a2e-4ef2-a14b-ad62d1b5add5 None admin] RBAC: Authorizing `identity:get_user(user_id=87ea694c5ee54adaa05fa5a5eb43ea4b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:09.249887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce5cf6-3a2e-4ef2-a14b-ad62d1b5add5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:09.252581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 112/232] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:16:09 2022] GET /identity/v3/users/87ea694c5ee54adaa05fa5a5eb43ea4b => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:09.258324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ab148-577c-4c79-8a30-5f47a800b85c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:09.304240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:09.387703 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ab148-577c-4c79-8a30-5f47a800b85c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:09.434370 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb60743-72f7-4d90-bab2-27b4540f073b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:09.435258 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb60743-72f7-4d90-bab2-27b4540f073b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:09.435547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb60743-72f7-4d90-bab2-27b4540f073b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:09.435829 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb60743-72f7-4d90-bab2-27b4540f073b None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:09.439016 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb60743-72f7-4d90-bab2-27b4540f073b None admin] RBAC: Authorizing `identity:get_project(project_id=1cca069e1cb44ca6baae94c18f1eb534)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:09.440449 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb60743-72f7-4d90-bab2-27b4540f073b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:09.442411 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 121/233] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:09 2022] GET /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:09.448125 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce5cf6-3a2e-4ef2-a14b-ad62d1b5add5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:09.559976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce5cf6-3a2e-4ef2-a14b-ad62d1b5add5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:09.596544 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce7b4c-4206-4e85-b263-ef36c4c5a040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:09.597439 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce7b4c-4206-4e85-b263-ef36c4c5a040 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:09.597735 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce7b4c-4206-4e85-b263-ef36c4c5a040 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:09.598018 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce7b4c-4206-4e85-b263-ef36c4c5a040 None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534/users/87ea694c5ee54adaa05fa5a5eb43ea4b/roles/aa317d762bd64a9d864e54d074507f94` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:09.600276 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce7b4c-4206-4e85-b263-ef36c4c5a040 None admin] RBAC: Authorizing `identity:create_grant(project_id=1cca069e1cb44ca6baae94c18f1eb534, user_id=87ea694c5ee54adaa05fa5a5eb43ea4b, role_id=aa317d762bd64a9d864e54d074507f94)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:09.601734 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce7b4c-4206-4e85-b263-ef36c4c5a040 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:09.716107 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 113/234] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:16:09 2022] PUT /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534/users/87ea694c5ee54adaa05fa5a5eb43ea4b/roles/aa317d762bd64a9d864e54d074507f94 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:16:09.872495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d9c48-1436-4ac7-ab33-2c30a426bac5 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:09.872897 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d9c48-1436-4ac7-ab33-2c30a426bac5 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:09.873070 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d9c48-1436-4ac7-ab33-2c30a426bac5 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:09.874615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 122/235] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:09.880356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc07bd-d864-4fd8-9e9d-e5a0ac8f8866 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:09.880844 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc07bd-d864-4fd8-9e9d-e5a0ac8f8866 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:09.880955 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc07bd-d864-4fd8-9e9d-e5a0ac8f8866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:09.884519 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c055a5-6999-4e84-b5ca-0d99ce2127c9 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:09.884886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c055a5-6999-4e84-b5ca-0d99ce2127c9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:09.885184 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c055a5-6999-4e84-b5ca-0d99ce2127c9 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:09.887439 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 123/236] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:09.895558 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9a92d-4b34-4954-be83-b511443a8937 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:09.895873 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9a92d-4b34-4954-be83-b511443a8937 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:09.896130 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9a92d-4b34-4954-be83-b511443a8937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:09.903138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3bdc07bd-d864-4fd8-9e9d-e5a0ac8f8866 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:09.904371 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3bdc07bd-d864-4fd8-9e9d-e5a0ac8f8866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:09.915033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:09.917987 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0bd9a92d-4b34-4954-be83-b511443a8937 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:09.919222 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0bd9a92d-4b34-4954-be83-b511443a8937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:10.004697 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 114/237] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:16:10.011297 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 124/238] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:16:10.028735 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc07bd-d864-4fd8-9e9d-e5a0ac8f8866 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:10.043147 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9a92d-4b34-4954-be83-b511443a8937 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:10.084667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:10.143439 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc07bd-d864-4fd8-9e9d-e5a0ac8f8866 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:10.178691 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd9a92d-4b34-4954-be83-b511443a8937 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:10.190675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f3a14-7683-4faa-a8b0-6f243a733daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:10.191865 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f3a14-7683-4faa-a8b0-6f243a733daf None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:10.192346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f3a14-7683-4faa-a8b0-6f243a733daf None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:10.192817 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f3a14-7683-4faa-a8b0-6f243a733daf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:10.211540 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f3a14-7683-4faa-a8b0-6f243a733daf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:10.214598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7242bd-1d8f-4e92-9b79-2ad842fb5279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:10.215403 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7242bd-1d8f-4e92-9b79-2ad842fb5279 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:10.215686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7242bd-1d8f-4e92-9b79-2ad842fb5279 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:10.215961 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7242bd-1d8f-4e92-9b79-2ad842fb5279 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:10.222065 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7242bd-1d8f-4e92-9b79-2ad842fb5279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:10.222065 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7242bd-1d8f-4e92-9b79-2ad842fb5279 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:10.222065 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 125/239] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:10.226326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-8a0f3a14-7683-4faa-a8b0-6f243a733daf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 02:16:10.226326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:10.226326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:10.226326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:10.226326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:10.226326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:10.226326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:10.226326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:10.226326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:10.226326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:10.226326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:10.226326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:10.226326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:10.226326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:10.226326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:10.226326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:10.227163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:10.227163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:10.227163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:10.227163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:10.227163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:10.227163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:10.227163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:10.227163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:10.227163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:10.227163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:10.227163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:10.227163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:10.227163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:10.227163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:10.227163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:10.227163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:10.228051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:10.228051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:10.228051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:10.228051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:10.228051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:10.228051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:10.228051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:10.228051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:10.228051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:10.228051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:10.228051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 02:16:10.228051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:10.228640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7242bd-1d8f-4e92-9b79-2ad842fb5279 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:10.230598 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 115/240] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:10.239165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f3a14-7683-4faa-a8b0-6f243a733daf None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:10.242527 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:10.336584 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7242bd-1d8f-4e92-9b79-2ad842fb5279 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:10.350183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:10.362385 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f3a14-7683-4faa-a8b0-6f243a733daf None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:10.381390 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e492757-43b8-46bf-b3e8-052a567d64b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:10.382222 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e492757-43b8-46bf-b3e8-052a567d64b1 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:10.382621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e492757-43b8-46bf-b3e8-052a567d64b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:10.382978 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e492757-43b8-46bf-b3e8-052a567d64b1 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:10.384446 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e492757-43b8-46bf-b3e8-052a567d64b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:10.386598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e492757-43b8-46bf-b3e8-052a567d64b1 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:10.400092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701351ae-5520-4910-be8b-39dcfca90295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:10.400836 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701351ae-5520-4910-be8b-39dcfca90295 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:10.401123 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701351ae-5520-4910-be8b-39dcfca90295 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:10.401404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701351ae-5520-4910-be8b-39dcfca90295 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:10.402202 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701351ae-5520-4910-be8b-39dcfca90295 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:10.402516 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701351ae-5520-4910-be8b-39dcfca90295 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:10.403906 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701351ae-5520-4910-be8b-39dcfca90295 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:10.413222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 116/241] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:16:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:10.414490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c90e9b-a8c2-45f0-8597-f544a1cf7461 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:10.414783 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c90e9b-a8c2-45f0-8597-f544a1cf7461 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:10.415068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c90e9b-a8c2-45f0-8597-f544a1cf7461 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:10.416301 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 117/242] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:10.422675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c90e9b-a8c2-45f0-8597-f544a1cf7461 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:10.470496 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 126/243] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jul 18 02:16:10 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:16:10.473049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dd629-eb5a-4374-9f7d-7b4175cd75b6 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:10.473870 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dd629-eb5a-4374-9f7d-7b4175cd75b6 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:10.474395 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99dd629-eb5a-4374-9f7d-7b4175cd75b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:10.496140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-d99dd629-eb5a-4374-9f7d-7b4175cd75b6 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:10.498042 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d99dd629-eb5a-4374-9f7d-7b4175cd75b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:10.519400 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:10.588637 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 127/244] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:10.624980 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99dd629-eb5a-4374-9f7d-7b4175cd75b6 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:10.642408 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c90e9b-a8c2-45f0-8597-f544a1cf7461 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:10.685565 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8257a1-a382-4087-882c-8135ddbdab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:10.686795 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8257a1-a382-4087-882c-8135ddbdab32 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:10.687272 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8257a1-a382-4087-882c-8135ddbdab32 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:10.687751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8257a1-a382-4087-882c-8135ddbdab32 None admin] PATH_INFO: `/v3/users/9155dc3812ef4777991e2ac332909291` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:10.702189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8257a1-a382-4087-882c-8135ddbdab32 None admin] RBAC: Authorizing `identity:get_user(user_id=9155dc3812ef4777991e2ac332909291)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:10.704459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8257a1-a382-4087-882c-8135ddbdab32 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:10.706733 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 118/245] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:16:10 2022] GET /identity/v3/users/9155dc3812ef4777991e2ac332909291 => generated 297 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:10.714709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8257a1-a382-4087-882c-8135ddbdab32 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:10.733666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:10.753332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99dd629-eb5a-4374-9f7d-7b4175cd75b6 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:10.799187 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0b5cc-8fc3-432a-a982-582038e87db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:10.800012 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0b5cc-8fc3-432a-a982-582038e87db6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:10.800297 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0b5cc-8fc3-432a-a982-582038e87db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:10.800575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0b5cc-8fc3-432a-a982-582038e87db6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:10.814660 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0b5cc-8fc3-432a-a982-582038e87db6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:10.823114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-58d0b5cc-8fc3-432a-a982-582038e87db6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:10.823114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:10.823114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:10.823114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:10.823114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:10.823114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:10.823114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:10.823114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:10.823114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:10.823114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:10.823114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:10.823114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:10.823114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:10.823114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:10.823114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:10.823114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:10.824017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:10.824017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:10.824017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:10.824017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:10.824017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:10.824017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:10.824017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:10.824017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:10.824017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:10.824017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:10.824017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:10.824017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:10.824017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:10.824017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:10.824017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:10.824017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:10.824867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:10.824867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:10.824867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:10.824867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:10.824867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:10.824867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:10.824867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:10.824867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:10.824867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:10.824867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:10.824867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:10.824867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:10.824867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 128/246] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:16:10.830287 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0b5cc-8fc3-432a-a982-582038e87db6 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:10.832179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8257a1-a382-4087-882c-8135ddbdab32 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:10.856290 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:10.870773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71243e-1554-4208-9788-162c004b622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:10.871730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71243e-1554-4208-9788-162c004b622d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:10.877189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71243e-1554-4208-9788-162c004b622d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:10.877189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71243e-1554-4208-9788-162c004b622d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:10.946226 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71243e-1554-4208-9788-162c004b622d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:10.947190 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0b5cc-8fc3-432a-a982-582038e87db6 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:10.948611 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71243e-1554-4208-9788-162c004b622d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:10.985483 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cde5b4-c726-4b11-9445-ba03f49ac5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:10.986197 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cde5b4-c726-4b11-9445-ba03f49ac5aa None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:10.986488 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cde5b4-c726-4b11-9445-ba03f49ac5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:10.986764 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cde5b4-c726-4b11-9445-ba03f49ac5aa None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:10.987508 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cde5b4-c726-4b11-9445-ba03f49ac5aa None admin] RBAC: Adding query filter params (name=member) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:10.987814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cde5b4-c726-4b11-9445-ba03f49ac5aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:10.989326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cde5b4-c726-4b11-9445-ba03f49ac5aa None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:10.999612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 129/247] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:16:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:11.008107 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cde5b4-c726-4b11-9445-ba03f49ac5aa None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:11.028845 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:11.060503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 119/248] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:11.067659 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71243e-1554-4208-9788-162c004b622d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:11.097163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:11.173196 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cde5b4-c726-4b11-9445-ba03f49ac5aa None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:11.191829 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71243e-1554-4208-9788-162c004b622d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:11.214030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501ab77-d3f4-4799-b238-2c57be4f96fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:11.215621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501ab77-d3f4-4799-b238-2c57be4f96fa None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:11.216153 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501ab77-d3f4-4799-b238-2c57be4f96fa None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:11.216870 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501ab77-d3f4-4799-b238-2c57be4f96fa None admin] PATH_INFO: `/v3/users/71fcc5f638e941cdac67adea70f49ef1` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:11.218976 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501ab77-d3f4-4799-b238-2c57be4f96fa None admin] RBAC: Authorizing `identity:get_user(user_id=71fcc5f638e941cdac67adea70f49ef1)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:11.220864 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501ab77-d3f4-4799-b238-2c57be4f96fa None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:11.222888 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 130/249] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:16:11 2022] GET /identity/v3/users/71fcc5f638e941cdac67adea70f49ef1 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:11.228876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501ab77-d3f4-4799-b238-2c57be4f96fa None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:11.231479 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dda983-cc0d-44cb-a254-6bdb41504505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:11.232538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dda983-cc0d-44cb-a254-6bdb41504505 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:11.232827 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dda983-cc0d-44cb-a254-6bdb41504505 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:11.233106 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dda983-cc0d-44cb-a254-6bdb41504505 None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:11.235671 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dda983-cc0d-44cb-a254-6bdb41504505 None admin] RBAC: Authorizing `identity:get_project(project_id=1cca069e1cb44ca6baae94c18f1eb534)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:11.237137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dda983-cc0d-44cb-a254-6bdb41504505 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:11.239154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 120/250] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:11 2022] GET /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:11.246395 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dda983-cc0d-44cb-a254-6bdb41504505 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:11.327872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:11.352657 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501ab77-d3f4-4799-b238-2c57be4f96fa None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:11.361555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:11.373086 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dda983-cc0d-44cb-a254-6bdb41504505 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:11.391788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2893daa-2b93-4069-a50f-f91d452549b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:11.393028 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2893daa-2b93-4069-a50f-f91d452549b8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:11.393511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2893daa-2b93-4069-a50f-f91d452549b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:11.394296 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2893daa-2b93-4069-a50f-f91d452549b8 None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:11.396660 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2893daa-2b93-4069-a50f-f91d452549b8 None admin] RBAC: Authorizing `identity:get_project(project_id=1cca069e1cb44ca6baae94c18f1eb534)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:11.398370 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2893daa-2b93-4069-a50f-f91d452549b8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:11.400767 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 131/251] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:11 2022] GET /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:11.407338 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2893daa-2b93-4069-a50f-f91d452549b8 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:11.413433 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9873c8-2a1d-4a62-b899-cc580852a265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:11.414170 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9873c8-2a1d-4a62-b899-cc580852a265 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:11.414437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9873c8-2a1d-4a62-b899-cc580852a265 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:11.414782 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9873c8-2a1d-4a62-b899-cc580852a265 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:11.415869 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9873c8-2a1d-4a62-b899-cc580852a265 None admin] RBAC: Adding query filter params (role.id=428c7cbed69f4893a907b0f69ab8eb98, scope.project.id=1cca069e1cb44ca6baae94c18f1eb534, user.id=9155dc3812ef4777991e2ac332909291) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:11.416296 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9873c8-2a1d-4a62-b899-cc580852a265 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:11.418199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9873c8-2a1d-4a62-b899-cc580852a265 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:11.429447 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 121/252] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:16:11 2022] GET /identity/v3/role_assignments?user.id=9155dc3812ef4777991e2ac332909291&scope.project.id=1cca069e1cb44ca6baae94c18f1eb534&role.id=428c7cbed69f4893a907b0f69ab8eb98 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:11.568485 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2893daa-2b93-4069-a50f-f91d452549b8 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:11.605280 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a4e61-70df-4b41-aba7-0845cf77d6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:11.606549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a4e61-70df-4b41-aba7-0845cf77d6d4 None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:11.606978 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a4e61-70df-4b41-aba7-0845cf77d6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:11.607424 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a4e61-70df-4b41-aba7-0845cf77d6d4 None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534/users/71fcc5f638e941cdac67adea70f49ef1/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:11.609747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a4e61-70df-4b41-aba7-0845cf77d6d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=1cca069e1cb44ca6baae94c18f1eb534, user_id=71fcc5f638e941cdac67adea70f49ef1, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:11.611408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a4e61-70df-4b41-aba7-0845cf77d6d4 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:11.688501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 132/253] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:16:11 2022] PUT /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534/users/71fcc5f638e941cdac67adea70f49ef1/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:16:12.025225 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf6105-f9d6-4456-87d5-4139db0cca98 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:12.025748 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf6105-f9d6-4456-87d5-4139db0cca98 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:12.025748 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf6105-f9d6-4456-87d5-4139db0cca98 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:12.027089 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 122/254] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:12.033306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed466609-fdd4-4995-a1c2-4b449ee2e7e9 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:12.033594 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed466609-fdd4-4995-a1c2-4b449ee2e7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:12.033895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed466609-fdd4-4995-a1c2-4b449ee2e7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:12.045634 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:12.055375 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-ed466609-fdd4-4995-a1c2-4b449ee2e7e9 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:12.056670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ed466609-fdd4-4995-a1c2-4b449ee2e7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:12.158220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 133/255] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:12.204065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf6105-f9d6-4456-87d5-4139db0cca98 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:12.343504 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf6105-f9d6-4456-87d5-4139db0cca98 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:12.388065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622c36c-046b-4b39-b9ec-bcf8a9ec078c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:12.389220 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622c36c-046b-4b39-b9ec-bcf8a9ec078c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:12.389730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622c36c-046b-4b39-b9ec-bcf8a9ec078c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:12.390237 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622c36c-046b-4b39-b9ec-bcf8a9ec078c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:12.405886 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622c36c-046b-4b39-b9ec-bcf8a9ec078c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:12.414561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-d622c36c-046b-4b39-b9ec-bcf8a9ec078c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:16:12.414561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:12.414561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:12.414561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:12.414561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:12.414561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:12.414561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:12.414561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:12.414561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:12.414561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:12.414561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:12.414561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:12.414561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:12.414561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:12.414561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:12.414561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:12.415423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:12.415423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:12.415423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:12.415423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:12.415423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:12.415423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:12.415423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:12.415423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:12.415423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:12.415423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:12.415423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:12.415423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:12.415423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:12.415423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:12.415423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:12.415423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:12.416232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:12.416232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:12.416232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:12.416232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:12.416232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:12.416232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:12.416232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:12.416232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:12.416232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:12.416232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:12.416232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:16:12.416232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:12.418607 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 123/256] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:16:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:12.424644 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed466609-fdd4-4995-a1c2-4b449ee2e7e9 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:12.545931 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed466609-fdd4-4995-a1c2-4b449ee2e7e9 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:12.600182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e6906-0cd7-464c-9b0c-7ecc8373599b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:12.601240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e6906-0cd7-464c-9b0c-7ecc8373599b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:12.601744 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e6906-0cd7-464c-9b0c-7ecc8373599b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:12.602248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e6906-0cd7-464c-9b0c-7ecc8373599b None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:12.603273 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e6906-0cd7-464c-9b0c-7ecc8373599b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:12.603793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e6906-0cd7-464c-9b0c-7ecc8373599b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:12.605440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e6906-0cd7-464c-9b0c-7ecc8373599b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:12.608547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:12.618094 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 134/257] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:12.623620 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622c36c-046b-4b39-b9ec-bcf8a9ec078c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:12.644971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:12.761073 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622c36c-046b-4b39-b9ec-bcf8a9ec078c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:12.796073 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b487db-8bca-4b76-b2c7-83f7e6c63376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:12.796994 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b487db-8bca-4b76-b2c7-83f7e6c63376 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:12.797289 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b487db-8bca-4b76-b2c7-83f7e6c63376 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:12.797569 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b487db-8bca-4b76-b2c7-83f7e6c63376 None admin] PATH_INFO: `/v3/users/87ea694c5ee54adaa05fa5a5eb43ea4b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:12.798821 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b487db-8bca-4b76-b2c7-83f7e6c63376 None admin] RBAC: Authorizing `identity:get_user(user_id=87ea694c5ee54adaa05fa5a5eb43ea4b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:12.800275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b487db-8bca-4b76-b2c7-83f7e6c63376 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:12.805807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 124/258] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:16:12 2022] GET /identity/v3/users/87ea694c5ee54adaa05fa5a5eb43ea4b => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:12.808083 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e6906-0cd7-464c-9b0c-7ecc8373599b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:12.819813 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263be12-0740-43a6-9fa9-3624ad90760f None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:12.820108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263be12-0740-43a6-9fa9-3624ad90760f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:12.820393 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263be12-0740-43a6-9fa9-3624ad90760f None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:12.825829 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 125/259] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:12.826989 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c872f-be75-4c68-beca-6391d6b6b86c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:12.827279 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c872f-be75-4c68-beca-6391d6b6b86c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:12.827567 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c872f-be75-4c68-beca-6391d6b6b86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:12.863841 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b34c872f-be75-4c68-beca-6391d6b6b86c None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:12.865044 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b34c872f-be75-4c68-beca-6391d6b6b86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:12.939966 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e6906-0cd7-464c-9b0c-7ecc8373599b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:12.978009 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd7c6e-b631-42be-b970-2d82432cba7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:12.978678 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd7c6e-b631-42be-b970-2d82432cba7f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:12.978965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd7c6e-b631-42be-b970-2d82432cba7f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:12.979241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd7c6e-b631-42be-b970-2d82432cba7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:12.986305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 126/260] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:13.024668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c872f-be75-4c68-beca-6391d6b6b86c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:13.046460 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:13.049914 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd7c6e-b631-42be-b970-2d82432cba7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:13.051425 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:13.052304 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd7c6e-b631-42be-b970-2d82432cba7f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:13.247773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 135/261] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:13.255478 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd7c6e-b631-42be-b970-2d82432cba7f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:13.305986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c872f-be75-4c68-beca-6391d6b6b86c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:13.393504 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c1093-27e8-4aa0-8297-d25a5ac275b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:13.394807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c1093-27e8-4aa0-8297-d25a5ac275b3 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:13.395296 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c1093-27e8-4aa0-8297-d25a5ac275b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:13.395769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c1093-27e8-4aa0-8297-d25a5ac275b3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:13.423394 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:13.425265 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c1093-27e8-4aa0-8297-d25a5ac275b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:13.432202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd7c6e-b631-42be-b970-2d82432cba7f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:13.442780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-4e8c1093-27e8-4aa0-8297-d25a5ac275b3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:16:13.442780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:13.442780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:13.442780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:13.442780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:13.442780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:13.442780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:13.442780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:13.442780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:13.442780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:13.442780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:13.442780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:13.442780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:13.442780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:13.442780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:13.442780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:13.448306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:13.448306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:13.448306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:13.448306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:13.448306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:13.448306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:13.448306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:13.448306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:13.448306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:13.448306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:13.448306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:13.448306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:13.448306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:13.448306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:13.448306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:13.448306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:13.449268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:13.449268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:13.449268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:13.449268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:13.449268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:13.449268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:13.449268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:13.449268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:13.449268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:13.449268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:13.449268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:16:13.449268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:13.449268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 127/262] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jul 18 02:16:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:16:13.453574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c1093-27e8-4aa0-8297-d25a5ac275b3 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:13.522913 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1c79a-158a-499c-bb52-5fc91bb187a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:13.524195 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1c79a-158a-499c-bb52-5fc91bb187a9 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:13.524675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1c79a-158a-499c-bb52-5fc91bb187a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:13.525143 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c1c79a-158a-499c-bb52-5fc91bb187a9 None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:13.527086 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1c79a-158a-499c-bb52-5fc91bb187a9 None admin] RBAC: Authorizing `identity:get_project(project_id=1cca069e1cb44ca6baae94c18f1eb534)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:13.528924 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c1c79a-158a-499c-bb52-5fc91bb187a9 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:13.531311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 136/263] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:13 2022] GET /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:13.536784 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1c79a-158a-499c-bb52-5fc91bb187a9 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:13.589588 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:13.647235 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c1093-27e8-4aa0-8297-d25a5ac275b3 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:13.715745 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac735ec3-c39a-430c-8870-d735f8a6a830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:13.716358 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac735ec3-c39a-430c-8870-d735f8a6a830 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:13.716643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac735ec3-c39a-430c-8870-d735f8a6a830 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:13.716920 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac735ec3-c39a-430c-8870-d735f8a6a830 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:13.717684 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac735ec3-c39a-430c-8870-d735f8a6a830 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:13.718031 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac735ec3-c39a-430c-8870-d735f8a6a830 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:13.719951 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac735ec3-c39a-430c-8870-d735f8a6a830 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:13.730426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 128/264] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:16:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:13.731863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092fcbb-60a9-4476-8982-485f64552a3e None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:13.732158 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092fcbb-60a9-4476-8982-485f64552a3e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:13.732441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092fcbb-60a9-4476-8982-485f64552a3e None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:13.732782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c1c79a-158a-499c-bb52-5fc91bb187a9 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:13.737903 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 129/265] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:13.738795 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092fcbb-60a9-4476-8982-485f64552a3e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:13.806103 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052fed38-5ce4-4904-933a-b289cc4b9bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:13.806780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fed38-5ce4-4904-933a-b289cc4b9bd0 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:13.807063 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fed38-5ce4-4904-933a-b289cc4b9bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:13.807341 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052fed38-5ce4-4904-933a-b289cc4b9bd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:13.808191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fed38-5ce4-4904-933a-b289cc4b9bd0 None admin] RBAC: Adding query filter params (role.id=5dfa34e7a4594751aed7c0495c9a2383, scope.project.id=1cca069e1cb44ca6baae94c18f1eb534, user.id=87ea694c5ee54adaa05fa5a5eb43ea4b) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:13.808504 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fed38-5ce4-4904-933a-b289cc4b9bd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:13.810007 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052fed38-5ce4-4904-933a-b289cc4b9bd0 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:13.820061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 137/266] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:16:13 2022] GET /identity/v3/role_assignments?user.id=87ea694c5ee54adaa05fa5a5eb43ea4b&scope.project.id=1cca069e1cb44ca6baae94c18f1eb534&role.id=5dfa34e7a4594751aed7c0495c9a2383 => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:13.828789 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697932b-5401-4ce4-8751-e0dcf1eb2eb5 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:13.829102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697932b-5401-4ce4-8751-e0dcf1eb2eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:13.829347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697932b-5401-4ce4-8751-e0dcf1eb2eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:13.876860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c697932b-5401-4ce4-8751-e0dcf1eb2eb5 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:13.878098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c697932b-5401-4ce4-8751-e0dcf1eb2eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:13.931029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092fcbb-60a9-4476-8982-485f64552a3e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:13.935466 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:13.999911 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66ed45-a9b1-4033-80fd-4b16365025ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:14.000721 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66ed45-a9b1-4033-80fd-4b16365025ae None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:14.001006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66ed45-a9b1-4033-80fd-4b16365025ae None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:14.001285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66ed45-a9b1-4033-80fd-4b16365025ae None admin] PATH_INFO: `/v3/users/87ea694c5ee54adaa05fa5a5eb43ea4b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:14.003167 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66ed45-a9b1-4033-80fd-4b16365025ae None admin] RBAC: Authorizing `identity:get_user(user_id=87ea694c5ee54adaa05fa5a5eb43ea4b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:14.004661 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66ed45-a9b1-4033-80fd-4b16365025ae None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:14.006426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 130/267] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:16:13 2022] GET /identity/v3/users/87ea694c5ee54adaa05fa5a5eb43ea4b => generated 283 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:14.012935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66ed45-a9b1-4033-80fd-4b16365025ae None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:14.017828 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 138/268] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:14.018374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:14.072512 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697932b-5401-4ce4-8751-e0dcf1eb2eb5 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:14.200196 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66ed45-a9b1-4033-80fd-4b16365025ae None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:14.243234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0134e71-acba-47db-aae6-b27c9a4cfe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:14.244592 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0134e71-acba-47db-aae6-b27c9a4cfe9b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:14.245033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0134e71-acba-47db-aae6-b27c9a4cfe9b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:14.245733 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0134e71-acba-47db-aae6-b27c9a4cfe9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:14.250760 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697932b-5401-4ce4-8751-e0dcf1eb2eb5 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:14.291949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944240f1-8a2b-4764-9b60-e76647ebf78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:14.293247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944240f1-8a2b-4764-9b60-e76647ebf78d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:14.293607 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944240f1-8a2b-4764-9b60-e76647ebf78d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:14.294063 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944240f1-8a2b-4764-9b60-e76647ebf78d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:14.307688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944240f1-8a2b-4764-9b60-e76647ebf78d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:14.316591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-944240f1-8a2b-4764-9b60-e76647ebf78d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:14.316591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:14.316591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:14.316591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:14.316591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:14.316591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:14.316591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:14.316591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:14.316591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:14.316591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:14.316591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:14.316591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:14.316591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:14.316591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:14.316591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:14.316591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:14.317681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:14.317681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:14.317681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:14.317681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:14.317681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:14.317681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:14.317681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:14.317681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:14.317681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:14.317681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:14.317681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:14.317681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:14.317681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:14.317681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:14.317681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:14.317681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:14.318699 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:14.318699 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:14.318699 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:14.318699 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:14.318699 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:14.318699 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:14.318699 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:14.318699 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:14.318699 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:14.318699 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:14.318699 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:14.318699 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:14.320296 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 139/269] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:16:14.321663 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43030964-9b6a-4349-af67-aa0c92ee3f38 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:14.322077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43030964-9b6a-4349-af67-aa0c92ee3f38 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:14.322427 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43030964-9b6a-4349-af67-aa0c92ee3f38 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:14.324066 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 140/270] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:14.328570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43030964-9b6a-4349-af67-aa0c92ee3f38 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:14.338900 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0134e71-acba-47db-aae6-b27c9a4cfe9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:14.340583 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0134e71-acba-47db-aae6-b27c9a4cfe9b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:14.343239 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:14.360566 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:14.459057 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43030964-9b6a-4349-af67-aa0c92ee3f38 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:14.459863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 131/271] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:14.462143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c14d3-4dc7-4ace-85ad-3fcfc1501359 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:14.462449 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c14d3-4dc7-4ace-85ad-3fcfc1501359 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:14.462736 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c14d3-4dc7-4ace-85ad-3fcfc1501359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:14.480631 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-9f2c14d3-4dc7-4ace-85ad-3fcfc1501359 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:14.481863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9f2c14d3-4dc7-4ace-85ad-3fcfc1501359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:14.499264 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be6c47-102d-4bb0-8fb2-e3171b93bf65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:14.500478 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be6c47-102d-4bb0-8fb2-e3171b93bf65 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:14.500946 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be6c47-102d-4bb0-8fb2-e3171b93bf65 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:14.501049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be6c47-102d-4bb0-8fb2-e3171b93bf65 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:14.501800 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be6c47-102d-4bb0-8fb2-e3171b93bf65 None admin] RBAC: Adding query filter params (name=member) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:14.502114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be6c47-102d-4bb0-8fb2-e3171b93bf65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:14.503785 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be6c47-102d-4bb0-8fb2-e3171b93bf65 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:14.512436 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 141/272] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:16:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:14.513688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76f73b-5853-4b58-839d-1ae29f5985c9 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:14.514005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76f73b-5853-4b58-839d-1ae29f5985c9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:14.514282 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b76f73b-5853-4b58-839d-1ae29f5985c9 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:14.520292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 142/273] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:14.520292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76f73b-5853-4b58-839d-1ae29f5985c9 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:14.560517 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 132/274] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:14.561763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c14d3-4dc7-4ace-85ad-3fcfc1501359 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:14.599793 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:14.618733 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:14.646795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b76f73b-5853-4b58-839d-1ae29f5985c9 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:14.684606 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c14d3-4dc7-4ace-85ad-3fcfc1501359 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:14.686415 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e05df-5466-4f79-ba92-4087535c2a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:14.687332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e05df-5466-4f79-ba92-4087535c2a59 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:14.687619 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e05df-5466-4f79-ba92-4087535c2a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:14.687899 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e05df-5466-4f79-ba92-4087535c2a59 None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:14.689073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e05df-5466-4f79-ba92-4087535c2a59 None admin] RBAC: Authorizing `identity:get_project(project_id=1cca069e1cb44ca6baae94c18f1eb534)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:14.690548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e05df-5466-4f79-ba92-4087535c2a59 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:14.692439 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 143/275] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:14 2022] GET /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:14.693524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d52ec-572c-4967-9efb-4fad19e83e33 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:14.693839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d52ec-572c-4967-9efb-4fad19e83e33 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:14.694126 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d52ec-572c-4967-9efb-4fad19e83e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:14.710013 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-225d52ec-572c-4967-9efb-4fad19e83e33 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:14.711201 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-225d52ec-572c-4967-9efb-4fad19e83e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:14.726166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7510b-3740-493b-895c-244d245079b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:14.727280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7510b-3740-493b-895c-244d245079b5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:14.727565 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7510b-3740-493b-895c-244d245079b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:14.727840 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7510b-3740-493b-895c-244d245079b5 None admin] PATH_INFO: `/v3/users/c0a50e368c0d4ac288bd3d6927ba9ba7` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:14.741927 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7510b-3740-493b-895c-244d245079b5 None admin] RBAC: Authorizing `identity:get_user(user_id=c0a50e368c0d4ac288bd3d6927ba9ba7)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:14.743828 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7510b-3740-493b-895c-244d245079b5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:14.745655 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 133/276] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:16:14 2022] GET /identity/v3/users/c0a50e368c0d4ac288bd3d6927ba9ba7 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:14.750658 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7510b-3740-493b-895c-244d245079b5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:14.783632 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 144/277] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:14.784407 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d52ec-572c-4967-9efb-4fad19e83e33 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:14.863368 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:14.873857 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7510b-3740-493b-895c-244d245079b5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:14.880368 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:14.901312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d52ec-572c-4967-9efb-4fad19e83e33 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:14.910320 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d20b9b-5e75-4ab9-b7ac-d5198bab8ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:14.911120 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d20b9b-5e75-4ab9-b7ac-d5198bab8ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:14.911399 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d20b9b-5e75-4ab9-b7ac-d5198bab8ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:14.911672 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d20b9b-5e75-4ab9-b7ac-d5198bab8ba0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:14.922748 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d20b9b-5e75-4ab9-b7ac-d5198bab8ba0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:14.930685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-35d20b9b-5e75-4ab9-b7ac-d5198bab8ba0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 02:16:14.930685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:14.930685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:14.930685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:14.930685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:14.930685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:14.930685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:14.930685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:14.930685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:14.930685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:14.930685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:14.930685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:14.930685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:14.930685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:14.930685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:14.930685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:14.931542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:14.931542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:14.931542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:14.931542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:14.931542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:14.931542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:14.931542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:14.931542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:14.931542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:14.931542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:14.931542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:14.931542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:14.931542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:14.931542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:14.931542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:14.931542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:14.932485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:14.932485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:14.932485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:14.932485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:14.932485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:14.932485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:14.932485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:14.932485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:14.932485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:14.932485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:14.932485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 02:16:14.932485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:14.932485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 134/278] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:14.933666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d20b9b-5e75-4ab9-b7ac-d5198bab8ba0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:14.939034 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c535c84-b240-47fd-8403-2e26018742e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:14.939701 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c535c84-b240-47fd-8403-2e26018742e8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:14.939987 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c535c84-b240-47fd-8403-2e26018742e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:14.940265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c535c84-b240-47fd-8403-2e26018742e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:14.941098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c535c84-b240-47fd-8403-2e26018742e8 None admin] RBAC: Adding query filter params (role.id=aa317d762bd64a9d864e54d074507f94, scope.project.id=1cca069e1cb44ca6baae94c18f1eb534, user.id=87ea694c5ee54adaa05fa5a5eb43ea4b) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:14.941418 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c535c84-b240-47fd-8403-2e26018742e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:14.942927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c535c84-b240-47fd-8403-2e26018742e8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:14.949009 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 145/279] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:16:14 2022] GET /identity/v3/role_assignments?user.id=87ea694c5ee54adaa05fa5a5eb43ea4b&scope.project.id=1cca069e1cb44ca6baae94c18f1eb534&role.id=aa317d762bd64a9d864e54d074507f94 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:14.950724 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c535c84-b240-47fd-8403-2e26018742e8 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:15.043790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d20b9b-5e75-4ab9-b7ac-d5198bab8ba0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:15.060777 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c535c84-b240-47fd-8403-2e26018742e8 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:15.082574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa282726-a225-4508-9261-7b7498acbda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:15.083475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa282726-a225-4508-9261-7b7498acbda3 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:15.083658 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa282726-a225-4508-9261-7b7498acbda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:15.083939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa282726-a225-4508-9261-7b7498acbda3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:15.084793 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa282726-a225-4508-9261-7b7498acbda3 None admin] RBAC: Adding query filter params (role.id=7db255e54afa4cecac2d6c93da70795e, user.id=c0a50e368c0d4ac288bd3d6927ba9ba7, scope.system=all) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:15.085109 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa282726-a225-4508-9261-7b7498acbda3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:15.086642 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa282726-a225-4508-9261-7b7498acbda3 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:15.097744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 135/280] 10.222.0.64 () {56 vars in 1308 bytes} [Mon Jul 18 02:16:14 2022] GET /identity/v3/role_assignments?user.id=c0a50e368c0d4ac288bd3d6927ba9ba7&scope.system=all&role.id=7db255e54afa4cecac2d6c93da70795e => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:15.097744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e716709-8606-41e6-af17-c473e21267fa None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:15.097744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e716709-8606-41e6-af17-c473e21267fa None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:15.097744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e716709-8606-41e6-af17-c473e21267fa None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:15.097744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 136/281] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:15.101469 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e716709-8606-41e6-af17-c473e21267fa None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:15.111846 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd889c0b-adc4-406f-8530-472990d70d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:15.112683 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd889c0b-adc4-406f-8530-472990d70d2d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:15.113635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd889c0b-adc4-406f-8530-472990d70d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:15.113635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd889c0b-adc4-406f-8530-472990d70d2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:15.114722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd889c0b-adc4-406f-8530-472990d70d2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:15.116375 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd889c0b-adc4-406f-8530-472990d70d2d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:15.118817 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 146/282] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:15.120691 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b8874-ac0a-46bc-a66a-a86cb7277b5a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:15.120985 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b8874-ac0a-46bc-a66a-a86cb7277b5a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:15.121267 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7b8874-ac0a-46bc-a66a-a86cb7277b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:15.126473 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:15.150790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-7f7b8874-ac0a-46bc-a66a-a86cb7277b5a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:15.152336 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7f7b8874-ac0a-46bc-a66a-a86cb7277b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:15.163703 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:15.250601 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 147/283] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:15.251504 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b8874-ac0a-46bc-a66a-a86cb7277b5a None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:15.271052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e716709-8606-41e6-af17-c473e21267fa None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:15.319580 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b13178-6fd9-406a-97ca-5b9ebf4b7193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:15.320183 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b13178-6fd9-406a-97ca-5b9ebf4b7193 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:15.320473 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b13178-6fd9-406a-97ca-5b9ebf4b7193 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:15.320748 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b13178-6fd9-406a-97ca-5b9ebf4b7193 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:15.321514 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b13178-6fd9-406a-97ca-5b9ebf4b7193 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:15.321858 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b13178-6fd9-406a-97ca-5b9ebf4b7193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:15.323249 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b13178-6fd9-406a-97ca-5b9ebf4b7193 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:15.337369 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 137/284] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:16:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:15.337369 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b13178-6fd9-406a-97ca-5b9ebf4b7193 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:15.366339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7b8874-ac0a-46bc-a66a-a86cb7277b5a None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:15.404864 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bc0e6-a6a5-41c7-93a7-4054b5a644dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:15.405495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bc0e6-a6a5-41c7-93a7-4054b5a644dc None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:15.405810 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bc0e6-a6a5-41c7-93a7-4054b5a644dc None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:15.406626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44bc0e6-a6a5-41c7-93a7-4054b5a644dc None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:15.407339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bc0e6-a6a5-41c7-93a7-4054b5a644dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:15.408782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44bc0e6-a6a5-41c7-93a7-4054b5a644dc None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:15.420762 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:15.443550 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b13178-6fd9-406a-97ca-5b9ebf4b7193 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:15.476396 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14642661-71d0-4a6b-8d4c-7850b7fe0aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:15.477224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14642661-71d0-4a6b-8d4c-7850b7fe0aaf None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:15.477517 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14642661-71d0-4a6b-8d4c-7850b7fe0aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:15.477832 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14642661-71d0-4a6b-8d4c-7850b7fe0aaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:15.488634 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14642661-71d0-4a6b-8d4c-7850b7fe0aaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:15.496615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-14642661-71d0-4a6b-8d4c-7850b7fe0aaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:15.496615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:15.496615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:15.496615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:15.496615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:15.496615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:15.496615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:15.496615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:15.496615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:15.496615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:15.496615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:15.496615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:15.496615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:15.496615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:15.496615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:15.496615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:15.497650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:15.497650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:15.497650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:15.497650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:15.497650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:15.497650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:15.497650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:15.497650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:15.497650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:15.497650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:15.497650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:15.497650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:15.497650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:15.497650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:15.497650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:15.497650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:15.498473 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:15.498473 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:15.498473 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:15.498473 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:15.498473 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:15.498473 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:15.498473 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:15.498473 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:15.498473 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:15.498473 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:15.498473 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:15.498473 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:15.498473 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 138/285] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:15.499536 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14642661-71d0-4a6b-8d4c-7850b7fe0aaf None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:15.503397 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:15.509882 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 148/286] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jul 18 02:16:15 2022] POST /identity/v3/users => generated 293 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:16:15.510917 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bc0e6-a6a5-41c7-93a7-4054b5a644dc None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:15.625764 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44bc0e6-a6a5-41c7-93a7-4054b5a644dc None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:15.647567 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14642661-71d0-4a6b-8d4c-7850b7fe0aaf None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:15.666032 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb21fd-5897-4c8d-bc47-3c49001cb159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:15.667159 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb21fd-5897-4c8d-bc47-3c49001cb159 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:15.667624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb21fd-5897-4c8d-bc47-3c49001cb159 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:15.668058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb21fd-5897-4c8d-bc47-3c49001cb159 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:15.668974 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb21fd-5897-4c8d-bc47-3c49001cb159 None admin] RBAC: Adding query filter params (name=member) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:15.669436 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb21fd-5897-4c8d-bc47-3c49001cb159 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:15.671236 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb21fd-5897-4c8d-bc47-3c49001cb159 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:15.682392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 149/287] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:16:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:15.688519 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb21fd-5897-4c8d-bc47-3c49001cb159 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:15.697941 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf99f86-08be-4863-8c96-4fafb670ed63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:15.698837 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf99f86-08be-4863-8c96-4fafb670ed63 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:15.699122 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf99f86-08be-4863-8c96-4fafb670ed63 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:15.699404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf99f86-08be-4863-8c96-4fafb670ed63 None admin] PATH_INFO: `/v3/users/9155dc3812ef4777991e2ac332909291` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:15.701407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf99f86-08be-4863-8c96-4fafb670ed63 None admin] RBAC: Authorizing `identity:get_user(user_id=9155dc3812ef4777991e2ac332909291)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:15.702959 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf99f86-08be-4863-8c96-4fafb670ed63 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:15.704953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 139/288] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:16:15 2022] GET /identity/v3/users/9155dc3812ef4777991e2ac332909291 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:15.710740 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf99f86-08be-4863-8c96-4fafb670ed63 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:15.715728 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:15.771767 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:15.815230 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb21fd-5897-4c8d-bc47-3c49001cb159 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:15.835872 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf99f86-08be-4863-8c96-4fafb670ed63 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:15.861261 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c22d97-9b1b-45fa-b020-49d5f7e77acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:15.862367 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c22d97-9b1b-45fa-b020-49d5f7e77acf None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:15.862659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c22d97-9b1b-45fa-b020-49d5f7e77acf None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:15.862939 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c22d97-9b1b-45fa-b020-49d5f7e77acf None admin] PATH_INFO: `/v3/users/71fcc5f638e941cdac67adea70f49ef1` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:15.865043 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c22d97-9b1b-45fa-b020-49d5f7e77acf None admin] RBAC: Authorizing `identity:get_user(user_id=71fcc5f638e941cdac67adea70f49ef1)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:15.866573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c22d97-9b1b-45fa-b020-49d5f7e77acf None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:15.868279 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 150/289] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:16:15 2022] GET /identity/v3/users/71fcc5f638e941cdac67adea70f49ef1 => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:15.874730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c22d97-9b1b-45fa-b020-49d5f7e77acf None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:15.889123 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05257bec-41b4-43fa-b00a-ed03b801584f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:15.890963 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05257bec-41b4-43fa-b00a-ed03b801584f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:15.891433 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05257bec-41b4-43fa-b00a-ed03b801584f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:15.891890 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05257bec-41b4-43fa-b00a-ed03b801584f None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:15.894036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05257bec-41b4-43fa-b00a-ed03b801584f None admin] RBAC: Authorizing `identity:get_project(project_id=1cca069e1cb44ca6baae94c18f1eb534)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:15.895654 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05257bec-41b4-43fa-b00a-ed03b801584f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:15.897573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 140/290] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:15 2022] GET /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:15.905370 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05257bec-41b4-43fa-b00a-ed03b801584f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:15.990213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c22d97-9b1b-45fa-b020-49d5f7e77acf None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:16.003694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:16.031263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05257bec-41b4-43fa-b00a-ed03b801584f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:16.032522 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:16.049303 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff0bae-2cbd-46b3-bdec-055df5f6b9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:16.049999 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff0bae-2cbd-46b3-bdec-055df5f6b9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:16.050281 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff0bae-2cbd-46b3-bdec-055df5f6b9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:16.050557 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff0bae-2cbd-46b3-bdec-055df5f6b9c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:16.101209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f967d7-4c74-4eb7-b6cf-387273f0eb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:16.102248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f967d7-4c74-4eb7-b6cf-387273f0eb5e None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:16.102536 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f967d7-4c74-4eb7-b6cf-387273f0eb5e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:16.102899 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f967d7-4c74-4eb7-b6cf-387273f0eb5e None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534/users/9155dc3812ef4777991e2ac332909291/roles/428c7cbed69f4893a907b0f69ab8eb98` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:16.107437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f967d7-4c74-4eb7-b6cf-387273f0eb5e None admin] RBAC: Authorizing `identity:create_grant(project_id=1cca069e1cb44ca6baae94c18f1eb534, user_id=9155dc3812ef4777991e2ac332909291, role_id=428c7cbed69f4893a907b0f69ab8eb98)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:16.109178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f967d7-4c74-4eb7-b6cf-387273f0eb5e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:16.140905 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff0bae-2cbd-46b3-bdec-055df5f6b9c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:16.143650 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ff0bae-2cbd-46b3-bdec-055df5f6b9c8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:16.183741 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 141/291] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:16:15 2022] PUT /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534/users/9155dc3812ef4777991e2ac332909291/roles/428c7cbed69f4893a907b0f69ab8eb98 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:16:16.282200 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 151/292] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:16.288000 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f967d7-4c74-4eb7-b6cf-387273f0eb5e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:16.415720 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f967d7-4c74-4eb7-b6cf-387273f0eb5e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:16.455105 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:16.460358 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff9f8a-6233-4127-b578-fffe0d4432e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:16.461251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff9f8a-6233-4127-b578-fffe0d4432e9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:16.461537 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff9f8a-6233-4127-b578-fffe0d4432e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:16.461850 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff9f8a-6233-4127-b578-fffe0d4432e9 None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:16.463130 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff9f8a-6233-4127-b578-fffe0d4432e9 None admin] RBAC: Authorizing `identity:get_project(project_id=1cca069e1cb44ca6baae94c18f1eb534)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:16.464706 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faff9f8a-6233-4127-b578-fffe0d4432e9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:16.466811 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 142/293] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:16 2022] GET /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:16.472790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff0bae-2cbd-46b3-bdec-055df5f6b9c8 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:16.503673 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:16.581383 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff0bae-2cbd-46b3-bdec-055df5f6b9c8 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:16.617739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26db52-c2a4-4e57-bea9-abdb86593865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:16.617739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26db52-c2a4-4e57-bea9-abdb86593865 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:16.617739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26db52-c2a4-4e57-bea9-abdb86593865 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:16.618334 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26db52-c2a4-4e57-bea9-abdb86593865 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:16.621746 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26db52-c2a4-4e57-bea9-abdb86593865 None admin] RBAC: Adding query filter params (role.id=7db255e54afa4cecac2d6c93da70795e, scope.project.id=1cca069e1cb44ca6baae94c18f1eb534, user.id=71fcc5f638e941cdac67adea70f49ef1) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:16.621746 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26db52-c2a4-4e57-bea9-abdb86593865 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:16.621746 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26db52-c2a4-4e57-bea9-abdb86593865 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:16.628574 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 152/294] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:16:16 2022] GET /identity/v3/role_assignments?user.id=71fcc5f638e941cdac67adea70f49ef1&scope.project.id=1cca069e1cb44ca6baae94c18f1eb534&role.id=7db255e54afa4cecac2d6c93da70795e => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:17.227894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01173fec-5863-409f-bee3-b8f67d498146 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:17.228273 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01173fec-5863-409f-bee3-b8f67d498146 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:17.228434 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01173fec-5863-409f-bee3-b8f67d498146 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:17.230160 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 143/295] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:17.235770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1c9c4-e701-415f-8180-aa8ef6abfd0c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:17.236065 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1c9c4-e701-415f-8180-aa8ef6abfd0c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:17.236347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1c9c4-e701-415f-8180-aa8ef6abfd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:17.256288 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-e2a1c9c4-e701-415f-8180-aa8ef6abfd0c None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:17.257497 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e2a1c9c4-e701-415f-8180-aa8ef6abfd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:17.326055 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 153/296] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:17.348025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01173fec-5863-409f-bee3-b8f67d498146 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:17.454280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01173fec-5863-409f-bee3-b8f67d498146 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:17.489776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f263bba-93ee-425b-85b0-5c06c599cf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:17.490586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f263bba-93ee-425b-85b0-5c06c599cf39 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:17.490872 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f263bba-93ee-425b-85b0-5c06c599cf39 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:17.491149 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f263bba-93ee-425b-85b0-5c06c599cf39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:17.501671 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f263bba-93ee-425b-85b0-5c06c599cf39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:17.509610 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-4f263bba-93ee-425b-85b0-5c06c599cf39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:17.509610 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:17.509610 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:17.509610 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:17.509610 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:17.509610 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:17.509610 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:17.509610 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:17.509610 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:17.509610 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:17.509610 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:17.509610 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:17.509610 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:17.509610 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:17.509610 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:17.509610 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:17.511769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:17.511769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:17.511769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:17.511769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:17.511769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:17.511769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:17.511769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:17.511769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:17.511769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:17.511769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:17.511769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:17.511769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:17.511769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:17.511769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:17.511769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:17.511769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:17.513792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:17.513792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:17.513792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:17.513792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:17.513792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:17.513792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:17.513792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:17.513792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:17.513792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:17.513792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:17.513792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:17.513792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:17.513792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 144/297] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:17.517864 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1c9c4-e701-415f-8180-aa8ef6abfd0c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:17.546847 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:17.622370 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1c9c4-e701-415f-8180-aa8ef6abfd0c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:17.658595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a2e16-1bb4-4056-8786-14641da8f21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:17.659276 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a2e16-1bb4-4056-8786-14641da8f21c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:17.659560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a2e16-1bb4-4056-8786-14641da8f21c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:17.659842 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a2e16-1bb4-4056-8786-14641da8f21c None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:17.660604 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a2e16-1bb4-4056-8786-14641da8f21c None admin] RBAC: Adding query filter params (name=member) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:17.660907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a2e16-1bb4-4056-8786-14641da8f21c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:17.662348 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a2e16-1bb4-4056-8786-14641da8f21c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:17.671575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 154/298] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:16:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:17.677273 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f263bba-93ee-425b-85b0-5c06c599cf39 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:17.743389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:17.786082 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f263bba-93ee-425b-85b0-5c06c599cf39 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:17.823537 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9626b-f3fb-4767-ad4c-6b46f5ccb303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:17.824428 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9626b-f3fb-4767-ad4c-6b46f5ccb303 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:17.824712 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9626b-f3fb-4767-ad4c-6b46f5ccb303 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:17.824992 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9626b-f3fb-4767-ad4c-6b46f5ccb303 None admin] PATH_INFO: `/v3/users/c0a50e368c0d4ac288bd3d6927ba9ba7` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:17.826223 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9626b-f3fb-4767-ad4c-6b46f5ccb303 None admin] RBAC: Authorizing `identity:get_user(user_id=c0a50e368c0d4ac288bd3d6927ba9ba7)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:17.827735 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9626b-f3fb-4767-ad4c-6b46f5ccb303 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:17.829382 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 145/299] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:16:17 2022] GET /identity/v3/users/c0a50e368c0d4ac288bd3d6927ba9ba7 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:17.835267 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a2e16-1bb4-4056-8786-14641da8f21c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:17.929882 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:17.946377 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a2e16-1bb4-4056-8786-14641da8f21c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:17.980999 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ae1c7-1ff6-4369-96f9-a6171154d43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:17.981907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ae1c7-1ff6-4369-96f9-a6171154d43d None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:17.982194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ae1c7-1ff6-4369-96f9-a6171154d43d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:17.982474 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ae1c7-1ff6-4369-96f9-a6171154d43d None admin] PATH_INFO: `/v3/system/users/c0a50e368c0d4ac288bd3d6927ba9ba7/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:17.984502 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ae1c7-1ff6-4369-96f9-a6171154d43d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c0a50e368c0d4ac288bd3d6927ba9ba7, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:17.985915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ae1c7-1ff6-4369-96f9-a6171154d43d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:18.006282 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5556c-35bb-4948-a74d-73de46bbc384 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:18.006282 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5556c-35bb-4948-a74d-73de46bbc384 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:18.006282 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5556c-35bb-4948-a74d-73de46bbc384 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:18.006282 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 146/300] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:16:18.006282 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adac61-27c6-423c-b2c4-48950b63ac6e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:18.006282 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adac61-27c6-423c-b2c4-48950b63ac6e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:18.007266 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0adac61-27c6-423c-b2c4-48950b63ac6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:18.023552 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b0adac61-27c6-423c-b2c4-48950b63ac6e None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:18.024860 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b0adac61-27c6-423c-b2c4-48950b63ac6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:18.073515 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 155/301] 10.222.0.64 () {58 vars in 1334 bytes} [Mon Jul 18 02:16:17 2022] PUT /identity/v3/system/users/c0a50e368c0d4ac288bd3d6927ba9ba7/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:16:18.073515 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed762a8-78c0-4b14-84df-6e8c5830cae0 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:18.073515 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed762a8-78c0-4b14-84df-6e8c5830cae0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:18.073515 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed762a8-78c0-4b14-84df-6e8c5830cae0 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:18.073515 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 156/302] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:18.079929 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fc533-5ad2-4153-ae35-0a87ea2f0eeb None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:18.080293 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fc533-5ad2-4153-ae35-0a87ea2f0eeb None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:18.080794 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fc533-5ad2-4153-ae35-0a87ea2f0eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:18.106273 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 147/303] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:16:18.135300 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adac61-27c6-423c-b2c4-48950b63ac6e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:18.150166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-f08fc533-5ad2-4153-ae35-0a87ea2f0eeb None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:18.151562 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f08fc533-5ad2-4153-ae35-0a87ea2f0eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:18.209423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:18.255576 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 157/304] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:16:18.258681 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0adac61-27c6-423c-b2c4-48950b63ac6e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:18.278023 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fc533-5ad2-4153-ae35-0a87ea2f0eeb None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:18.298303 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7e261-770d-4a3c-b533-fc2cf279de93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:18.299114 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7e261-770d-4a3c-b533-fc2cf279de93 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:18.299393 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7e261-770d-4a3c-b533-fc2cf279de93 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:18.299663 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7e261-770d-4a3c-b533-fc2cf279de93 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:18.311709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7e261-770d-4a3c-b533-fc2cf279de93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:18.320197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-c0c7e261-770d-4a3c-b533-fc2cf279de93 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 02:16:18.320197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:18.320197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:18.320197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:18.320197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:18.320197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:18.320197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:18.320197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:18.320197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:18.320197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:18.320197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:18.320197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:18.320197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:18.320197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:18.320197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:18.320197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:18.321092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:18.321092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:18.321092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:18.321092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:18.321092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:18.321092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:18.321092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:18.321092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:18.321092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:18.321092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:18.321092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:18.321092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:18.321092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:18.321092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:18.321092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:18.321092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:18.321930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:18.321930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:18.321930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:18.321930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:18.321930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:18.321930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:18.321930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:18.321930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:18.321930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:18.321930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:18.321930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 02:16:18.321930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:18.321930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 148/305] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:18.332144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7e261-770d-4a3c-b533-fc2cf279de93 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:18.379739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:18.401265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08fc533-5ad2-4153-ae35-0a87ea2f0eeb None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:18.447721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430e940-cd55-4ff9-95ff-9f7a858e833f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:18.449203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430e940-cd55-4ff9-95ff-9f7a858e833f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:18.449692 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430e940-cd55-4ff9-95ff-9f7a858e833f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:18.450194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430e940-cd55-4ff9-95ff-9f7a858e833f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:18.452035 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430e940-cd55-4ff9-95ff-9f7a858e833f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:18.454187 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430e940-cd55-4ff9-95ff-9f7a858e833f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:18.456753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 158/306] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:18.462289 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430e940-cd55-4ff9-95ff-9f7a858e833f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:18.463819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7e261-770d-4a3c-b533-fc2cf279de93 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:18.482449 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:18.500558 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832663d7-4964-418f-8984-953a65489469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:18.501805 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832663d7-4964-418f-8984-953a65489469 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:18.501805 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832663d7-4964-418f-8984-953a65489469 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:18.501805 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832663d7-4964-418f-8984-953a65489469 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:18.502535 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832663d7-4964-418f-8984-953a65489469 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:18.502841 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832663d7-4964-418f-8984-953a65489469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:18.504211 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832663d7-4964-418f-8984-953a65489469 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:18.517877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 149/307] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:16:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:18.519104 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832663d7-4964-418f-8984-953a65489469 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:18.572579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430e940-cd55-4ff9-95ff-9f7a858e833f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:18.614956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395771f-d1e6-4890-a6b6-30069aa113e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:18.616416 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395771f-d1e6-4890-a6b6-30069aa113e8 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:18.617147 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395771f-d1e6-4890-a6b6-30069aa113e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:18.617623 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395771f-d1e6-4890-a6b6-30069aa113e8 None admin] PATH_INFO: `/v3/groups` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:18.619185 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395771f-d1e6-4890-a6b6-30069aa113e8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:18.621358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395771f-d1e6-4890-a6b6-30069aa113e8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:18.624817 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832663d7-4964-418f-8984-953a65489469 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:18.661157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781c674-8579-42c6-99dd-acf55de57804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:18.662068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781c674-8579-42c6-99dd-acf55de57804 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:18.662364 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781c674-8579-42c6-99dd-acf55de57804 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:18.662644 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781c674-8579-42c6-99dd-acf55de57804 None admin] PATH_INFO: `/v3/users/8aebafd7acec4322ba9bdfe491b2dcde` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:18.678192 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781c674-8579-42c6-99dd-acf55de57804 None admin] RBAC: Authorizing `identity:get_user(user_id=8aebafd7acec4322ba9bdfe491b2dcde)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:18.679836 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781c674-8579-42c6-99dd-acf55de57804 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:18.682588 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 150/308] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:16:18 2022] GET /identity/v3/users/8aebafd7acec4322ba9bdfe491b2dcde => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:18.693991 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781c674-8579-42c6-99dd-acf55de57804 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:18.697183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 159/309] 10.222.0.64 () {60 vars in 1134 bytes} [Mon Jul 18 02:16:18 2022] POST /identity/v3/groups => generated 229 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:16:18.744740 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5572006-fea7-4fcf-b2de-aad3837cedf2 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:18.745049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5572006-fea7-4fcf-b2de-aad3837cedf2 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:18.745308 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5572006-fea7-4fcf-b2de-aad3837cedf2 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:18.747089 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 160/310] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:16:18.752636 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba39ca-bee0-4d2f-8b1e-8d928c908981 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:18.752923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba39ca-bee0-4d2f-8b1e-8d928c908981 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:18.753209 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba39ca-bee0-4d2f-8b1e-8d928c908981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:18.762268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:18.768949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:18.775540 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-abba39ca-bee0-4d2f-8b1e-8d928c908981 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:18.778395 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-abba39ca-bee0-4d2f-8b1e-8d928c908981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:18.852061 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781c674-8579-42c6-99dd-acf55de57804 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:18.854913 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 161/311] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:16:18.879757 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba39ca-bee0-4d2f-8b1e-8d928c908981 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:18.901498 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7799b-d329-42d6-a62e-7a64f86b2b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:18.902304 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7799b-d329-42d6-a62e-7a64f86b2b42 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:18.902652 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7799b-d329-42d6-a62e-7a64f86b2b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:18.902996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7799b-d329-42d6-a62e-7a64f86b2b42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:18.904329 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7799b-d329-42d6-a62e-7a64f86b2b42 None admin] RBAC: Adding query filter params (role.id=428c7cbed69f4893a907b0f69ab8eb98, user.id=8aebafd7acec4322ba9bdfe491b2dcde, scope.system=all) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:18.904701 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7799b-d329-42d6-a62e-7a64f86b2b42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:18.906649 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7799b-d329-42d6-a62e-7a64f86b2b42 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:18.913609 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 151/312] 10.222.0.64 () {56 vars in 1308 bytes} [Mon Jul 18 02:16:18 2022] GET /identity/v3/role_assignments?user.id=8aebafd7acec4322ba9bdfe491b2dcde&scope.system=all&role.id=428c7cbed69f4893a907b0f69ab8eb98 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:18.997668 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba39ca-bee0-4d2f-8b1e-8d928c908981 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:19.042199 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf49ab-872e-4eb1-9e56-08154672b50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:19.042199 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf49ab-872e-4eb1-9e56-08154672b50a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:19.042199 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf49ab-872e-4eb1-9e56-08154672b50a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:19.042199 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf49ab-872e-4eb1-9e56-08154672b50a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:19.042628 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:19.050355 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf49ab-872e-4eb1-9e56-08154672b50a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:19.058737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-c0bf49ab-872e-4eb1-9e56-08154672b50a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 02:16:19.058737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:19.058737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:19.058737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:19.058737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:19.058737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:19.058737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:19.058737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:19.058737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:19.058737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:19.058737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:19.058737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:19.058737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:19.058737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:19.058737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:19.058737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:19.059860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:19.059860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:19.059860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:19.059860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:19.059860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:19.059860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:19.059860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:19.059860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:19.059860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:19.059860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:19.059860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:19.059860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:19.059860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:19.059860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:19.059860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:19.059860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:19.060851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:19.060851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:19.060851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:19.060851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:19.060851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:19.060851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:19.060851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:19.060851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:19.060851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:19.060851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:19.060851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 02:16:19.060851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:19.061555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 162/313] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:19.068060 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7799b-d329-42d6-a62e-7a64f86b2b42 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:19.174183 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7799b-d329-42d6-a62e-7a64f86b2b42 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:19.175770 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:19.211195 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d2d6d-2081-4399-b3e0-f2adaa71000e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:19.212860 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d2d6d-2081-4399-b3e0-f2adaa71000e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:19.213601 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d2d6d-2081-4399-b3e0-f2adaa71000e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:19.214227 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d2d6d-2081-4399-b3e0-f2adaa71000e None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:19.215215 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d2d6d-2081-4399-b3e0-f2adaa71000e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:19.216121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d2d6d-2081-4399-b3e0-f2adaa71000e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:19.217608 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d2d6d-2081-4399-b3e0-f2adaa71000e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:19.228554 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 152/314] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:16:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:19.236249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf49ab-872e-4eb1-9e56-08154672b50a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:19.342133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf49ab-872e-4eb1-9e56-08154672b50a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:19.377125 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39c977-7346-4841-bb97-9be816389283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:19.378060 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39c977-7346-4841-bb97-9be816389283 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:19.378346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39c977-7346-4841-bb97-9be816389283 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:19.378628 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39c977-7346-4841-bb97-9be816389283 None admin] PATH_INFO: `/v3/users/9155dc3812ef4777991e2ac332909291` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:19.379842 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39c977-7346-4841-bb97-9be816389283 None admin] RBAC: Authorizing `identity:get_user(user_id=9155dc3812ef4777991e2ac332909291)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:19.381299 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39c977-7346-4841-bb97-9be816389283 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:19.383284 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 163/315] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:16:19 2022] GET /identity/v3/users/9155dc3812ef4777991e2ac332909291 => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:19.388507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d2d6d-2081-4399-b3e0-f2adaa71000e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:19.492327 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d2d6d-2081-4399-b3e0-f2adaa71000e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:19.532678 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704367df-685d-46f7-8a42-860850154486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:19.533581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704367df-685d-46f7-8a42-860850154486 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:19.534067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704367df-685d-46f7-8a42-860850154486 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:19.534494 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704367df-685d-46f7-8a42-860850154486 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:19.574137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:19.607322 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704367df-685d-46f7-8a42-860850154486 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:19.608757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704367df-685d-46f7-8a42-860850154486 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:19.709674 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 153/316] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:19.714895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39c977-7346-4841-bb97-9be816389283 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:19.782908 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:19.821813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39c977-7346-4841-bb97-9be816389283 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:19.857631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca503094-d0bf-40a9-9c97-c94c02cbcd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:19.858470 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca503094-d0bf-40a9-9c97-c94c02cbcd9d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:19.858833 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca503094-d0bf-40a9-9c97-c94c02cbcd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:19.859617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca503094-d0bf-40a9-9c97-c94c02cbcd9d None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:19.860863 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca503094-d0bf-40a9-9c97-c94c02cbcd9d None admin] RBAC: Authorizing `identity:get_project(project_id=1cca069e1cb44ca6baae94c18f1eb534)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:19.862378 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca503094-d0bf-40a9-9c97-c94c02cbcd9d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:19.864961 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 164/317] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:19 2022] GET /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:19.870818 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704367df-685d-46f7-8a42-860850154486 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:19.951744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:19.992018 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704367df-685d-46f7-8a42-860850154486 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:20.028046 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d650f-6c8c-4c61-b584-00bba7506981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:20.028795 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d650f-6c8c-4c61-b584-00bba7506981 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:20.029129 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d650f-6c8c-4c61-b584-00bba7506981 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:20.029568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d650f-6c8c-4c61-b584-00bba7506981 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:20.030633 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d650f-6c8c-4c61-b584-00bba7506981 None admin] RBAC: Adding query filter params (role.id=428c7cbed69f4893a907b0f69ab8eb98, scope.project.id=1cca069e1cb44ca6baae94c18f1eb534, user.id=9155dc3812ef4777991e2ac332909291) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:20.030952 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d650f-6c8c-4c61-b584-00bba7506981 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:20.032392 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d650f-6c8c-4c61-b584-00bba7506981 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:20.038934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 154/318] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:16:19 2022] GET /identity/v3/role_assignments?user.id=9155dc3812ef4777991e2ac332909291&scope.project.id=1cca069e1cb44ca6baae94c18f1eb534&role.id=428c7cbed69f4893a907b0f69ab8eb98 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:20.222222 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebada9fa-c388-4471-9efc-ed84cd19de3c None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:20.222544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebada9fa-c388-4471-9efc-ed84cd19de3c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:20.222783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebada9fa-c388-4471-9efc-ed84cd19de3c None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:20.224181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 165/319] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:20.229670 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47129f8e-d4a6-4bbf-843f-73c33784791a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:20.229999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47129f8e-d4a6-4bbf-843f-73c33784791a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:20.230280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47129f8e-d4a6-4bbf-843f-73c33784791a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:20.251373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-47129f8e-d4a6-4bbf-843f-73c33784791a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:20.252561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-47129f8e-d4a6-4bbf-843f-73c33784791a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:20.322448 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 155/320] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:20.346076 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebada9fa-c388-4471-9efc-ed84cd19de3c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:20.449070 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebada9fa-c388-4471-9efc-ed84cd19de3c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:20.478476 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:20.483996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a12c00-021f-42aa-8d26-3dee6312b312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:20.484802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a12c00-021f-42aa-8d26-3dee6312b312 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:20.485087 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a12c00-021f-42aa-8d26-3dee6312b312 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:20.485363 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a12c00-021f-42aa-8d26-3dee6312b312 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:20.496425 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a12c00-021f-42aa-8d26-3dee6312b312 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:20.504981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-e9a12c00-021f-42aa-8d26-3dee6312b312 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:20.504981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:20.504981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:20.504981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:20.504981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:20.504981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:20.504981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:20.504981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:20.504981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:20.504981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:20.504981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:20.504981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:20.504981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:20.504981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:20.504981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:20.504981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:20.506150 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:20.506150 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:20.506150 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:20.506150 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:20.506150 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:20.506150 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:20.506150 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:20.506150 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:20.506150 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:20.506150 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:20.506150 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:20.506150 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:20.506150 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:20.506150 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:20.506150 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:20.506150 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:20.511681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:20.511681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:20.511681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:20.511681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:20.511681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:20.511681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:20.511681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:20.511681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:20.511681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:20.511681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:20.511681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:20.511681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:20.511681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 166/321] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:20.513962 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47129f8e-d4a6-4bbf-843f-73c33784791a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:20.572902 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:20.616173 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47129f8e-d4a6-4bbf-843f-73c33784791a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:20.650519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409dbde6-cb83-4715-a035-d80bb224b5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:20.651197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409dbde6-cb83-4715-a035-d80bb224b5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:20.651494 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409dbde6-cb83-4715-a035-d80bb224b5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:20.651762 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409dbde6-cb83-4715-a035-d80bb224b5e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:20.652519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409dbde6-cb83-4715-a035-d80bb224b5e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:20.652830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409dbde6-cb83-4715-a035-d80bb224b5e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:20.654253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409dbde6-cb83-4715-a035-d80bb224b5e1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:20.662792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 156/322] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:16:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:20.668364 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a12c00-021f-42aa-8d26-3dee6312b312 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:20.774859 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a12c00-021f-42aa-8d26-3dee6312b312 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:20.808571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b437c-89a4-4474-b19c-792596f01908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:20.809450 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b437c-89a4-4474-b19c-792596f01908 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:20.809765 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b437c-89a4-4474-b19c-792596f01908 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:20.810045 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b437c-89a4-4474-b19c-792596f01908 None admin] PATH_INFO: `/v3/users/c0a50e368c0d4ac288bd3d6927ba9ba7` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:20.811235 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b437c-89a4-4474-b19c-792596f01908 None admin] RBAC: Authorizing `identity:get_user(user_id=c0a50e368c0d4ac288bd3d6927ba9ba7)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:20.813239 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b437c-89a4-4474-b19c-792596f01908 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:20.815076 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 167/323] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:16:20 2022] GET /identity/v3/users/c0a50e368c0d4ac288bd3d6927ba9ba7 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:20.820758 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409dbde6-cb83-4715-a035-d80bb224b5e1 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:20.882566 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253e7ee-0754-42bb-91d0-c8973ff4509d None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:20.882884 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253e7ee-0754-42bb-91d0-c8973ff4509d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:20.883212 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6253e7ee-0754-42bb-91d0-c8973ff4509d None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:20.885742 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 168/324] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:16:20.890110 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3114672-1c5e-45e5-9136-e337dfaa71d6 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:20.890557 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3114672-1c5e-45e5-9136-e337dfaa71d6 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:20.890837 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3114672-1c5e-45e5-9136-e337dfaa71d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:20.906910 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b3114672-1c5e-45e5-9136-e337dfaa71d6 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:20.908093 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b3114672-1c5e-45e5-9136-e337dfaa71d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:20.924550 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409dbde6-cb83-4715-a035-d80bb224b5e1 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:20.945362 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:20.960552 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536bef5-5671-4282-b684-3962bcc01fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:20.961216 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536bef5-5671-4282-b684-3962bcc01fdb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:20.961510 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536bef5-5671-4282-b684-3962bcc01fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:20.961835 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536bef5-5671-4282-b684-3962bcc01fdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:20.962674 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536bef5-5671-4282-b684-3962bcc01fdb None admin] RBAC: Adding query filter params (role.id=7db255e54afa4cecac2d6c93da70795e, user.id=c0a50e368c0d4ac288bd3d6927ba9ba7, scope.system=all) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:20.962992 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536bef5-5671-4282-b684-3962bcc01fdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:20.964434 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536bef5-5671-4282-b684-3962bcc01fdb None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:20.969846 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:20.977190 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 157/325] 10.222.0.64 () {56 vars in 1308 bytes} [Mon Jul 18 02:16:20 2022] GET /identity/v3/role_assignments?user.id=c0a50e368c0d4ac288bd3d6927ba9ba7&scope.system=all&role.id=7db255e54afa4cecac2d6c93da70795e => generated 510 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:20.981226 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071b519-165b-4695-a209-72a301c89373 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:20.981370 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 169/326] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:16:20.981448 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071b519-165b-4695-a209-72a301c89373 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:20.981609 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071b519-165b-4695-a209-72a301c89373 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:20.983113 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 158/327] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:16:20.990302 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139730a7-6a3d-4636-ac97-4b65e4788851 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:20.990829 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139730a7-6a3d-4636-ac97-4b65e4788851 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:20.991186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139730a7-6a3d-4636-ac97-4b65e4788851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:21.004998 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071b519-165b-4695-a209-72a301c89373 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:21.011050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-139730a7-6a3d-4636-ac97-4b65e4788851 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:21.012293 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-139730a7-6a3d-4636-ac97-4b65e4788851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:21.135990 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 170/328] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:21.160458 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139730a7-6a3d-4636-ac97-4b65e4788851 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:21.177102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071b519-165b-4695-a209-72a301c89373 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:21.212599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc7841-563b-423b-9701-2fe71a14692b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:21.213399 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc7841-563b-423b-9701-2fe71a14692b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:21.213685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc7841-563b-423b-9701-2fe71a14692b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:21.214003 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc7841-563b-423b-9701-2fe71a14692b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:21.215160 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc7841-563b-423b-9701-2fe71a14692b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:21.216593 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc7841-563b-423b-9701-2fe71a14692b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:21.218306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 159/329] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:21.223647 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc7841-563b-423b-9701-2fe71a14692b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:21.261304 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139730a7-6a3d-4636-ac97-4b65e4788851 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:21.272908 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:21.282596 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:21.296381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97054d6-3d8a-4339-a377-2dd25735241a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:21.297177 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97054d6-3d8a-4339-a377-2dd25735241a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:21.297458 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97054d6-3d8a-4339-a377-2dd25735241a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:21.297756 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97054d6-3d8a-4339-a377-2dd25735241a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:21.308037 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97054d6-3d8a-4339-a377-2dd25735241a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:21.316259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-c97054d6-3d8a-4339-a377-2dd25735241a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 02:16:21.316259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:21.316259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:21.316259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:21.316259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:21.316259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:21.316259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:21.316259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:21.316259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:21.316259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:21.316259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:21.316259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:21.316259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:21.316259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:21.316259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:21.316259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:21.319098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:21.319098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:21.319098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:21.319098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:21.319098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:21.319098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:21.319098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:21.319098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:21.319098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:21.319098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:21.319098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:21.319098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:21.319098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:21.319098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:21.319098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:21.319098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:21.319887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:21.319887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:21.319887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:21.319887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:21.319887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:21.319887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:21.319887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:21.319887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:21.319887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:21.319887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:21.319887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 02:16:21.319887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:21.319887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 171/330] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:16:21.323378 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97054d6-3d8a-4339-a377-2dd25735241a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:21.329999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc7841-563b-423b-9701-2fe71a14692b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:21.363609 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbb3a3-bde2-4651-9695-b98c4c4e5020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:21.364280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbb3a3-bde2-4651-9695-b98c4c4e5020 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:21.364568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbb3a3-bde2-4651-9695-b98c4c4e5020 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:21.364848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbb3a3-bde2-4651-9695-b98c4c4e5020 None admin] PATH_INFO: `/v3/groups` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:21.365536 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fbb3a3-bde2-4651-9695-b98c4c4e5020 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:21.367008 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fbb3a3-bde2-4651-9695-b98c4c4e5020 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:21.419739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97054d6-3d8a-4339-a377-2dd25735241a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:21.453056 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6fc10-5356-40ba-b331-d6378a956a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:21.453746 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6fc10-5356-40ba-b331-d6378a956a53 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:21.454036 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6fc10-5356-40ba-b331-d6378a956a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:21.454318 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c6fc10-5356-40ba-b331-d6378a956a53 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:21.455065 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6fc10-5356-40ba-b331-d6378a956a53 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:21.455379 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6fc10-5356-40ba-b331-d6378a956a53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:21.456773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c6fc10-5356-40ba-b331-d6378a956a53 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:21.464596 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 172/331] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:16:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:21.470204 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6fc10-5356-40ba-b331-d6378a956a53 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:21.474807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 160/332] 10.222.0.64 () {60 vars in 1134 bytes} [Mon Jul 18 02:16:21 2022] POST /identity/v3/groups => generated 226 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:16:21.516909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:21.589910 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c6fc10-5356-40ba-b331-d6378a956a53 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:21.626297 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fc147-047d-4fb2-b088-edd3ddbd8c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:21.627181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fc147-047d-4fb2-b088-edd3ddbd8c6f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:21.627475 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fc147-047d-4fb2-b088-edd3ddbd8c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:21.627747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fc147-047d-4fb2-b088-edd3ddbd8c6f None admin] PATH_INFO: `/v3/users/8aebafd7acec4322ba9bdfe491b2dcde` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:21.628942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fc147-047d-4fb2-b088-edd3ddbd8c6f None admin] RBAC: Authorizing `identity:get_user(user_id=8aebafd7acec4322ba9bdfe491b2dcde)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:21.630422 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fc147-047d-4fb2-b088-edd3ddbd8c6f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:21.632054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 173/333] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:16:21 2022] GET /identity/v3/users/8aebafd7acec4322ba9bdfe491b2dcde => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:21.637663 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbb3a3-bde2-4651-9695-b98c4c4e5020 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:21.742009 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbb3a3-bde2-4651-9695-b98c4c4e5020 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:21.750371 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:21.779492 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20555e51-7d45-420e-a63d-d5604719c2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:21.780373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20555e51-7d45-420e-a63d-d5604719c2a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:21.780682 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20555e51-7d45-420e-a63d-d5604719c2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:21.780963 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20555e51-7d45-420e-a63d-d5604719c2a6 None admin] PATH_INFO: `/v3/system/users/8aebafd7acec4322ba9bdfe491b2dcde/roles/428c7cbed69f4893a907b0f69ab8eb98` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:21.782463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20555e51-7d45-420e-a63d-d5604719c2a6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8aebafd7acec4322ba9bdfe491b2dcde, role_id=428c7cbed69f4893a907b0f69ab8eb98)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:21.783986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20555e51-7d45-420e-a63d-d5604719c2a6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:21.856949 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 161/334] 10.222.0.64 () {58 vars in 1334 bytes} [Mon Jul 18 02:16:21 2022] PUT /identity/v3/system/users/8aebafd7acec4322ba9bdfe491b2dcde/roles/428c7cbed69f4893a907b0f69ab8eb98 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:16:23.782226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5db197-08ba-43d1-ac9d-b07e91ac046f None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:23.782760 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5db197-08ba-43d1-ac9d-b07e91ac046f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:23.782760 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5db197-08ba-43d1-ac9d-b07e91ac046f None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:23.784406 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 174/335] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:23.792505 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e30c49-ded5-4b51-9ae8-d9ad9e699bdf None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:23.792960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e30c49-ded5-4b51-9ae8-d9ad9e699bdf None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:23.793053 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e30c49-ded5-4b51-9ae8-d9ad9e699bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:23.814701 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e0e30c49-ded5-4b51-9ae8-d9ad9e699bdf None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:23.815910 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e0e30c49-ded5-4b51-9ae8-d9ad9e699bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:23.904387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 162/336] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:23.941160 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5db197-08ba-43d1-ac9d-b07e91ac046f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:24.066391 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5db197-08ba-43d1-ac9d-b07e91ac046f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:24.077713 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:24.108041 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac59fc1-ea80-43aa-853c-066b4fb0e9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:24.108878 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac59fc1-ea80-43aa-853c-066b4fb0e9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:24.109158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac59fc1-ea80-43aa-853c-066b4fb0e9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:24.109427 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac59fc1-ea80-43aa-853c-066b4fb0e9a9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:24.120699 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac59fc1-ea80-43aa-853c-066b4fb0e9a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:24.123031 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4bb03-11d6-4d12-93df-a58182859c31 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:24.123328 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4bb03-11d6-4d12-93df-a58182859c31 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:24.123615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4bb03-11d6-4d12-93df-a58182859c31 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:24.125288 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 163/337] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:24.129306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-eac59fc1-ea80-43aa-853c-066b4fb0e9a9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:24.129306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:24.129306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:24.129306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:24.129306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:24.129306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:24.129306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:24.129306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:24.129306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:24.129306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:24.129306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:24.129306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:24.129306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:24.129306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:24.129306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:24.129306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:24.130205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:24.130205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:24.130205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:24.130205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:24.130205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:24.130205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:24.130205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:24.130205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:24.130205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:24.130205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:24.130205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:24.130205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:24.130205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:24.130205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:24.130205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:24.130205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:24.131405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:24.131405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:24.131405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:24.131405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:24.131405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:24.131405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:24.131405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:24.131405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:24.131405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:24.131405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:24.131405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:24.131405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:24.131405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 175/338] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:24.135137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b640b-f3af-43c8-981f-364b77d1026f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:24.135421 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b640b-f3af-43c8-981f-364b77d1026f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:24.138332 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b640b-f3af-43c8-981f-364b77d1026f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:24.147920 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac59fc1-ea80-43aa-853c-066b4fb0e9a9 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:24.171916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-bf2b640b-f3af-43c8-981f-364b77d1026f None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:24.173118 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bf2b640b-f3af-43c8-981f-364b77d1026f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:24.270598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac59fc1-ea80-43aa-853c-066b4fb0e9a9 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:24.311087 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db04e87-ac47-426c-ad00-3bebb67f38a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:24.311799 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db04e87-ac47-426c-ad00-3bebb67f38a9 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:24.312081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db04e87-ac47-426c-ad00-3bebb67f38a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:24.312356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db04e87-ac47-426c-ad00-3bebb67f38a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:24.313105 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db04e87-ac47-426c-ad00-3bebb67f38a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:24.313412 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db04e87-ac47-426c-ad00-3bebb67f38a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:24.314819 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db04e87-ac47-426c-ad00-3bebb67f38a9 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:24.323928 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 176/339] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:16:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:24.324948 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10855e5e-09eb-42f8-9da8-168dfb7df45e None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:24.325257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10855e5e-09eb-42f8-9da8-168dfb7df45e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:24.325610 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10855e5e-09eb-42f8-9da8-168dfb7df45e None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:24.331338 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 177/340] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:24.332754 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10855e5e-09eb-42f8-9da8-168dfb7df45e None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:24.344722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 164/341] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:24.346064 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15904a1f-4dd9-494a-ab3d-7f39377b317a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:24.346349 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15904a1f-4dd9-494a-ab3d-7f39377b317a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:24.346632 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15904a1f-4dd9-494a-ab3d-7f39377b317a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:24.380617 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-15904a1f-4dd9-494a-ab3d-7f39377b317a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:24.381864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-15904a1f-4dd9-494a-ab3d-7f39377b317a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:24.396838 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:24.430234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:24.497427 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 165/342] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:24.498344 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15904a1f-4dd9-494a-ab3d-7f39377b317a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:24.536349 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10855e5e-09eb-42f8-9da8-168dfb7df45e None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:24.602122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb605d-d431-4fdf-8b50-556f5edb3ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:24.602857 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb605d-d431-4fdf-8b50-556f5edb3ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:24.603147 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb605d-d431-4fdf-8b50-556f5edb3ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:24.603525 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffb605d-d431-4fdf-8b50-556f5edb3ff5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:24.612282 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15904a1f-4dd9-494a-ab3d-7f39377b317a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:24.647548 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217dc09-e542-484b-809c-fa1b89c4b426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:24.648360 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217dc09-e542-484b-809c-fa1b89c4b426 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:24.648647 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217dc09-e542-484b-809c-fa1b89c4b426 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:24.648926 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217dc09-e542-484b-809c-fa1b89c4b426 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:24.659582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c217dc09-e542-484b-809c-fa1b89c4b426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:24.667318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-c217dc09-e542-484b-809c-fa1b89c4b426 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:24.667318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:24.667318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:24.667318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:24.667318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:24.667318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:24.667318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:24.667318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:24.667318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:24.667318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:24.667318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:24.667318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:24.667318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:24.667318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:24.667318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:24.667318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:24.668203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:24.668203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:24.668203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:24.668203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:24.668203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:24.668203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:24.668203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:24.668203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:24.668203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:24.668203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:24.668203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:24.668203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:24.668203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:24.668203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:24.668203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:24.668203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:24.669861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:24.669861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:24.669861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:24.669861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:24.669861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:24.669861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:24.669861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:24.669861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:24.669861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:24.669861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:24.669861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:24.669861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:24.669861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 166/343] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:24.669861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217dc09-e542-484b-809c-fa1b89c4b426 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:24.694908 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:24.718296 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb605d-d431-4fdf-8b50-556f5edb3ff5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:24.721309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffb605d-d431-4fdf-8b50-556f5edb3ff5 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:24.771980 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:24.858146 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 178/344] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 02:16:24.859493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb605d-d431-4fdf-8b50-556f5edb3ff5 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:24.862245 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217dc09-e542-484b-809c-fa1b89c4b426 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:24.958462 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc0298-f6ea-4e1a-b382-c74c9c9b6cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:24.959302 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc0298-f6ea-4e1a-b382-c74c9c9b6cfa None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:24.959727 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc0298-f6ea-4e1a-b382-c74c9c9b6cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:24.960009 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc0298-f6ea-4e1a-b382-c74c9c9b6cfa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:24.981345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc0298-f6ea-4e1a-b382-c74c9c9b6cfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:24.996493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffb605d-d431-4fdf-8b50-556f5edb3ff5 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:24.999662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-3ffc0298-f6ea-4e1a-b382-c74c9c9b6cfa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:16:24.999662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:24.999662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:24.999662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:24.999662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:24.999662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:24.999662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:24.999662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:24.999662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:24.999662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:24.999662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:24.999662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:24.999662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:24.999662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:24.999662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:24.999662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:25.001837 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:25.001837 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:25.001837 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:25.001837 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:25.001837 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:25.001837 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:25.001837 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:25.001837 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:25.001837 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:25.001837 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:25.001837 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:25.001837 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:25.001837 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:25.001837 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:25.001837 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:25.001837 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:25.003862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:25.003862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:25.003862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:25.003862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:25.003862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:25.003862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:25.003862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:25.003862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:25.003862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:25.003862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:25.003862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:16:25.003862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:25.005672 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 167/345] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jul 18 02:16:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:25.005864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc0298-f6ea-4e1a-b382-c74c9c9b6cfa None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:25.044176 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:25.052341 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c021ba5-e8e8-4371-8fe7-29721a555e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:25.053019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c021ba5-e8e8-4371-8fe7-29721a555e0c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:25.053302 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c021ba5-e8e8-4371-8fe7-29721a555e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:25.056334 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c021ba5-e8e8-4371-8fe7-29721a555e0c None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:25.056334 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c021ba5-e8e8-4371-8fe7-29721a555e0c None admin] RBAC: Adding query filter params (name=member) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:25.056334 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c021ba5-e8e8-4371-8fe7-29721a555e0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:25.057399 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c021ba5-e8e8-4371-8fe7-29721a555e0c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:25.068071 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 179/346] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:16:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:25.069430 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c021ba5-e8e8-4371-8fe7-29721a555e0c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:25.113995 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:25.147912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc0298-f6ea-4e1a-b382-c74c9c9b6cfa None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:25.187545 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4fbc7-d9cc-4c6d-8a28-29a71854bce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:25.188421 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4fbc7-d9cc-4c6d-8a28-29a71854bce4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:25.188711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4fbc7-d9cc-4c6d-8a28-29a71854bce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:25.188995 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4fbc7-d9cc-4c6d-8a28-29a71854bce4 None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:25.190225 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4fbc7-d9cc-4c6d-8a28-29a71854bce4 None admin] RBAC: Authorizing `identity:get_project(project_id=48537ad736fa4427a5c6de586bc429e5)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:25.190536 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c021ba5-e8e8-4371-8fe7-29721a555e0c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:25.191682 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4fbc7-d9cc-4c6d-8a28-29a71854bce4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:25.193690 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 168/347] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:25 2022] GET /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:25.194928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3dbd2-bdff-46a0-957c-285134789008 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:25.195220 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3dbd2-bdff-46a0-957c-285134789008 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:25.195502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3dbd2-bdff-46a0-957c-285134789008 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:25.196741 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 169/348] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:25.197446 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3dbd2-bdff-46a0-957c-285134789008 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:25.234918 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fff4f-5473-45da-953d-5923a571456e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:25.235603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fff4f-5473-45da-953d-5923a571456e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:25.235885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fff4f-5473-45da-953d-5923a571456e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:25.236165 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fff4f-5473-45da-953d-5923a571456e None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:25.236918 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7fff4f-5473-45da-953d-5923a571456e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:25.237224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7fff4f-5473-45da-953d-5923a571456e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:25.238814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7fff4f-5473-45da-953d-5923a571456e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:25.249344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 180/349] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:16:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:25.250920 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b1085-5f48-4fe0-b4e4-07bff93e2060 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:25.251212 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b1085-5f48-4fe0-b4e4-07bff93e2060 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:25.251492 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41b1085-5f48-4fe0-b4e4-07bff93e2060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:25.274041 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a41b1085-5f48-4fe0-b4e4-07bff93e2060 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:25.275396 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a41b1085-5f48-4fe0-b4e4-07bff93e2060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:25.324939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3dbd2-bdff-46a0-957c-285134789008 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:25.349245 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:25.363695 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 181/350] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:25.365397 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b1085-5f48-4fe0-b4e4-07bff93e2060 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:25.370858 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e3033-f93b-43ae-80cc-2a19eef58a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:25.371528 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e3033-f93b-43ae-80cc-2a19eef58a0d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:25.371817 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e3033-f93b-43ae-80cc-2a19eef58a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:25.372102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e3033-f93b-43ae-80cc-2a19eef58a0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:25.397733 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:25.457251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e3033-f93b-43ae-80cc-2a19eef58a0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:25.458935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e3033-f93b-43ae-80cc-2a19eef58a0d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:25.478211 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41b1085-5f48-4fe0-b4e4-07bff93e2060 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:25.515253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe9d23-8233-4c6b-84b7-3a4155eee110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:25.516182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe9d23-8233-4c6b-84b7-3a4155eee110 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:25.516474 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe9d23-8233-4c6b-84b7-3a4155eee110 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:25.516750 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfe9d23-8233-4c6b-84b7-3a4155eee110 None admin] PATH_INFO: `/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:25.524854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe9d23-8233-4c6b-84b7-3a4155eee110 None admin] RBAC: Authorizing `identity:get_group(group_id=ce391b9b9a9d4518bdd5ed7546d91929)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:25.526667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfe9d23-8233-4c6b-84b7-3a4155eee110 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:25.528782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 182/351] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jul 18 02:16:25 2022] GET /identity/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:25.529795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe9d23-8233-4c6b-84b7-3a4155eee110 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:25.571707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 170/352] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:25.572609 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e3033-f93b-43ae-80cc-2a19eef58a0d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:25.587483 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:25.641380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:25.651083 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfe9d23-8233-4c6b-84b7-3a4155eee110 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:25.697396 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f92c5c-7a3e-4c9a-803f-b5bda0fe1c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:25.698088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f92c5c-7a3e-4c9a-803f-b5bda0fe1c3f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:25.699047 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f92c5c-7a3e-4c9a-803f-b5bda0fe1c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:25.699047 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f92c5c-7a3e-4c9a-803f-b5bda0fe1c3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:25.705276 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e3033-f93b-43ae-80cc-2a19eef58a0d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:25.749655 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a635f32-e7f1-4cd1-a929-ccfb821287d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:25.750487 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a635f32-e7f1-4cd1-a929-ccfb821287d0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:25.750768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a635f32-e7f1-4cd1-a929-ccfb821287d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:25.751040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a635f32-e7f1-4cd1-a929-ccfb821287d0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:25.763702 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a635f32-e7f1-4cd1-a929-ccfb821287d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:25.772461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-4a635f32-e7f1-4cd1-a929-ccfb821287d0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 02:16:25.772461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:25.772461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:25.772461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:25.772461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:25.772461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:25.772461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:25.772461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:25.772461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:25.772461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:25.772461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:25.772461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:25.772461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:25.772461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:25.772461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:25.772461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:25.773376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:25.773376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:25.773376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:25.773376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:25.773376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:25.773376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:25.773376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:25.773376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:25.773376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:25.773376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:25.773376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:25.773376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:25.773376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:25.773376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:25.773376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:25.773376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:25.774234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:25.774234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:25.774234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:25.774234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:25.774234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:25.774234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:25.774234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:25.774234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:25.774234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:25.774234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:25.774234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 02:16:25.774234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:25.774234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 171/353] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:25.775613 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c880f0-3f8c-4939-ba8f-2d03c10b3858 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:25.775613 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c880f0-3f8c-4939-ba8f-2d03c10b3858 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:25.775613 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c880f0-3f8c-4939-ba8f-2d03c10b3858 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:25.777015 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 172/354] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:25.777582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c880f0-3f8c-4939-ba8f-2d03c10b3858 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:25.790388 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f92c5c-7a3e-4c9a-803f-b5bda0fe1c3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:25.792412 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f92c5c-7a3e-4c9a-803f-b5bda0fe1c3f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:25.861588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:25.904073 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c880f0-3f8c-4939-ba8f-2d03c10b3858 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:25.916577 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:25.935150 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 183/355] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:25.937381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f92c5c-7a3e-4c9a-803f-b5bda0fe1c3f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:25.954084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bce3f-bc19-421c-8fc7-49b68b24e4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:25.954759 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bce3f-bc19-421c-8fc7-49b68b24e4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:25.955043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bce3f-bc19-421c-8fc7-49b68b24e4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:25.955319 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bce3f-bc19-421c-8fc7-49b68b24e4e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:25.956153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bce3f-bc19-421c-8fc7-49b68b24e4e5 None admin] RBAC: Adding query filter params (group.id=ce391b9b9a9d4518bdd5ed7546d91929, role.id=7db255e54afa4cecac2d6c93da70795e, scope.project.id=48537ad736fa4427a5c6de586bc429e5) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:25.956463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bce3f-bc19-421c-8fc7-49b68b24e4e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:25.957946 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3bce3f-bc19-421c-8fc7-49b68b24e4e5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:25.964865 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 173/356] 10.222.0.64 () {56 vars in 1376 bytes} [Mon Jul 18 02:16:25 2022] GET /identity/v3/role_assignments?group.id=ce391b9b9a9d4518bdd5ed7546d91929&scope.project.id=48537ad736fa4427a5c6de586bc429e5&role.id=7db255e54afa4cecac2d6c93da70795e => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:25.966933 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bce3f-bc19-421c-8fc7-49b68b24e4e5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:26.070013 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f92c5c-7a3e-4c9a-803f-b5bda0fe1c3f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:26.111647 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4919be4f-f225-4146-9db2-1a4e883339d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:26.112534 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919be4f-f225-4146-9db2-1a4e883339d4 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:26.112822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919be4f-f225-4146-9db2-1a4e883339d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:26.113103 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4919be4f-f225-4146-9db2-1a4e883339d4 None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:26.114859 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919be4f-f225-4146-9db2-1a4e883339d4 None admin] RBAC: Authorizing `identity:get_project(project_id=1cca069e1cb44ca6baae94c18f1eb534)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:26.116344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4919be4f-f225-4146-9db2-1a4e883339d4 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:26.118865 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 184/357] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:25 2022] GET /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:26.120155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795da8e-5171-4ebb-b4a6-a31b9a2a57b1 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:26.120447 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795da8e-5171-4ebb-b4a6-a31b9a2a57b1 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:26.120733 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d795da8e-5171-4ebb-b4a6-a31b9a2a57b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:26.128670 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bce3f-bc19-421c-8fc7-49b68b24e4e5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:26.148854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-d795da8e-5171-4ebb-b4a6-a31b9a2a57b1 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:26.150185 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d795da8e-5171-4ebb-b4a6-a31b9a2a57b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:26.172402 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:26.180523 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4485ab-ab5d-4cff-8872-f7bb6772354b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:26.181216 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4485ab-ab5d-4cff-8872-f7bb6772354b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:26.181519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4485ab-ab5d-4cff-8872-f7bb6772354b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:26.184804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4485ab-ab5d-4cff-8872-f7bb6772354b None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:26.184804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4485ab-ab5d-4cff-8872-f7bb6772354b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:26.184804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4485ab-ab5d-4cff-8872-f7bb6772354b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:26.184804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4485ab-ab5d-4cff-8872-f7bb6772354b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:26.194500 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 174/358] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:16:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:26.195360 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4485ab-ab5d-4cff-8872-f7bb6772354b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:26.237406 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:26.241507 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 185/359] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:26.242794 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61336068-31f3-4f14-9663-241602517c93 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:26.243949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61336068-31f3-4f14-9663-241602517c93 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:26.243949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61336068-31f3-4f14-9663-241602517c93 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:26.244570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 186/360] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:26.245321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61336068-31f3-4f14-9663-241602517c93 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:26.328029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4485ab-ab5d-4cff-8872-f7bb6772354b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:26.376647 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61336068-31f3-4f14-9663-241602517c93 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:26.380702 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c051a32-203a-4665-a171-0db570a52b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:26.381879 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c051a32-203a-4665-a171-0db570a52b0c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:26.382387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c051a32-203a-4665-a171-0db570a52b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:26.382883 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c051a32-203a-4665-a171-0db570a52b0c None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:26.384319 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c051a32-203a-4665-a171-0db570a52b0c None admin] RBAC: Authorizing `identity:get_project(project_id=48537ad736fa4427a5c6de586bc429e5)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:26.386082 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c051a32-203a-4665-a171-0db570a52b0c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:26.388139 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 175/361] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:26 2022] GET /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:26.393923 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c051a32-203a-4665-a171-0db570a52b0c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:26.419831 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd75d0-7a5d-4999-9282-d632cf23b8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:26.421090 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd75d0-7a5d-4999-9282-d632cf23b8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:26.421589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd75d0-7a5d-4999-9282-d632cf23b8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:26.422733 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd75d0-7a5d-4999-9282-d632cf23b8b9 None admin] PATH_INFO: `/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:26.424440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd75d0-7a5d-4999-9282-d632cf23b8b9 None admin] RBAC: Authorizing `identity:get_group(group_id=ce391b9b9a9d4518bdd5ed7546d91929)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:26.427130 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd75d0-7a5d-4999-9282-d632cf23b8b9 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:26.429540 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 187/362] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jul 18 02:16:26 2022] GET /identity/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:26.430926 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d447c2-116f-49ee-8cc6-4509dcd7d11c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:26.431212 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d447c2-116f-49ee-8cc6-4509dcd7d11c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:26.431494 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d447c2-116f-49ee-8cc6-4509dcd7d11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:26.449673 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-39d447c2-116f-49ee-8cc6-4509dcd7d11c None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:26.450922 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-39d447c2-116f-49ee-8cc6-4509dcd7d11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:26.462686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:26.521964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c051a32-203a-4665-a171-0db570a52b0c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:26.524001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:26.540127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 188/363] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:26.541432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d447c2-116f-49ee-8cc6-4509dcd7d11c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:26.581479 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252cf229-217e-47cf-9e24-1be6314b13cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:26.582386 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cf229-217e-47cf-9e24-1be6314b13cd None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:26.582667 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cf229-217e-47cf-9e24-1be6314b13cd None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:26.582939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252cf229-217e-47cf-9e24-1be6314b13cd None admin] PATH_INFO: `/v3/users/8aebafd7acec4322ba9bdfe491b2dcde` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:26.584653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252cf229-217e-47cf-9e24-1be6314b13cd None admin] RBAC: Authorizing `identity:get_user(user_id=8aebafd7acec4322ba9bdfe491b2dcde)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:26.586541 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252cf229-217e-47cf-9e24-1be6314b13cd None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:26.587864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 176/364] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:16:26 2022] GET /identity/v3/users/8aebafd7acec4322ba9bdfe491b2dcde => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:26.588476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252cf229-217e-47cf-9e24-1be6314b13cd None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:26.680105 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d447c2-116f-49ee-8cc6-4509dcd7d11c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:26.718551 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252cf229-217e-47cf-9e24-1be6314b13cd None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:26.723916 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041a2a2-3391-4a38-a497-5f51b54ccb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:26.725578 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041a2a2-3391-4a38-a497-5f51b54ccb7b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:26.726197 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041a2a2-3391-4a38-a497-5f51b54ccb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:26.726694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041a2a2-3391-4a38-a497-5f51b54ccb7b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:26.740511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041a2a2-3391-4a38-a497-5f51b54ccb7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:26.749593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-c041a2a2-3391-4a38-a497-5f51b54ccb7b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:16:26.749593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:26.749593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:26.749593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:26.749593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:26.749593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:26.749593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:26.749593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:26.749593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:26.749593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:26.749593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:26.749593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:26.749593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:26.749593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:26.749593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:26.749593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:26.750551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:26.750551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:26.750551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:26.750551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:26.750551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:26.750551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:26.750551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:26.750551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:26.750551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:26.750551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:26.750551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:26.750551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:26.750551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:26.750551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:26.750551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:26.750551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:26.751366 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:26.751366 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:26.751366 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:26.751366 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:26.751366 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:26.751366 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:26.751366 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:26.751366 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:26.751366 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:26.751366 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:26.751366 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:16:26.751366 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:26.751366 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 189/365] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jul 18 02:16:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:26.752022 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041a2a2-3391-4a38-a497-5f51b54ccb7b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:26.769752 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:26.772061 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b68cc6-1cf7-4e8a-8a3f-3e025cbc8d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:26.772937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b68cc6-1cf7-4e8a-8a3f-3e025cbc8d01 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:26.773298 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b68cc6-1cf7-4e8a-8a3f-3e025cbc8d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:26.773573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b68cc6-1cf7-4e8a-8a3f-3e025cbc8d01 None admin] PATH_INFO: `/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:26.774777 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b68cc6-1cf7-4e8a-8a3f-3e025cbc8d01 None admin] RBAC: Authorizing `identity:get_group(group_id=ce391b9b9a9d4518bdd5ed7546d91929)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:26.776582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b68cc6-1cf7-4e8a-8a3f-3e025cbc8d01 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:26.778302 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 177/366] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jul 18 02:16:26 2022] GET /identity/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:26.787293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b68cc6-1cf7-4e8a-8a3f-3e025cbc8d01 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:26.831926 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:26.888942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041a2a2-3391-4a38-a497-5f51b54ccb7b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:26.906481 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b68cc6-1cf7-4e8a-8a3f-3e025cbc8d01 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:26.936732 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c1682-255e-4150-b1bd-11733f51d984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:26.937327 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c1682-255e-4150-b1bd-11733f51d984 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:26.937606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c1682-255e-4150-b1bd-11733f51d984 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:26.937931 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c1682-255e-4150-b1bd-11733f51d984 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:26.938762 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c1682-255e-4150-b1bd-11733f51d984 None admin] RBAC: Adding query filter params (group.id=ce391b9b9a9d4518bdd5ed7546d91929, role.id=7db255e54afa4cecac2d6c93da70795e, scope.project.id=1cca069e1cb44ca6baae94c18f1eb534) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:26.939075 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c1682-255e-4150-b1bd-11733f51d984 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:26.940520 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c1682-255e-4150-b1bd-11733f51d984 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:26.945645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7f3ac-24ea-4548-8c96-b619ac39a093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:26.946522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7f3ac-24ea-4548-8c96-b619ac39a093 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:26.946802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7f3ac-24ea-4548-8c96-b619ac39a093 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:26.946961 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 190/367] 10.222.0.64 () {56 vars in 1376 bytes} [Mon Jul 18 02:16:26 2022] GET /identity/v3/role_assignments?group.id=ce391b9b9a9d4518bdd5ed7546d91929&scope.project.id=1cca069e1cb44ca6baae94c18f1eb534&role.id=7db255e54afa4cecac2d6c93da70795e => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:26.947360 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7f3ac-24ea-4548-8c96-b619ac39a093 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:26.947728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c1682-255e-4150-b1bd-11733f51d984 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:26.975560 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7f3ac-24ea-4548-8c96-b619ac39a093 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:26.987198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-7ad7f3ac-24ea-4548-8c96-b619ac39a093 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:16:26.987198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:26.987198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:26.987198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:26.987198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:26.987198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:26.987198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:26.987198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:26.987198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:26.987198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:26.987198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:26.987198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:26.987198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:26.987198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:26.987198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:26.987198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:26.988151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:26.988151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:26.988151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:26.988151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:26.988151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:26.988151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:26.988151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:26.988151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:26.988151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:26.988151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:26.988151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:26.988151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:26.988151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:26.988151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:26.988151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:26.988151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:26.989384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:26.989384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:26.989384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:26.989384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:26.989384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:26.989384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:26.989384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:26.989384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:26.989384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:26.989384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:26.989384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:16:26.989384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:26.989384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 178/368] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:16:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:26.990243 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7f3ac-24ea-4548-8c96-b619ac39a093 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:27.045915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:27.083663 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c1682-255e-4150-b1bd-11733f51d984 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:27.127168 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a12d0-866a-4f44-b11a-2d63cd250601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:27.127859 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a12d0-866a-4f44-b11a-2d63cd250601 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:27.128144 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a12d0-866a-4f44-b11a-2d63cd250601 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:27.128427 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a12d0-866a-4f44-b11a-2d63cd250601 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:27.130199 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a12d0-866a-4f44-b11a-2d63cd250601 None admin] RBAC: Adding query filter params (role.id=428c7cbed69f4893a907b0f69ab8eb98, user.id=8aebafd7acec4322ba9bdfe491b2dcde, scope.system=all) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:27.130199 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a12d0-866a-4f44-b11a-2d63cd250601 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:27.132923 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:27.133070 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a12d0-866a-4f44-b11a-2d63cd250601 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:27.144746 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7f3ac-24ea-4548-8c96-b619ac39a093 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:27.155822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 191/369] 10.222.0.64 () {56 vars in 1308 bytes} [Mon Jul 18 02:16:26 2022] GET /identity/v3/role_assignments?user.id=8aebafd7acec4322ba9bdfe491b2dcde&scope.system=all&role.id=428c7cbed69f4893a907b0f69ab8eb98 => generated 510 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:27.156712 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a12d0-866a-4f44-b11a-2d63cd250601 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:27.247178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f031d-b8a0-4dbb-865c-fb7e8925555f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:27.247821 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f031d-b8a0-4dbb-865c-fb7e8925555f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:27.248110 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f031d-b8a0-4dbb-865c-fb7e8925555f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:27.248392 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f031d-b8a0-4dbb-865c-fb7e8925555f None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:27.249747 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f031d-b8a0-4dbb-865c-fb7e8925555f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:27.254187 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f031d-b8a0-4dbb-865c-fb7e8925555f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:27.255648 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f031d-b8a0-4dbb-865c-fb7e8925555f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:27.279810 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 179/370] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:16:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:27.279810 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f031d-b8a0-4dbb-865c-fb7e8925555f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:27.294243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a12d0-866a-4f44-b11a-2d63cd250601 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:27.332271 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:27.347667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b5953-b629-40c5-9850-9ff544fbac32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:27.348374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b5953-b629-40c5-9850-9ff544fbac32 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:27.348656 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b5953-b629-40c5-9850-9ff544fbac32 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:27.348933 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63b5953-b629-40c5-9850-9ff544fbac32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:27.349798 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b5953-b629-40c5-9850-9ff544fbac32 None admin] RBAC: Adding query filter params (group.id=ce391b9b9a9d4518bdd5ed7546d91929, role.id=aa317d762bd64a9d864e54d074507f94, scope.project.id=48537ad736fa4427a5c6de586bc429e5) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:27.350112 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b5953-b629-40c5-9850-9ff544fbac32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:27.351558 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63b5953-b629-40c5-9850-9ff544fbac32 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:27.359855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 192/371] 10.222.0.64 () {56 vars in 1376 bytes} [Mon Jul 18 02:16:27 2022] GET /identity/v3/role_assignments?group.id=ce391b9b9a9d4518bdd5ed7546d91929&scope.project.id=48537ad736fa4427a5c6de586bc429e5&role.id=aa317d762bd64a9d864e54d074507f94 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:27.360717 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b5953-b629-40c5-9850-9ff544fbac32 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:27.493279 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f031d-b8a0-4dbb-865c-fb7e8925555f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:27.567444 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63b5953-b629-40c5-9850-9ff544fbac32 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:27.572298 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18dd33-f678-4f95-827d-86c294fc4acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:27.573289 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18dd33-f678-4f95-827d-86c294fc4acb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:27.573925 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18dd33-f678-4f95-827d-86c294fc4acb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:27.574208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18dd33-f678-4f95-827d-86c294fc4acb None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:27.574997 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18dd33-f678-4f95-827d-86c294fc4acb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:27.575307 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18dd33-f678-4f95-827d-86c294fc4acb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:27.576941 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18dd33-f678-4f95-827d-86c294fc4acb None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:27.597218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 180/372] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:27.603304 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18dd33-f678-4f95-827d-86c294fc4acb None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:27.617758 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500cfbd-6a83-4b4c-ab87-f59cd337b923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:27.618443 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500cfbd-6a83-4b4c-ab87-f59cd337b923 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:27.618788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500cfbd-6a83-4b4c-ab87-f59cd337b923 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:27.619071 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500cfbd-6a83-4b4c-ab87-f59cd337b923 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:27.648349 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:27.706889 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:27.718830 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500cfbd-6a83-4b4c-ab87-f59cd337b923 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:27.720556 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500cfbd-6a83-4b4c-ab87-f59cd337b923 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:27.765967 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18dd33-f678-4f95-827d-86c294fc4acb None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:27.813487 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c01955-9621-43a9-8dca-027610581e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:27.814181 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c01955-9621-43a9-8dca-027610581e7e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:27.814768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c01955-9621-43a9-8dca-027610581e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:27.815055 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c01955-9621-43a9-8dca-027610581e7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:27.837322 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 193/373] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:27.843059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500cfbd-6a83-4b4c-ab87-f59cd337b923 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:27.923149 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c01955-9621-43a9-8dca-027610581e7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:27.925301 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c01955-9621-43a9-8dca-027610581e7e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:27.957638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:27.959574 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:27.968498 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500cfbd-6a83-4b4c-ab87-f59cd337b923 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:28.009470 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2234adb-e08b-41c4-a82f-3f6c43fb3e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:28.010440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2234adb-e08b-41c4-a82f-3f6c43fb3e30 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:28.010726 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2234adb-e08b-41c4-a82f-3f6c43fb3e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:28.011000 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2234adb-e08b-41c4-a82f-3f6c43fb3e30 None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:28.012207 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2234adb-e08b-41c4-a82f-3f6c43fb3e30 None admin] RBAC: Authorizing `identity:get_project(project_id=1cca069e1cb44ca6baae94c18f1eb534)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:28.013666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2234adb-e08b-41c4-a82f-3f6c43fb3e30 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:28.015972 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 194/374] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:27 2022] GET /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:28.025968 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2234adb-e08b-41c4-a82f-3f6c43fb3e30 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:28.078755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 181/375] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 02:16:28.084058 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c01955-9621-43a9-8dca-027610581e7e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:28.219049 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c01955-9621-43a9-8dca-027610581e7e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:28.231662 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2234adb-e08b-41c4-a82f-3f6c43fb3e30 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:28.250336 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:28.265411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600df0d-9c81-4598-9de9-1b3914edaead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:28.266387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600df0d-9c81-4598-9de9-1b3914edaead None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:28.271808 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600df0d-9c81-4598-9de9-1b3914edaead None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:28.271808 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600df0d-9c81-4598-9de9-1b3914edaead None admin] PATH_INFO: `/v3/projects/588ca26de9454c75b0a1f50762b8b0a2` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:28.271808 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600df0d-9c81-4598-9de9-1b3914edaead None admin] RBAC: Authorizing `identity:get_project(project_id=588ca26de9454c75b0a1f50762b8b0a2)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:28.271808 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600df0d-9c81-4598-9de9-1b3914edaead None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:28.272404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 182/376] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:28 2022] GET /identity/v3/projects/588ca26de9454c75b0a1f50762b8b0a2 => generated 344 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:28.280471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600df0d-9c81-4598-9de9-1b3914edaead None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:28.305399 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ab969-94df-47be-8792-84c5f892498f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:28.306311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ab969-94df-47be-8792-84c5f892498f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:28.306590 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ab969-94df-47be-8792-84c5f892498f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:28.306862 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ab969-94df-47be-8792-84c5f892498f None admin] PATH_INFO: `/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:28.308760 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ab969-94df-47be-8792-84c5f892498f None admin] RBAC: Authorizing `identity:get_group(group_id=ce391b9b9a9d4518bdd5ed7546d91929)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:28.310246 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ab969-94df-47be-8792-84c5f892498f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:28.312181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 195/377] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jul 18 02:16:28 2022] GET /identity/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929 => generated 226 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:28.313356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522611e-675f-439c-aa21-f7a05f1edf04 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:28.316999 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522611e-675f-439c-aa21-f7a05f1edf04 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:28.316999 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522611e-675f-439c-aa21-f7a05f1edf04 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:28.316999 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 196/378] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:28.324377 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd86f5-52d9-43d7-8abf-9f4dd28b5101 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:28.324672 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd86f5-52d9-43d7-8abf-9f4dd28b5101 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:28.324950 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd86f5-52d9-43d7-8abf-9f4dd28b5101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:28.346470 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-e1dd86f5-52d9-43d7-8abf-9f4dd28b5101 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:28.348154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e1dd86f5-52d9-43d7-8abf-9f4dd28b5101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:28.380037 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:28.428032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600df0d-9c81-4598-9de9-1b3914edaead None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:28.433154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 197/379] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:28.434306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd86f5-52d9-43d7-8abf-9f4dd28b5101 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:28.471624 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8ee2e-a8af-4f48-85e4-b6e9690fc62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:28.472757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8ee2e-a8af-4f48-85e4-b6e9690fc62c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:28.473042 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8ee2e-a8af-4f48-85e4-b6e9690fc62c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:28.473324 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8ee2e-a8af-4f48-85e4-b6e9690fc62c None admin] PATH_INFO: `/v3/groups/39ce060ac5d84cf9a7cf0d8606195d06` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:28.481102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8ee2e-a8af-4f48-85e4-b6e9690fc62c None admin] RBAC: Authorizing `identity:get_group(group_id=39ce060ac5d84cf9a7cf0d8606195d06)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:28.482997 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8ee2e-a8af-4f48-85e4-b6e9690fc62c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:28.485434 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 183/380] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jul 18 02:16:28 2022] GET /identity/v3/groups/39ce060ac5d84cf9a7cf0d8606195d06 => generated 229 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:28.492786 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8ee2e-a8af-4f48-85e4-b6e9690fc62c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:28.563876 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:28.565863 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd86f5-52d9-43d7-8abf-9f4dd28b5101 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:28.603770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e42a9-099a-4b1e-926e-848efe5c56db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:28.604437 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e42a9-099a-4b1e-926e-848efe5c56db None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:28.604718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e42a9-099a-4b1e-926e-848efe5c56db None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:28.604996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e42a9-099a-4b1e-926e-848efe5c56db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:28.606973 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e42a9-099a-4b1e-926e-848efe5c56db None admin] RBAC: Adding query filter params (group.id=ce391b9b9a9d4518bdd5ed7546d91929, role.id=aa317d762bd64a9d864e54d074507f94, scope.project.id=1cca069e1cb44ca6baae94c18f1eb534) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:28.607132 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e42a9-099a-4b1e-926e-848efe5c56db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:28.608650 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e42a9-099a-4b1e-926e-848efe5c56db None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:28.615251 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 198/381] 10.222.0.64 () {56 vars in 1376 bytes} [Mon Jul 18 02:16:28 2022] GET /identity/v3/role_assignments?group.id=ce391b9b9a9d4518bdd5ed7546d91929&scope.project.id=1cca069e1cb44ca6baae94c18f1eb534&role.id=aa317d762bd64a9d864e54d074507f94 => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:28.616094 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e42a9-099a-4b1e-926e-848efe5c56db None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:28.622439 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8ee2e-a8af-4f48-85e4-b6e9690fc62c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:28.642589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:28.677245 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c991ab-fa8b-48ca-8bab-38df1a66319e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:28.678150 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c991ab-fa8b-48ca-8bab-38df1a66319e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:28.678374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c991ab-fa8b-48ca-8bab-38df1a66319e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:28.678653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c991ab-fa8b-48ca-8bab-38df1a66319e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:28.704311 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c991ab-fa8b-48ca-8bab-38df1a66319e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:28.715539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-45c991ab-fa8b-48ca-8bab-38df1a66319e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:28.715539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:28.715539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:28.715539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:28.715539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:28.715539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:28.715539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:28.715539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:28.715539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:28.715539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:28.715539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:28.715539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:28.715539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:28.715539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:28.715539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:28.715539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:28.716538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:28.716538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:28.716538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:28.716538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:28.716538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:28.716538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:28.716538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:28.716538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:28.716538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:28.716538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:28.716538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:28.716538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:28.716538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:28.716538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:28.716538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:28.716538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:28.718431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:28.718431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:28.718431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:28.718431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:28.718431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:28.718431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:28.718431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:28.718431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:28.718431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:28.718431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:28.718431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:28.718431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:28.718431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 184/382] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:28.734963 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c991ab-fa8b-48ca-8bab-38df1a66319e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:28.794184 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e42a9-099a-4b1e-926e-848efe5c56db None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:28.869962 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f6d54-2d2c-44d0-a2f7-95beaa8b3ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:28.870645 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f6d54-2d2c-44d0-a2f7-95beaa8b3ba6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:28.870932 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f6d54-2d2c-44d0-a2f7-95beaa8b3ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:28.871213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f6d54-2d2c-44d0-a2f7-95beaa8b3ba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:28.872058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f6d54-2d2c-44d0-a2f7-95beaa8b3ba6 None admin] RBAC: Adding query filter params (group.id=39ce060ac5d84cf9a7cf0d8606195d06, role.id=5dfa34e7a4594751aed7c0495c9a2383, scope.project.id=588ca26de9454c75b0a1f50762b8b0a2) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:28.872376 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f6d54-2d2c-44d0-a2f7-95beaa8b3ba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:28.873932 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f6d54-2d2c-44d0-a2f7-95beaa8b3ba6 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:28.885315 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 199/383] 10.222.0.64 () {56 vars in 1376 bytes} [Mon Jul 18 02:16:28 2022] GET /identity/v3/role_assignments?group.id=39ce060ac5d84cf9a7cf0d8606195d06&scope.project.id=588ca26de9454c75b0a1f50762b8b0a2&role.id=5dfa34e7a4594751aed7c0495c9a2383 => generated 260 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:28.903459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c991ab-fa8b-48ca-8bab-38df1a66319e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:28.921383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:28.947774 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9eaa4-27f5-4ed6-a3a3-be7df9524000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:28.948375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9eaa4-27f5-4ed6-a3a3-be7df9524000 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:28.948665 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9eaa4-27f5-4ed6-a3a3-be7df9524000 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:28.948949 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9eaa4-27f5-4ed6-a3a3-be7df9524000 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:28.949734 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9eaa4-27f5-4ed6-a3a3-be7df9524000 None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:28.950053 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9eaa4-27f5-4ed6-a3a3-be7df9524000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:28.951453 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e9eaa4-27f5-4ed6-a3a3-be7df9524000 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:28.966570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 185/384] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:16:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:28.973034 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f6d54-2d2c-44d0-a2f7-95beaa8b3ba6 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:29.100833 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:29.116696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f6d54-2d2c-44d0-a2f7-95beaa8b3ba6 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:29.156451 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccd026-a7a3-4125-a69f-08b13dec3fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:29.157381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccd026-a7a3-4125-a69f-08b13dec3fdc None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:29.157744 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccd026-a7a3-4125-a69f-08b13dec3fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:29.158032 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccd026-a7a3-4125-a69f-08b13dec3fdc None admin] PATH_INFO: `/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:29.159252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ccd026-a7a3-4125-a69f-08b13dec3fdc None admin] RBAC: Authorizing `identity:get_group(group_id=ce391b9b9a9d4518bdd5ed7546d91929)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:29.160732 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ccd026-a7a3-4125-a69f-08b13dec3fdc None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:29.162766 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 200/385] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jul 18 02:16:28 2022] GET /identity/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:29.168340 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9eaa4-27f5-4ed6-a3a3-be7df9524000 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:29.301292 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e9eaa4-27f5-4ed6-a3a3-be7df9524000 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:29.340757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012c822-01b7-4b87-a240-40b0f2e40363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:29.341627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012c822-01b7-4b87-a240-40b0f2e40363 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:29.341966 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012c822-01b7-4b87-a240-40b0f2e40363 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:29.342265 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012c822-01b7-4b87-a240-40b0f2e40363 None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:29.344052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012c822-01b7-4b87-a240-40b0f2e40363 None admin] RBAC: Authorizing `identity:get_project(project_id=48537ad736fa4427a5c6de586bc429e5)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:29.345511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a012c822-01b7-4b87-a240-40b0f2e40363 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:29.347554 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 186/386] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:29 2022] GET /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:29.353579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccd026-a7a3-4125-a69f-08b13dec3fdc None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:29.473075 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccd026-a7a3-4125-a69f-08b13dec3fdc None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:29.517839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d48c88-c6a3-4ecd-b88c-632918be55f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:29.518749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d48c88-c6a3-4ecd-b88c-632918be55f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:29.519042 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d48c88-c6a3-4ecd-b88c-632918be55f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:29.519319 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d48c88-c6a3-4ecd-b88c-632918be55f1 None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5/groups/ce391b9b9a9d4518bdd5ed7546d91929/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:29.521334 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d48c88-c6a3-4ecd-b88c-632918be55f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=48537ad736fa4427a5c6de586bc429e5, group_id=ce391b9b9a9d4518bdd5ed7546d91929, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:29.522837 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d48c88-c6a3-4ecd-b88c-632918be55f1 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:29.628033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386093f-ae84-405c-bd50-2d40f12ab36e None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:29.628371 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386093f-ae84-405c-bd50-2d40f12ab36e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:29.628589 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386093f-ae84-405c-bd50-2d40f12ab36e None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:29.630316 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 187/387] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:29.635396 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd90e8-9bc6-4eb5-862d-5f5cc02d4f70 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:29.635802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd90e8-9bc6-4eb5-862d-5f5cc02d4f70 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:29.636191 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd90e8-9bc6-4eb5-862d-5f5cc02d4f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:29.654380 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 201/388] 10.222.0.64 () {58 vars in 1442 bytes} [Mon Jul 18 02:16:29 2022] PUT /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5/groups/ce391b9b9a9d4518bdd5ed7546d91929/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:16:29.665231 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-76cd90e8-9bc6-4eb5-862d-5f5cc02d4f70 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:29.666553 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-76cd90e8-9bc6-4eb5-862d-5f5cc02d4f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:29.724572 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:29.759409 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 188/389] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:29.795360 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d48c88-c6a3-4ecd-b88c-632918be55f1 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:29.813358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:29.912657 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d48c88-c6a3-4ecd-b88c-632918be55f1 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:29.946852 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcc5a1f-8752-415f-831c-6c89c8466b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:29.947994 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc5a1f-8752-415f-831c-6c89c8466b6c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:29.948491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc5a1f-8752-415f-831c-6c89c8466b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:29.948972 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcc5a1f-8752-415f-831c-6c89c8466b6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:29.960457 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcc5a1f-8752-415f-831c-6c89c8466b6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:29.969346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-6dcc5a1f-8752-415f-831c-6c89c8466b6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:29.969346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:29.969346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:29.969346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:29.969346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:29.969346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:29.969346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:29.969346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:29.969346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:29.969346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:29.969346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:29.969346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:29.969346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:29.969346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:29.969346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:29.969346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:29.970249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:29.970249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:29.970249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:29.970249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:29.970249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:29.970249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:29.970249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:29.970249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:29.970249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:29.970249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:29.970249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:29.970249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:29.970249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:29.970249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:29.970249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:29.970249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:29.971026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:29.971026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:29.971026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:29.971026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:29.971026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:29.971026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:29.971026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:29.971026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:29.971026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:29.971026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:29.971026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:29.971026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:29.974861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 202/390] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:29.981418 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd90e8-9bc6-4eb5-862d-5f5cc02d4f70 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:30.096385 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eec72-dcc5-4fda-9332-b421cda40b24 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:30.096750 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eec72-dcc5-4fda-9332-b421cda40b24 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:30.096939 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eec72-dcc5-4fda-9332-b421cda40b24 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:30.098798 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 203/391] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:30.108736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ade0a8-09ec-4bc8-8f2d-07e3c950a06a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:30.109155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ade0a8-09ec-4bc8-8f2d-07e3c950a06a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:30.109440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ade0a8-09ec-4bc8-8f2d-07e3c950a06a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:30.111317 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd90e8-9bc6-4eb5-862d-5f5cc02d4f70 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:30.135573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b9ade0a8-09ec-4bc8-8f2d-07e3c950a06a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:30.138180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b9ade0a8-09ec-4bc8-8f2d-07e3c950a06a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:30.180819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c8067-8be2-48df-8c7f-eeb5683c8665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:30.181486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c8067-8be2-48df-8c7f-eeb5683c8665 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:30.181802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c8067-8be2-48df-8c7f-eeb5683c8665 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:30.182087 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c8067-8be2-48df-8c7f-eeb5683c8665 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:30.182842 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c8067-8be2-48df-8c7f-eeb5683c8665 None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:30.183154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c8067-8be2-48df-8c7f-eeb5683c8665 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:30.184528 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c8067-8be2-48df-8c7f-eeb5683c8665 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:30.201803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 189/392] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:16:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:30.206186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c8067-8be2-48df-8c7f-eeb5683c8665 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:30.268809 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 204/393] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:16:30.274436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:30.307928 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ade0a8-09ec-4bc8-8f2d-07e3c950a06a None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:30.311263 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:30.378680 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c8067-8be2-48df-8c7f-eeb5683c8665 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:30.435217 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ade0a8-09ec-4bc8-8f2d-07e3c950a06a None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:30.447352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85379d-5cc7-45d0-a193-5de09cc3824f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:30.448225 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85379d-5cc7-45d0-a193-5de09cc3824f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:30.448505 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85379d-5cc7-45d0-a193-5de09cc3824f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:30.448779 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85379d-5cc7-45d0-a193-5de09cc3824f None admin] PATH_INFO: `/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:30.454406 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85379d-5cc7-45d0-a193-5de09cc3824f None admin] RBAC: Authorizing `identity:get_group(group_id=ce391b9b9a9d4518bdd5ed7546d91929)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:30.455860 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85379d-5cc7-45d0-a193-5de09cc3824f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:30.461725 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 190/394] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jul 18 02:16:30 2022] GET /identity/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929 => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:30.464702 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85379d-5cc7-45d0-a193-5de09cc3824f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:30.484997 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d2df1-e88a-4cf1-82e8-d7169eff2751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:30.486711 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d2df1-e88a-4cf1-82e8-d7169eff2751 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:30.487214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d2df1-e88a-4cf1-82e8-d7169eff2751 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:30.487695 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d2df1-e88a-4cf1-82e8-d7169eff2751 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:30.500108 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d2df1-e88a-4cf1-82e8-d7169eff2751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:30.510346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-873d2df1-e88a-4cf1-82e8-d7169eff2751 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:16:30.510346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:30.510346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:30.510346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:30.510346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:30.510346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:30.510346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:30.510346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:30.510346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:30.510346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:30.510346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:30.510346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:30.510346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:30.510346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:30.510346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:30.510346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:30.511210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:30.511210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:30.511210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:30.511210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:30.511210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:30.511210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:30.511210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:30.511210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:30.511210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:30.511210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:30.511210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:30.511210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:30.511210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:30.511210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:30.511210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:30.511210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:30.512015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:30.512015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:30.512015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:30.512015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:30.512015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:30.512015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:30.512015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:30.512015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:30.512015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:30.512015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:30.512015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:16:30.512015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:30.515034 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 205/395] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jul 18 02:16:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:30.520567 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d2df1-e88a-4cf1-82e8-d7169eff2751 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:30.623662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85379d-5cc7-45d0-a193-5de09cc3824f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:30.626538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:30.662455 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc1926-3e36-4c7c-9a45-df52f65e50c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:30.663820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc1926-3e36-4c7c-9a45-df52f65e50c3 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:30.664315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc1926-3e36-4c7c-9a45-df52f65e50c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:30.664797 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfc1926-3e36-4c7c-9a45-df52f65e50c3 None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:30.666223 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc1926-3e36-4c7c-9a45-df52f65e50c3 None admin] RBAC: Authorizing `identity:get_project(project_id=1cca069e1cb44ca6baae94c18f1eb534)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:30.667887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfc1926-3e36-4c7c-9a45-df52f65e50c3 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:30.674073 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 191/396] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:30 2022] GET /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:30.675318 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:30.677318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc1926-3e36-4c7c-9a45-df52f65e50c3 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:30.746319 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d2df1-e88a-4cf1-82e8-d7169eff2751 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:30.788979 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfc1926-3e36-4c7c-9a45-df52f65e50c3 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:30.796551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82f4e0-c5cc-4c3f-98c6-61c1f5efa999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:30.797240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82f4e0-c5cc-4c3f-98c6-61c1f5efa999 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:30.797522 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82f4e0-c5cc-4c3f-98c6-61c1f5efa999 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:30.797873 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d82f4e0-c5cc-4c3f-98c6-61c1f5efa999 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:30.798624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82f4e0-c5cc-4c3f-98c6-61c1f5efa999 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:30.798930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82f4e0-c5cc-4c3f-98c6-61c1f5efa999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:30.800848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d82f4e0-c5cc-4c3f-98c6-61c1f5efa999 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:30.813199 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 206/397] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:16:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:30.818657 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82f4e0-c5cc-4c3f-98c6-61c1f5efa999 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:30.839576 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52216d86-4c80-4d20-bddf-eac30097990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:30.840845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52216d86-4c80-4d20-bddf-eac30097990d None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:30.841317 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52216d86-4c80-4d20-bddf-eac30097990d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:30.841861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52216d86-4c80-4d20-bddf-eac30097990d None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534/groups/ce391b9b9a9d4518bdd5ed7546d91929/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:30.844136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52216d86-4c80-4d20-bddf-eac30097990d None admin] RBAC: Authorizing `identity:create_grant(project_id=1cca069e1cb44ca6baae94c18f1eb534, group_id=ce391b9b9a9d4518bdd5ed7546d91929, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:30.846338 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52216d86-4c80-4d20-bddf-eac30097990d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:30.940473 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d82f4e0-c5cc-4c3f-98c6-61c1f5efa999 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:30.948510 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 192/398] 10.222.0.64 () {58 vars in 1442 bytes} [Mon Jul 18 02:16:30 2022] PUT /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534/groups/ce391b9b9a9d4518bdd5ed7546d91929/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:16:30.970477 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:30.979848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8400c-07a4-4de3-b5a3-8e642b2e715d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:30.980731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8400c-07a4-4de3-b5a3-8e642b2e715d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:30.981018 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8400c-07a4-4de3-b5a3-8e642b2e715d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:30.981299 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8400c-07a4-4de3-b5a3-8e642b2e715d None admin] PATH_INFO: `/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:30.982581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8400c-07a4-4de3-b5a3-8e642b2e715d None admin] RBAC: Authorizing `identity:get_group(group_id=ce391b9b9a9d4518bdd5ed7546d91929)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:30.984203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8400c-07a4-4de3-b5a3-8e642b2e715d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:30.986212 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 207/399] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jul 18 02:16:30 2022] GET /identity/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:30.997908 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52216d86-4c80-4d20-bddf-eac30097990d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:31.097897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:31.240849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c0bbd-1a1b-4f93-bc0d-f7234e2f132d None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:31.241240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c0bbd-1a1b-4f93-bc0d-f7234e2f132d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:31.241599 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c0bbd-1a1b-4f93-bc0d-f7234e2f132d None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:31.243339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 208/400] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:31.248817 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9dfd1-ec05-4188-b5ea-26e655650bf3 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:31.249143 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9dfd1-ec05-4188-b5ea-26e655650bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:31.249531 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a9dfd1-ec05-4188-b5ea-26e655650bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:31.250462 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52216d86-4c80-4d20-bddf-eac30097990d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:31.299975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-e7a9dfd1-ec05-4188-b5ea-26e655650bf3 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:31.301207 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e7a9dfd1-ec05-4188-b5ea-26e655650bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:31.347416 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea02923-0ce3-41cf-b925-731c4de6865d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:31.348290 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea02923-0ce3-41cf-b925-731c4de6865d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:31.348577 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea02923-0ce3-41cf-b925-731c4de6865d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:31.348858 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea02923-0ce3-41cf-b925-731c4de6865d None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:31.353281 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea02923-0ce3-41cf-b925-731c4de6865d None admin] RBAC: Authorizing `identity:get_project(project_id=48537ad736fa4427a5c6de586bc429e5)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:31.354806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea02923-0ce3-41cf-b925-731c4de6865d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:31.364364 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 193/401] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:30 2022] GET /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5 => generated 298 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:31.368333 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea02923-0ce3-41cf-b925-731c4de6865d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:31.463369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 209/402] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:31.518033 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9dfd1-ec05-4188-b5ea-26e655650bf3 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:31.613133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:31.618874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea02923-0ce3-41cf-b925-731c4de6865d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:31.658262 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc4dc7-06b4-458b-9551-9531e265c1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:31.659367 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc4dc7-06b4-458b-9551-9531e265c1e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:31.659657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc4dc7-06b4-458b-9551-9531e265c1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:31.659930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc4dc7-06b4-458b-9551-9531e265c1e6 None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5/groups/ce391b9b9a9d4518bdd5ed7546d91929/roles/aa317d762bd64a9d864e54d074507f94` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:31.663023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc4dc7-06b4-458b-9551-9531e265c1e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=48537ad736fa4427a5c6de586bc429e5, group_id=ce391b9b9a9d4518bdd5ed7546d91929, role_id=aa317d762bd64a9d864e54d074507f94)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:31.664462 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbc4dc7-06b4-458b-9551-9531e265c1e6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:31.705624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a9dfd1-ec05-4188-b5ea-26e655650bf3 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:31.731387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:31.743238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8735c0b-506b-4c14-8eb9-d1aa39604d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:31.744057 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8735c0b-506b-4c14-8eb9-d1aa39604d39 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:31.744331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8735c0b-506b-4c14-8eb9-d1aa39604d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:31.744602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8735c0b-506b-4c14-8eb9-d1aa39604d39 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:31.755074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8735c0b-506b-4c14-8eb9-d1aa39604d39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:31.765569 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 194/403] 10.222.0.64 () {58 vars in 1442 bytes} [Mon Jul 18 02:16:31 2022] PUT /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5/groups/ce391b9b9a9d4518bdd5ed7546d91929/roles/aa317d762bd64a9d864e54d074507f94 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:16:31.771149 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cfb31-bcda-49dc-88bf-d53dbd2361df None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:31.771149 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cfb31-bcda-49dc-88bf-d53dbd2361df None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:31.771149 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7cfb31-bcda-49dc-88bf-d53dbd2361df None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:31.772531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 195/404] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:16:31.774349 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-f8735c0b-506b-4c14-8eb9-d1aa39604d39 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:16:31.774349 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:31.774349 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:31.774349 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:31.774349 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:31.774349 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:31.774349 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:31.774349 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:31.774349 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:31.774349 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:31.774349 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:31.774349 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:31.774349 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:31.774349 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:31.774349 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:31.774349 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:31.775248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:31.775248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:31.775248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:31.775248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:31.775248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:31.775248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:31.775248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:31.775248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:31.775248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:31.775248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:31.775248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:31.775248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:31.775248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:31.775248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:31.775248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:31.775248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:31.776019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:31.776019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:31.776019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:31.776019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:31.776019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:31.776019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:31.776019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:31.776019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:31.776019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:31.776019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:31.776019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:16:31.776019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:31.776607 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 210/405] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jul 18 02:16:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:31.783597 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d4c65-8871-4e2d-bc61-5a6c52c82cf5 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:31.783597 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d4c65-8871-4e2d-bc61-5a6c52c82cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:31.783597 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d4c65-8871-4e2d-bc61-5a6c52c82cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:31.785649 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8735c0b-506b-4c14-8eb9-d1aa39604d39 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:31.815025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-189d4c65-8871-4e2d-bc61-5a6c52c82cf5 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:31.817354 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-189d4c65-8871-4e2d-bc61-5a6c52c82cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:31.947749 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 196/406] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:31.972464 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d4c65-8871-4e2d-bc61-5a6c52c82cf5 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:31.978149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8735c0b-506b-4c14-8eb9-d1aa39604d39 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:32.015646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016780ef-50ed-482c-81c7-2eb071220dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:32.016381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016780ef-50ed-482c-81c7-2eb071220dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:32.016667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016780ef-50ed-482c-81c7-2eb071220dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:32.016947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016780ef-50ed-482c-81c7-2eb071220dc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:32.022981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016780ef-50ed-482c-81c7-2eb071220dc3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:32.022981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016780ef-50ed-482c-81c7-2eb071220dc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:32.022981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016780ef-50ed-482c-81c7-2eb071220dc3 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:32.028782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 211/407] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:16:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:32.034389 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016780ef-50ed-482c-81c7-2eb071220dc3 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:32.119496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:32.121525 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:32.157323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d4c65-8871-4e2d-bc61-5a6c52c82cf5 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:32.213928 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016780ef-50ed-482c-81c7-2eb071220dc3 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:32.220708 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fda8a-92c5-4ac2-9838-7b556206855c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:32.221520 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fda8a-92c5-4ac2-9838-7b556206855c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:32.221839 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fda8a-92c5-4ac2-9838-7b556206855c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:32.222121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fda8a-92c5-4ac2-9838-7b556206855c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:32.243248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fda8a-92c5-4ac2-9838-7b556206855c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:32.251463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-728fda8a-92c5-4ac2-9838-7b556206855c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:16:32.251463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:32.251463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:32.251463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:32.251463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:32.251463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:32.251463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:32.251463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:32.251463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:32.251463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:32.251463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:32.251463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:32.251463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:32.251463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:32.251463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:32.251463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:32.252350 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:32.252350 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:32.252350 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:32.252350 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:32.252350 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:32.252350 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:32.252350 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:32.252350 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:32.252350 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:32.252350 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:32.252350 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:32.252350 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:32.252350 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:32.252350 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:32.252350 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:32.252350 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:32.253126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:32.253126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:32.253126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:32.253126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:32.253126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:32.253126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:32.253126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:32.253126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:32.253126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:32.253126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:32.253126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:16:32.253126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:32.255226 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 197/408] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:16:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:16:32.262958 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fda8a-92c5-4ac2-9838-7b556206855c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:32.283373 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b303f-129e-4304-ac86-41ea12649b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:32.284177 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b303f-129e-4304-ac86-41ea12649b84 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:32.284458 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b303f-129e-4304-ac86-41ea12649b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:32.284735 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b303f-129e-4304-ac86-41ea12649b84 None admin] PATH_INFO: `/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:32.285959 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b303f-129e-4304-ac86-41ea12649b84 None admin] RBAC: Authorizing `identity:get_group(group_id=ce391b9b9a9d4518bdd5ed7546d91929)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:32.287404 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b303f-129e-4304-ac86-41ea12649b84 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:32.289033 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 212/409] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jul 18 02:16:32 2022] GET /identity/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:32.297599 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b303f-129e-4304-ac86-41ea12649b84 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:32.407585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fda8a-92c5-4ac2-9838-7b556206855c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:32.434289 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b303f-129e-4304-ac86-41ea12649b84 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:32.443635 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce655515-65f3-4b17-8ee7-cef614075554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:32.444582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce655515-65f3-4b17-8ee7-cef614075554 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:32.445078 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce655515-65f3-4b17-8ee7-cef614075554 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:32.445554 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce655515-65f3-4b17-8ee7-cef614075554 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:32.446539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce655515-65f3-4b17-8ee7-cef614075554 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:32.447057 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce655515-65f3-4b17-8ee7-cef614075554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:32.448634 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce655515-65f3-4b17-8ee7-cef614075554 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:32.449075 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:32.458258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 198/410] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:32.460587 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49905432-f9da-4ee6-b0fc-030899a85b77 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:32.460587 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49905432-f9da-4ee6-b0fc-030899a85b77 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:32.460587 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49905432-f9da-4ee6-b0fc-030899a85b77 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:32.462198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 199/411] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:32.464022 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49905432-f9da-4ee6-b0fc-030899a85b77 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:32.479818 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:32.480314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea9282-283e-4128-b7ae-e7d057818e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:32.482505 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea9282-283e-4128-b7ae-e7d057818e67 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:32.482831 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea9282-283e-4128-b7ae-e7d057818e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:32.483120 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea9282-283e-4128-b7ae-e7d057818e67 None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:32.484349 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea9282-283e-4128-b7ae-e7d057818e67 None admin] RBAC: Authorizing `identity:get_project(project_id=1cca069e1cb44ca6baae94c18f1eb534)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:32.486016 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea9282-283e-4128-b7ae-e7d057818e67 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:32.492810 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 213/412] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:32 2022] GET /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:32.494557 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62fd59-c644-477d-970d-1f6e1e9347ba None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:32.494993 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62fd59-c644-477d-970d-1f6e1e9347ba None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:32.495461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62fd59-c644-477d-970d-1f6e1e9347ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:32.514572 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0e62fd59-c644-477d-970d-1f6e1e9347ba None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:32.516215 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0e62fd59-c644-477d-970d-1f6e1e9347ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:32.571406 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49905432-f9da-4ee6-b0fc-030899a85b77 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:32.590236 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 214/413] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:32.591286 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62fd59-c644-477d-970d-1f6e1e9347ba None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:32.606545 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf457144-f941-4a13-8374-8a148d27d2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:32.607417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf457144-f941-4a13-8374-8a148d27d2aa None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:32.607758 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf457144-f941-4a13-8374-8a148d27d2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:32.608530 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf457144-f941-4a13-8374-8a148d27d2aa None admin] PATH_INFO: `/v3/groups/39ce060ac5d84cf9a7cf0d8606195d06` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:32.609713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf457144-f941-4a13-8374-8a148d27d2aa None admin] RBAC: Authorizing `identity:get_group(group_id=39ce060ac5d84cf9a7cf0d8606195d06)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:32.611153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf457144-f941-4a13-8374-8a148d27d2aa None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:32.613088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 200/414] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jul 18 02:16:32 2022] GET /identity/v3/groups/39ce060ac5d84cf9a7cf0d8606195d06 => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:32.622703 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf457144-f941-4a13-8374-8a148d27d2aa None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:32.704218 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62fd59-c644-477d-970d-1f6e1e9347ba None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:32.704862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:32.724376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf457144-f941-4a13-8374-8a148d27d2aa None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:32.734048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:32.742237 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde5536-3f87-4651-8f69-0919b9333729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:32.743359 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde5536-3f87-4651-8f69-0919b9333729 None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:32.743825 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde5536-3f87-4651-8f69-0919b9333729 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:32.744292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde5536-3f87-4651-8f69-0919b9333729 None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534/groups/ce391b9b9a9d4518bdd5ed7546d91929/roles/aa317d762bd64a9d864e54d074507f94` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:32.746768 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde5536-3f87-4651-8f69-0919b9333729 None admin] RBAC: Authorizing `identity:create_grant(project_id=1cca069e1cb44ca6baae94c18f1eb534, group_id=ce391b9b9a9d4518bdd5ed7546d91929, role_id=aa317d762bd64a9d864e54d074507f94)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:32.748448 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde5536-3f87-4651-8f69-0919b9333729 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:32.759159 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4016d-5463-4329-8820-cd09645b1f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:32.760024 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4016d-5463-4329-8820-cd09645b1f57 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:32.760310 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4016d-5463-4329-8820-cd09645b1f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:32.760588 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4016d-5463-4329-8820-cd09645b1f57 None admin] PATH_INFO: `/v3/projects/588ca26de9454c75b0a1f50762b8b0a2` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:32.761788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4016d-5463-4329-8820-cd09645b1f57 None admin] RBAC: Authorizing `identity:get_project(project_id=588ca26de9454c75b0a1f50762b8b0a2)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:32.763191 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4016d-5463-4329-8820-cd09645b1f57 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:32.769648 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 201/415] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:32 2022] GET /identity/v3/projects/588ca26de9454c75b0a1f50762b8b0a2 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:32.769648 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4016d-5463-4329-8820-cd09645b1f57 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:32.876335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4016d-5463-4329-8820-cd09645b1f57 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:32.878485 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 215/416] 10.222.0.64 () {58 vars in 1442 bytes} [Mon Jul 18 02:16:32 2022] PUT /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534/groups/ce391b9b9a9d4518bdd5ed7546d91929/roles/aa317d762bd64a9d864e54d074507f94 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:16:32.879768 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde5536-3f87-4651-8f69-0919b9333729 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:32.963834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca192e73-e7a3-40eb-b304-59c071758a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:32.964678 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca192e73-e7a3-40eb-b304-59c071758a2e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:32.965244 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca192e73-e7a3-40eb-b304-59c071758a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:32.965363 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca192e73-e7a3-40eb-b304-59c071758a2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:32.999653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca192e73-e7a3-40eb-b304-59c071758a2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:33.015250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-ca192e73-e7a3-40eb-b304-59c071758a2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:33.015250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:33.015250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:33.015250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:33.015250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:33.015250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:33.015250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:33.015250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:33.015250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:33.015250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:33.015250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:33.015250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:33.015250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:33.015250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:33.015250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:33.015250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:33.022248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:33.022248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:33.022248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:33.022248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:33.022248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:33.022248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:33.022248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:33.022248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:33.022248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:33.022248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:33.022248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:33.022248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:33.022248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:33.022248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:33.022248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:33.022248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:33.023052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:33.023052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:33.023052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:33.023052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:33.023052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:33.023052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:33.023052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:33.023052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:33.023052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:33.023052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:33.023052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:33.023052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:33.023052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 202/417] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:33.026807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca192e73-e7a3-40eb-b304-59c071758a2e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:33.039789 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde5536-3f87-4651-8f69-0919b9333729 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:33.060454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:33.084838 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc443dd-6ad6-4e42-9c02-28177b6f738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:33.086174 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc443dd-6ad6-4e42-9c02-28177b6f738b None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:33.086642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc443dd-6ad6-4e42-9c02-28177b6f738b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:33.087123 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc443dd-6ad6-4e42-9c02-28177b6f738b None admin] PATH_INFO: `/v3/projects/588ca26de9454c75b0a1f50762b8b0a2/groups/39ce060ac5d84cf9a7cf0d8606195d06/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:33.089394 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc443dd-6ad6-4e42-9c02-28177b6f738b None admin] RBAC: Authorizing `identity:create_grant(project_id=588ca26de9454c75b0a1f50762b8b0a2, group_id=39ce060ac5d84cf9a7cf0d8606195d06, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:33.091454 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc443dd-6ad6-4e42-9c02-28177b6f738b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:33.170400 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 216/418] 10.222.0.64 () {58 vars in 1442 bytes} [Mon Jul 18 02:16:32 2022] PUT /identity/v3/projects/588ca26de9454c75b0a1f50762b8b0a2/groups/39ce060ac5d84cf9a7cf0d8606195d06/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:16:33.206594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca192e73-e7a3-40eb-b304-59c071758a2e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:33.255862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a2dba-86c3-45dc-b143-4f57bef67664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:33.256666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a2dba-86c3-45dc-b143-4f57bef67664 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:33.256957 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a2dba-86c3-45dc-b143-4f57bef67664 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:33.257238 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a2dba-86c3-45dc-b143-4f57bef67664 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:33.258036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a2dba-86c3-45dc-b143-4f57bef67664 None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:33.258384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a2dba-86c3-45dc-b143-4f57bef67664 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:33.259811 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a2dba-86c3-45dc-b143-4f57bef67664 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:33.274301 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 203/419] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:16:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:33.280706 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc443dd-6ad6-4e42-9c02-28177b6f738b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:33.325477 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a528e9-3c56-49f7-9fa5-5d201ada43f4 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:33.325848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a528e9-3c56-49f7-9fa5-5d201ada43f4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:33.326079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a528e9-3c56-49f7-9fa5-5d201ada43f4 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:33.327744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 204/420] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:16:33.332767 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:33.339483 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031826a6-c524-4d8b-a13e-5b1fae58c91f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:33.339778 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031826a6-c524-4d8b-a13e-5b1fae58c91f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:33.340044 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031826a6-c524-4d8b-a13e-5b1fae58c91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:33.374772 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-031826a6-c524-4d8b-a13e-5b1fae58c91f None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:33.375991 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-031826a6-c524-4d8b-a13e-5b1fae58c91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:33.426921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc443dd-6ad6-4e42-9c02-28177b6f738b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:33.471303 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:33.474124 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228f425-b833-4cf2-ac7a-bb745641b0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:33.474483 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228f425-b833-4cf2-ac7a-bb745641b0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:33.474996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228f425-b833-4cf2-ac7a-bb745641b0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:33.475067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228f425-b833-4cf2-ac7a-bb745641b0f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:33.479622 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 205/421] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:16:33.503426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031826a6-c524-4d8b-a13e-5b1fae58c91f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:33.594810 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228f425-b833-4cf2-ac7a-bb745641b0f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:33.596650 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228f425-b833-4cf2-ac7a-bb745641b0f9 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:33.624242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031826a6-c524-4d8b-a13e-5b1fae58c91f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:33.664891 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfc322-670b-493d-8379-d9daa4eedf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:33.665730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfc322-670b-493d-8379-d9daa4eedf37 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:33.666035 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfc322-670b-493d-8379-d9daa4eedf37 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:33.666305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dfc322-670b-493d-8379-d9daa4eedf37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:33.666752 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:33.686975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dfc322-670b-493d-8379-d9daa4eedf37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:33.688387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-35dfc322-670b-493d-8379-d9daa4eedf37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:33.688387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:33.688387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:33.688387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:33.688387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:33.688387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:33.688387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:33.688387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:33.688387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:33.688387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:33.688387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:33.688387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:33.688387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:33.688387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:33.688387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:33.688387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:33.689242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:33.689242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:33.689242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:33.689242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:33.689242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:33.689242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:33.689242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:33.689242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:33.689242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:33.689242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:33.689242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:33.689242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:33.689242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:33.689242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:33.689242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:33.689242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:33.690074 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:33.690074 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:33.690074 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:33.690074 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:33.690074 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:33.690074 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:33.690074 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:33.690074 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:33.690074 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:33.690074 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:33.690074 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 02:16:33.690074 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:33.690074 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 206/422] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:33.696406 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfc322-670b-493d-8379-d9daa4eedf37 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:33.770038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:33.825734 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dfc322-670b-493d-8379-d9daa4eedf37 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:33.848752 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 217/423] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:33.853852 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228f425-b833-4cf2-ac7a-bb745641b0f9 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:33.865301 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca5e55-04b4-4c55-82d3-e6699430daa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:33.867116 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca5e55-04b4-4c55-82d3-e6699430daa3 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:33.867116 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca5e55-04b4-4c55-82d3-e6699430daa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:33.868110 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca5e55-04b4-4c55-82d3-e6699430daa3 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:33.868882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca5e55-04b4-4c55-82d3-e6699430daa3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:33.869198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca5e55-04b4-4c55-82d3-e6699430daa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:33.873723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beca5e55-04b4-4c55-82d3-e6699430daa3 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:33.881449 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 207/424] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:16:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:33.887696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca5e55-04b4-4c55-82d3-e6699430daa3 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:34.012165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca5e55-04b4-4c55-82d3-e6699430daa3 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:34.045392 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:34.058513 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228f425-b833-4cf2-ac7a-bb745641b0f9 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:34.060376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe3d72-8f27-4863-beb5-0c4a56e44a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:34.061814 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe3d72-8f27-4863-beb5-0c4a56e44a46 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:34.062973 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe3d72-8f27-4863-beb5-0c4a56e44a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:34.063274 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe3d72-8f27-4863-beb5-0c4a56e44a46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:34.096430 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:34.102794 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554dcd3-36a2-4a2c-ac2b-2b098d67f579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:34.104255 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554dcd3-36a2-4a2c-ac2b-2b098d67f579 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:34.104988 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554dcd3-36a2-4a2c-ac2b-2b098d67f579 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:34.105801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554dcd3-36a2-4a2c-ac2b-2b098d67f579 None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:34.107665 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554dcd3-36a2-4a2c-ac2b-2b098d67f579 None admin] RBAC: Authorizing `identity:get_project(project_id=48537ad736fa4427a5c6de586bc429e5)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:34.110351 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554dcd3-36a2-4a2c-ac2b-2b098d67f579 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:34.112767 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 218/425] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:33 2022] GET /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:34.114217 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f894a5-e8f2-4649-aaa6-fb5698814888 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:34.115129 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f894a5-e8f2-4649-aaa6-fb5698814888 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:34.115606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f894a5-e8f2-4649-aaa6-fb5698814888 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:34.117659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 219/426] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:34.118799 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f894a5-e8f2-4649-aaa6-fb5698814888 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:34.153167 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe3d72-8f27-4863-beb5-0c4a56e44a46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:34.155907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe3d72-8f27-4863-beb5-0c4a56e44a46 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:34.248664 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f894a5-e8f2-4649-aaa6-fb5698814888 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:34.285173 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 208/427] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 02:16:34.287017 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3843b8d-0bba-40a4-a525-297a11bf4e88 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:34.287458 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3843b8d-0bba-40a4-a525-297a11bf4e88 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:34.287859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3843b8d-0bba-40a4-a525-297a11bf4e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:34.302402 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb978cc2-8a81-425a-a173-41c66704b82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:34.304922 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb978cc2-8a81-425a-a173-41c66704b82b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:34.305387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb978cc2-8a81-425a-a173-41c66704b82b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:34.305857 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb978cc2-8a81-425a-a173-41c66704b82b None admin] PATH_INFO: `/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:34.307235 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb978cc2-8a81-425a-a173-41c66704b82b None admin] RBAC: Authorizing `identity:get_group(group_id=ce391b9b9a9d4518bdd5ed7546d91929)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:34.307711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d3843b8d-0bba-40a4-a525-297a11bf4e88 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:34.308988 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb978cc2-8a81-425a-a173-41c66704b82b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:34.309102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d3843b8d-0bba-40a4-a525-297a11bf4e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:34.316559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 220/428] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jul 18 02:16:34 2022] GET /identity/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:34.317633 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb978cc2-8a81-425a-a173-41c66704b82b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:34.330205 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:34.393120 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:34.398766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 209/429] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:34.399711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3843b8d-0bba-40a4-a525-297a11bf4e88 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:34.432100 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb978cc2-8a81-425a-a173-41c66704b82b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:34.472590 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810b437-ab0b-492f-a1ee-cb684dbe978e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:34.473720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810b437-ab0b-492f-a1ee-cb684dbe978e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:34.474190 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810b437-ab0b-492f-a1ee-cb684dbe978e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:34.474602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810b437-ab0b-492f-a1ee-cb684dbe978e None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:34.476191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810b437-ab0b-492f-a1ee-cb684dbe978e None admin] RBAC: Authorizing `identity:get_project(project_id=1cca069e1cb44ca6baae94c18f1eb534)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:34.477824 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810b437-ab0b-492f-a1ee-cb684dbe978e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:34.479884 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 221/430] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:34 2022] GET /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:34.480820 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810b437-ab0b-492f-a1ee-cb684dbe978e None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:34.527799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3843b8d-0bba-40a4-a525-297a11bf4e88 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:34.574720 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4fcfc-12d0-44bd-a0ed-b1f65c4f522a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:34.575730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4fcfc-12d0-44bd-a0ed-b1f65c4f522a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:34.576123 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4fcfc-12d0-44bd-a0ed-b1f65c4f522a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:34.576536 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4fcfc-12d0-44bd-a0ed-b1f65c4f522a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:34.577757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4fcfc-12d0-44bd-a0ed-b1f65c4f522a None admin] RBAC: Adding query filter params (group.id=ce391b9b9a9d4518bdd5ed7546d91929, role.id=7db255e54afa4cecac2d6c93da70795e, scope.project.id=48537ad736fa4427a5c6de586bc429e5) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:34.578182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4fcfc-12d0-44bd-a0ed-b1f65c4f522a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:34.580115 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4fcfc-12d0-44bd-a0ed-b1f65c4f522a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:34.597744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 210/431] 10.222.0.64 () {56 vars in 1376 bytes} [Mon Jul 18 02:16:34 2022] GET /identity/v3/role_assignments?group.id=ce391b9b9a9d4518bdd5ed7546d91929&scope.project.id=48537ad736fa4427a5c6de586bc429e5&role.id=7db255e54afa4cecac2d6c93da70795e => generated 611 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:34.597744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4fcfc-12d0-44bd-a0ed-b1f65c4f522a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:34.606712 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810b437-ab0b-492f-a1ee-cb684dbe978e None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:34.614174 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:34.685472 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bd509-3e51-4530-85d2-62ad7bc39a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:34.687774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bd509-3e51-4530-85d2-62ad7bc39a25 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:34.688871 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bd509-3e51-4530-85d2-62ad7bc39a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:34.689491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596bd509-3e51-4530-85d2-62ad7bc39a25 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:34.706105 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:34.714065 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596bd509-3e51-4530-85d2-62ad7bc39a25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:34.734178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-596bd509-3e51-4530-85d2-62ad7bc39a25 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:16:34.734178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:34.734178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:34.734178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:34.734178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:34.734178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:34.734178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:34.734178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:34.734178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:34.734178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:34.734178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:34.734178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:34.734178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:34.734178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:34.734178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:34.734178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:34.735154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:34.735154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:34.735154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:34.735154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:34.735154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:34.735154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:34.735154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:34.735154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:34.735154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:34.735154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:34.735154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:34.735154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:34.735154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:34.735154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:34.735154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:34.735154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:34.736250 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:34.736250 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:34.736250 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:34.736250 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:34.736250 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:34.736250 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:34.736250 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:34.736250 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:34.736250 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:34.736250 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:34.736250 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:16:34.736250 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:34.736250 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 222/432] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jul 18 02:16:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:34.744009 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bd509-3e51-4530-85d2-62ad7bc39a25 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:34.785052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4fcfc-12d0-44bd-a0ed-b1f65c4f522a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:34.825547 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec66d0-24cf-476e-a0cb-f11f0ec63504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:34.826436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec66d0-24cf-476e-a0cb-f11f0ec63504 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:34.826725 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec66d0-24cf-476e-a0cb-f11f0ec63504 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:34.827000 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec66d0-24cf-476e-a0cb-f11f0ec63504 None admin] PATH_INFO: `/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:34.828278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec66d0-24cf-476e-a0cb-f11f0ec63504 None admin] RBAC: Authorizing `identity:get_group(group_id=ce391b9b9a9d4518bdd5ed7546d91929)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:34.829878 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ec66d0-24cf-476e-a0cb-f11f0ec63504 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:34.836421 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 211/433] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jul 18 02:16:34 2022] GET /identity/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:34.838030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec66d0-24cf-476e-a0cb-f11f0ec63504 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:34.898797 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596bd509-3e51-4530-85d2-62ad7bc39a25 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:34.941674 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec529658-534f-4064-b875-887202e0010d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:34.942811 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec529658-534f-4064-b875-887202e0010d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:34.943290 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec529658-534f-4064-b875-887202e0010d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:34.943743 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec529658-534f-4064-b875-887202e0010d None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:34.944792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec529658-534f-4064-b875-887202e0010d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:34.945280 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec529658-534f-4064-b875-887202e0010d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:34.946962 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec529658-534f-4064-b875-887202e0010d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:34.950874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:34.957993 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 223/434] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:16:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:34.965157 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec529658-534f-4064-b875-887202e0010d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:34.969430 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ec66d0-24cf-476e-a0cb-f11f0ec63504 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:35.024368 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad2f57d-2b04-4716-b222-6c02f3a87761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:35.025035 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2f57d-2b04-4716-b222-6c02f3a87761 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:35.025320 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2f57d-2b04-4716-b222-6c02f3a87761 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:35.025598 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad2f57d-2b04-4716-b222-6c02f3a87761 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:35.026462 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2f57d-2b04-4716-b222-6c02f3a87761 None admin] RBAC: Adding query filter params (group.id=ce391b9b9a9d4518bdd5ed7546d91929, role.id=7db255e54afa4cecac2d6c93da70795e, scope.project.id=1cca069e1cb44ca6baae94c18f1eb534) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:35.026831 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2f57d-2b04-4716-b222-6c02f3a87761 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:35.028321 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad2f57d-2b04-4716-b222-6c02f3a87761 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:35.041001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 212/435] 10.222.0.64 () {56 vars in 1376 bytes} [Mon Jul 18 02:16:34 2022] GET /identity/v3/role_assignments?group.id=ce391b9b9a9d4518bdd5ed7546d91929&scope.project.id=1cca069e1cb44ca6baae94c18f1eb534&role.id=7db255e54afa4cecac2d6c93da70795e => generated 611 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:35.045891 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:35.097303 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec529658-534f-4064-b875-887202e0010d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:35.139993 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbf046-e11a-44d2-ac1a-2148a9066bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:35.141888 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbf046-e11a-44d2-ac1a-2148a9066bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:35.142436 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbf046-e11a-44d2-ac1a-2148a9066bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:35.142909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbf046-e11a-44d2-ac1a-2148a9066bc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:35.195838 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f687c-7352-47f0-8f18-dea6bb81e74e None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:35.196238 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f687c-7352-47f0-8f18-dea6bb81e74e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:35.196521 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f687c-7352-47f0-8f18-dea6bb81e74e None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:35.199552 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 213/436] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:35.206855 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f407f-2406-4dde-b893-3372faae6a81 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:35.207141 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f407f-2406-4dde-b893-3372faae6a81 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:35.207423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f407f-2406-4dde-b893-3372faae6a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:35.226713 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cbf046-e11a-44d2-ac1a-2148a9066bc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:35.228652 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cbf046-e11a-44d2-ac1a-2148a9066bc4 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:35.233888 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-0b2f407f-2406-4dde-b893-3372faae6a81 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:35.235322 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0b2f407f-2406-4dde-b893-3372faae6a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:35.295495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:35.329729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 214/437] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:35.354678 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 224/438] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 02:16:35.360664 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f407f-2406-4dde-b893-3372faae6a81 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:35.362594 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbf046-e11a-44d2-ac1a-2148a9066bc4 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:35.482022 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:35.489354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbf046-e11a-44d2-ac1a-2148a9066bc4 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:35.509557 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f407f-2406-4dde-b893-3372faae6a81 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:35.529387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a93bfa-7e3c-4085-a72a-4e3f844b8870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:35.530316 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a93bfa-7e3c-4085-a72a-4e3f844b8870 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:35.530607 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a93bfa-7e3c-4085-a72a-4e3f844b8870 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:35.530883 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a93bfa-7e3c-4085-a72a-4e3f844b8870 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:35.541576 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a93bfa-7e3c-4085-a72a-4e3f844b8870 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:35.546742 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d621afd-7500-4abc-835c-2173b14b81dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:35.547619 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d621afd-7500-4abc-835c-2173b14b81dd None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:35.547910 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d621afd-7500-4abc-835c-2173b14b81dd None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:35.548191 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d621afd-7500-4abc-835c-2173b14b81dd None admin] PATH_INFO: `/v3/projects/48537ad736fa4427a5c6de586bc429e5` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:35.549429 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d621afd-7500-4abc-835c-2173b14b81dd None admin] RBAC: Authorizing `identity:get_project(project_id=48537ad736fa4427a5c6de586bc429e5)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:35.549895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-f4a93bfa-7e3c-4085-a72a-4e3f844b8870 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:16:35.549895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:35.549895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:35.549895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:35.549895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:35.549895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:35.549895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:35.549895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:35.549895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:35.549895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:35.549895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:35.549895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:35.549895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:35.549895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:35.549895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:35.549895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:35.550731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:35.550731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:35.550731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:35.550731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:35.550731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:35.550731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:35.550731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:35.550731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:35.550731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:35.550731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:35.550731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:35.550731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:35.550731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:35.550731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:35.550731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:35.550731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:35.551785 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:35.551785 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:35.551785 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:35.551785 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:35.551785 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:35.551785 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:35.551785 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:35.551785 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:35.551785 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:35.551785 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:35.551785 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:16:35.551785 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:35.552400 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d621afd-7500-4abc-835c-2173b14b81dd None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:35.557315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 215/439] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:35 2022] GET /identity/v3/projects/48537ad736fa4427a5c6de586bc429e5 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:35.557430 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 225/440] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jul 18 02:16:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:35.557679 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d621afd-7500-4abc-835c-2173b14b81dd None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:35.558094 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a93bfa-7e3c-4085-a72a-4e3f844b8870 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:35.580428 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:35.661922 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d621afd-7500-4abc-835c-2173b14b81dd None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:35.662261 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a93bfa-7e3c-4085-a72a-4e3f844b8870 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:35.696995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979eb950-a899-4eac-a99e-b967085d64c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:35.697218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702b812-e9db-4819-bf38-5e8ca493f72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:35.697830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702b812-e9db-4819-bf38-5e8ca493f72c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:35.697932 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979eb950-a899-4eac-a99e-b967085d64c3 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:35.698121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702b812-e9db-4819-bf38-5e8ca493f72c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:35.698220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979eb950-a899-4eac-a99e-b967085d64c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:35.698398 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9702b812-e9db-4819-bf38-5e8ca493f72c None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:35.698492 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979eb950-a899-4eac-a99e-b967085d64c3 None admin] PATH_INFO: `/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:35.699140 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702b812-e9db-4819-bf38-5e8ca493f72c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:35.699446 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702b812-e9db-4819-bf38-5e8ca493f72c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:35.699622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979eb950-a899-4eac-a99e-b967085d64c3 None admin] RBAC: Authorizing `identity:get_group(group_id=ce391b9b9a9d4518bdd5ed7546d91929)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:35.700812 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9702b812-e9db-4819-bf38-5e8ca493f72c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:35.701058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979eb950-a899-4eac-a99e-b967085d64c3 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:35.703479 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 226/441] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jul 18 02:16:35 2022] GET /identity/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:35.708953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979eb950-a899-4eac-a99e-b967085d64c3 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:35.714505 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 216/442] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:16:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:35.715350 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702b812-e9db-4819-bf38-5e8ca493f72c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:35.726049 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:35.796695 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:35.812656 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979eb950-a899-4eac-a99e-b967085d64c3 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:35.819926 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9702b812-e9db-4819-bf38-5e8ca493f72c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:35.846708 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06257e-b38c-4102-a4e3-9f704770439c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:35.847360 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06257e-b38c-4102-a4e3-9f704770439c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:35.847644 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06257e-b38c-4102-a4e3-9f704770439c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:35.847918 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06257e-b38c-4102-a4e3-9f704770439c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:35.848731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06257e-b38c-4102-a4e3-9f704770439c None admin] RBAC: Adding query filter params (group.id=ce391b9b9a9d4518bdd5ed7546d91929, role.id=aa317d762bd64a9d864e54d074507f94, scope.project.id=48537ad736fa4427a5c6de586bc429e5) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:35.849041 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06257e-b38c-4102-a4e3-9f704770439c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:35.850558 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06257e-b38c-4102-a4e3-9f704770439c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:35.853125 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e9ed7-d4fe-4011-b988-843e837b3ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:35.853807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e9ed7-d4fe-4011-b988-843e837b3ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:35.854096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e9ed7-d4fe-4011-b988-843e837b3ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:35.854379 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e9ed7-d4fe-4011-b988-843e837b3ec4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:35.856162 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 227/443] 10.222.0.64 () {56 vars in 1376 bytes} [Mon Jul 18 02:16:35 2022] GET /identity/v3/role_assignments?group.id=ce391b9b9a9d4518bdd5ed7546d91929&scope.project.id=48537ad736fa4427a5c6de586bc429e5&role.id=aa317d762bd64a9d864e54d074507f94 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:35.857970 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c105c6f-6532-42af-a328-bcd18143d2c8 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:35.858827 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c105c6f-6532-42af-a328-bcd18143d2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:35.858827 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c105c6f-6532-42af-a328-bcd18143d2c8 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:35.859748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 228/444] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:35.871707 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6d41a-76fe-402b-9fdc-666ecc435471 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:35.872001 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6d41a-76fe-402b-9fdc-666ecc435471 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:35.872289 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6d41a-76fe-402b-9fdc-666ecc435471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:35.890329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-68f6d41a-76fe-402b-9fdc-666ecc435471 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:35.891561 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-68f6d41a-76fe-402b-9fdc-666ecc435471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:35.933619 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e9ed7-d4fe-4011-b988-843e837b3ec4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:35.935047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e9ed7-d4fe-4011-b988-843e837b3ec4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:35.945874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:35.969936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 229/445] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:16:35.993524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6d41a-76fe-402b-9fdc-666ecc435471 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:36.044079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 217/446] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 02:16:36.050538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e9ed7-d4fe-4011-b988-843e837b3ec4 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:36.079216 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:36.100113 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6d41a-76fe-402b-9fdc-666ecc435471 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:36.152321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a781e-57cc-48b4-8e30-eeb86ee8d6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:36.153363 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a781e-57cc-48b4-8e30-eeb86ee8d6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:36.153837 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a781e-57cc-48b4-8e30-eeb86ee8d6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:36.154299 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a781e-57cc-48b4-8e30-eeb86ee8d6f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:36.166572 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a781e-57cc-48b4-8e30-eeb86ee8d6f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:36.174907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-094a781e-57cc-48b4-8e30-eeb86ee8d6f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:16:36.174907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:36.174907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:36.174907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:36.174907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:36.174907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:36.174907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:36.174907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:36.174907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:36.174907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:36.174907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:36.174907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:36.174907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:36.174907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:36.174907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:36.174907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:36.175790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:36.175790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:36.175790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:36.175790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:36.175790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:36.175790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:36.175790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:36.175790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:36.175790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:36.175790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:36.175790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:36.175790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:36.175790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:36.175790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:36.175790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:36.175790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:36.176848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:36.176848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:36.176848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:36.176848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:36.176848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:36.176848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:36.176848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:36.176848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:36.176848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:36.176848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:36.176848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:16:36.176848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:36.176848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 230/447] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:16:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:16:36.178159 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e9ed7-d4fe-4011-b988-843e837b3ec4 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:36.182571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a781e-57cc-48b4-8e30-eeb86ee8d6f0 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:36.188428 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:36.220079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b546bc4-7fd1-46c4-a23c-0457132432cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:36.221260 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b546bc4-7fd1-46c4-a23c-0457132432cb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:36.221567 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b546bc4-7fd1-46c4-a23c-0457132432cb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:36.221888 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b546bc4-7fd1-46c4-a23c-0457132432cb None admin] PATH_INFO: `/v3/projects/1cca069e1cb44ca6baae94c18f1eb534` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:36.225520 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b546bc4-7fd1-46c4-a23c-0457132432cb None admin] RBAC: Authorizing `identity:get_project(project_id=1cca069e1cb44ca6baae94c18f1eb534)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:36.225939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b546bc4-7fd1-46c4-a23c-0457132432cb None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:36.229354 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 218/448] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:36 2022] GET /identity/v3/projects/1cca069e1cb44ca6baae94c18f1eb534 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:36.233457 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b546bc4-7fd1-46c4-a23c-0457132432cb None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:36.302860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a781e-57cc-48b4-8e30-eeb86ee8d6f0 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:36.345475 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98025ef3-2615-45c6-b04b-f50f7fe44f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:36.348596 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98025ef3-2615-45c6-b04b-f50f7fe44f0c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:36.348596 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98025ef3-2615-45c6-b04b-f50f7fe44f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:36.348596 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98025ef3-2615-45c6-b04b-f50f7fe44f0c None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:36.348596 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98025ef3-2615-45c6-b04b-f50f7fe44f0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:36.348596 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98025ef3-2615-45c6-b04b-f50f7fe44f0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:36.348988 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98025ef3-2615-45c6-b04b-f50f7fe44f0c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:36.352967 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b546bc4-7fd1-46c4-a23c-0457132432cb None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:36.359880 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 231/449] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:36.366986 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98025ef3-2615-45c6-b04b-f50f7fe44f0c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:36.368275 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:36.392814 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c5b5e-4660-4ccf-b338-a08cd30497f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:36.396033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c5b5e-4660-4ccf-b338-a08cd30497f5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:36.396033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c5b5e-4660-4ccf-b338-a08cd30497f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:36.396033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527c5b5e-4660-4ccf-b338-a08cd30497f5 None admin] PATH_INFO: `/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:36.396033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c5b5e-4660-4ccf-b338-a08cd30497f5 None admin] RBAC: Authorizing `identity:get_group(group_id=ce391b9b9a9d4518bdd5ed7546d91929)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:36.397226 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527c5b5e-4660-4ccf-b338-a08cd30497f5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:36.399162 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 219/450] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jul 18 02:16:36 2022] GET /identity/v3/groups/ce391b9b9a9d4518bdd5ed7546d91929 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:36.405330 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c5b5e-4660-4ccf-b338-a08cd30497f5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:36.450265 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:36.472713 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98025ef3-2615-45c6-b04b-f50f7fe44f0c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:36.504327 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527c5b5e-4660-4ccf-b338-a08cd30497f5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:36.506375 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0b6da-0353-426b-9bd6-9c2730e25383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:36.507102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0b6da-0353-426b-9bd6-9c2730e25383 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:36.507385 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0b6da-0353-426b-9bd6-9c2730e25383 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:36.507659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0b6da-0353-426b-9bd6-9c2730e25383 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:36.539370 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc175917-a944-4cd9-b2b9-cf53da056469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:36.540023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc175917-a944-4cd9-b2b9-cf53da056469 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:36.540311 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc175917-a944-4cd9-b2b9-cf53da056469 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:36.540593 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc175917-a944-4cd9-b2b9-cf53da056469 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:36.541421 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc175917-a944-4cd9-b2b9-cf53da056469 None admin] RBAC: Adding query filter params (group.id=ce391b9b9a9d4518bdd5ed7546d91929, role.id=aa317d762bd64a9d864e54d074507f94, scope.project.id=1cca069e1cb44ca6baae94c18f1eb534) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:36.541774 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc175917-a944-4cd9-b2b9-cf53da056469 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:36.543226 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc175917-a944-4cd9-b2b9-cf53da056469 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:36.549054 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 220/451] 10.222.0.64 () {56 vars in 1376 bytes} [Mon Jul 18 02:16:36 2022] GET /identity/v3/role_assignments?group.id=ce391b9b9a9d4518bdd5ed7546d91929&scope.project.id=1cca069e1cb44ca6baae94c18f1eb534&role.id=aa317d762bd64a9d864e54d074507f94 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:36.577638 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0b6da-0353-426b-9bd6-9c2730e25383 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:36.579175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0b6da-0353-426b-9bd6-9c2730e25383 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:36.581499 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:36.683623 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 232/452] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:36.689925 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc175917-a944-4cd9-b2b9-cf53da056469 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:36.793180 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc175917-a944-4cd9-b2b9-cf53da056469 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:36.802831 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:36.827698 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02987ad8-3abb-4c90-9156-9d10ee45e47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:36.828568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02987ad8-3abb-4c90-9156-9d10ee45e47a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:36.828857 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02987ad8-3abb-4c90-9156-9d10ee45e47a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:36.829324 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02987ad8-3abb-4c90-9156-9d10ee45e47a None admin] PATH_INFO: `/v3/projects/588ca26de9454c75b0a1f50762b8b0a2` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:36.831536 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02987ad8-3abb-4c90-9156-9d10ee45e47a None admin] RBAC: Authorizing `identity:get_project(project_id=588ca26de9454c75b0a1f50762b8b0a2)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:36.833574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02987ad8-3abb-4c90-9156-9d10ee45e47a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:36.836301 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 221/453] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:16:36 2022] GET /identity/v3/projects/588ca26de9454c75b0a1f50762b8b0a2 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:36.842332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0b6da-0353-426b-9bd6-9c2730e25383 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:36.944869 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0b6da-0353-426b-9bd6-9c2730e25383 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:36.946376 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:36.978478 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053e026-1dad-4ed3-bf2b-98b909c87e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:36.979326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053e026-1dad-4ed3-bf2b-98b909c87e31 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:36.979609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053e026-1dad-4ed3-bf2b-98b909c87e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:36.979879 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053e026-1dad-4ed3-bf2b-98b909c87e31 None admin] PATH_INFO: `/v3/groups/39ce060ac5d84cf9a7cf0d8606195d06` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:36.981021 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053e026-1dad-4ed3-bf2b-98b909c87e31 None admin] RBAC: Authorizing `identity:get_group(group_id=39ce060ac5d84cf9a7cf0d8606195d06)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:36.983137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053e026-1dad-4ed3-bf2b-98b909c87e31 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:36.984742 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 233/454] 10.222.0.64 () {56 vars in 1180 bytes} [Mon Jul 18 02:16:36 2022] GET /identity/v3/groups/39ce060ac5d84cf9a7cf0d8606195d06 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:36.990598 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02987ad8-3abb-4c90-9156-9d10ee45e47a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:37.087403 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02987ad8-3abb-4c90-9156-9d10ee45e47a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:37.120205 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf55ffbc-10c1-401c-8fa3-10d26c791676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:37.120848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55ffbc-10c1-401c-8fa3-10d26c791676 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:37.121137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55ffbc-10c1-401c-8fa3-10d26c791676 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:37.121418 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55ffbc-10c1-401c-8fa3-10d26c791676 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:37.122273 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55ffbc-10c1-401c-8fa3-10d26c791676 None admin] RBAC: Adding query filter params (group.id=39ce060ac5d84cf9a7cf0d8606195d06, role.id=5dfa34e7a4594751aed7c0495c9a2383, scope.project.id=588ca26de9454c75b0a1f50762b8b0a2) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:37.122588 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55ffbc-10c1-401c-8fa3-10d26c791676 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:37.124044 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf55ffbc-10c1-401c-8fa3-10d26c791676 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:37.129725 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 222/455] 10.222.0.64 () {56 vars in 1376 bytes} [Mon Jul 18 02:16:36 2022] GET /identity/v3/role_assignments?group.id=39ce060ac5d84cf9a7cf0d8606195d06&scope.project.id=588ca26de9454c75b0a1f50762b8b0a2&role.id=5dfa34e7a4594751aed7c0495c9a2383 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:39.504284 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48270001-fc1b-4f78-9127-135fd9200bf8 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:39.505028 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48270001-fc1b-4f78-9127-135fd9200bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:39.505028 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48270001-fc1b-4f78-9127-135fd9200bf8 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:39.506330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 234/456] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:39.511702 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c5301-cdaa-4ed6-a644-7a0c6195e5ea None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:39.512554 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c5301-cdaa-4ed6-a644-7a0c6195e5ea None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:39.512554 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c5301-cdaa-4ed6-a644-7a0c6195e5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:39.538717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-048c5301-cdaa-4ed6-a644-7a0c6195e5ea None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:39.539942 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-048c5301-cdaa-4ed6-a644-7a0c6195e5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:39.586295 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:39.632349 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 223/457] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:39.667651 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48270001-fc1b-4f78-9127-135fd9200bf8 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:39.784844 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cf2e5-b196-4ede-b07e-8644b2bcc0c3 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:39.785153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cf2e5-b196-4ede-b07e-8644b2bcc0c3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:39.785334 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cf2e5-b196-4ede-b07e-8644b2bcc0c3 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:39.786746 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 224/458] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:16:39.802492 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343807f-b774-44a9-a037-ceca1662bea0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:39.802773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343807f-b774-44a9-a037-ceca1662bea0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:39.803046 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343807f-b774-44a9-a037-ceca1662bea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:39.819330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48270001-fc1b-4f78-9127-135fd9200bf8 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:39.825410 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c343807f-b774-44a9-a037-ceca1662bea0 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:39.826924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c343807f-b774-44a9-a037-ceca1662bea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:39.882432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f3d81-fd09-4cdc-a6ac-f3e087c35e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:39.883251 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f3d81-fd09-4cdc-a6ac-f3e087c35e0c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:39.883533 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f3d81-fd09-4cdc-a6ac-f3e087c35e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:39.883810 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2f3d81-fd09-4cdc-a6ac-f3e087c35e0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:39.907776 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f3d81-fd09-4cdc-a6ac-f3e087c35e0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:39.909232 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2f3d81-fd09-4cdc-a6ac-f3e087c35e0c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:39.912874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 225/459] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:39.939248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343807f-b774-44a9-a037-ceca1662bea0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:39.945024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-3e2f3d81-fd09-4cdc-a6ac-f3e087c35e0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:39.945024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:39.945024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:39.945024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:39.945024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:39.945024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:39.945024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:39.945024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:39.945024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:39.945024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:39.945024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:39.945024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:39.945024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:39.945024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:39.945024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:39.946145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:39.946145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:39.946145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:39.946145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:39.946145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:39.946145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:39.946145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:39.946145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:39.946145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:39.946145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:39.946145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:39.946145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:39.946145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:39.946145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:39.946145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:39.946145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:39.946145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:39.947049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:39.947049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:39.947049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:39.947049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:39.947049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 235/460] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:39.955371 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f3d81-fd09-4cdc-a6ac-f3e087c35e0c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:40.002850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:40.083210 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:40.087320 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343807f-b774-44a9-a037-ceca1662bea0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:40.087438 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2f3d81-fd09-4cdc-a6ac-f3e087c35e0c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:40.125469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b5ed2-e0c0-4821-ba99-573620a0abea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:40.126104 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b5ed2-e0c0-4821-ba99-573620a0abea None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:40.126468 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b5ed2-e0c0-4821-ba99-573620a0abea None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:40.126878 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b5ed2-e0c0-4821-ba99-573620a0abea None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:40.127705 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b5ed2-e0c0-4821-ba99-573620a0abea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:40.128040 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b5ed2-e0c0-4821-ba99-573620a0abea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:40.132021 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b5ed2-e0c0-4821-ba99-573620a0abea None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:40.137364 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9c657-fa9b-4377-894e-0dd470e7b536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:40.139420 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9c657-fa9b-4377-894e-0dd470e7b536 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:40.139860 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9c657-fa9b-4377-894e-0dd470e7b536 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:40.141137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9c657-fa9b-4377-894e-0dd470e7b536 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:40.152778 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 236/461] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:40.152778 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850afa5-beda-4ba3-98e5-02f77b28f108 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:40.152778 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850afa5-beda-4ba3-98e5-02f77b28f108 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:40.152778 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850afa5-beda-4ba3-98e5-02f77b28f108 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:40.161505 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 237/462] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:40.161505 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850afa5-beda-4ba3-98e5-02f77b28f108 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:40.162146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9c657-fa9b-4377-894e-0dd470e7b536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:40.163860 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9c657-fa9b-4377-894e-0dd470e7b536 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:40.187916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-79b9c657-fa9b-4377-894e-0dd470e7b536 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:40.187916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:40.187916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:40.187916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:40.187916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:40.187916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:40.187916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:40.187916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:40.187916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:40.187916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:40.187916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:40.187916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:40.187916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:40.187916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:40.187916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:40.188843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:40.188843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:40.188843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:40.188843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:40.188843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:40.188843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:40.188843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:40.188843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:40.188843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:40.188843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:40.188843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:40.188843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:40.188843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:40.188843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:40.188843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:40.188843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:40.188843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:40.189667 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:40.189667 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:40.189667 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:40.189667 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:40.194164 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 226/463] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:40.195595 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e5c41-50f8-4e6f-82da-ccd084c8ea7c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:40.195922 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e5c41-50f8-4e6f-82da-ccd084c8ea7c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:40.196327 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e5c41-50f8-4e6f-82da-ccd084c8ea7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:40.214945 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-409e5c41-50f8-4e6f-82da-ccd084c8ea7c None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:40.216357 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-409e5c41-50f8-4e6f-82da-ccd084c8ea7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:40.262982 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:40.283858 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850afa5-beda-4ba3-98e5-02f77b28f108 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:40.293923 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 227/464] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:40.294973 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e5c41-50f8-4e6f-82da-ccd084c8ea7c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:40.330663 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b5253-2f36-4953-a01a-ab02fe550c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:40.331741 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b5253-2f36-4953-a01a-ab02fe550c8d None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:40.332201 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b5253-2f36-4953-a01a-ab02fe550c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:40.332724 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4b5253-2f36-4953-a01a-ab02fe550c8d None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:40.333658 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b5253-2f36-4953-a01a-ab02fe550c8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:40.337200 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4b5253-2f36-4953-a01a-ab02fe550c8d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:40.382419 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:40.399277 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e5c41-50f8-4e6f-82da-ccd084c8ea7c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:40.431914 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3fcb3-ae2c-4ed2-8954-0347f96c8c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:40.432567 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3fcb3-ae2c-4ed2-8954-0347f96c8c06 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:40.432851 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3fcb3-ae2c-4ed2-8954-0347f96c8c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:40.433124 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3fcb3-ae2c-4ed2-8954-0347f96c8c06 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:40.433867 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3fcb3-ae2c-4ed2-8954-0347f96c8c06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:40.434174 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3fcb3-ae2c-4ed2-8954-0347f96c8c06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:40.436246 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3fcb3-ae2c-4ed2-8954-0347f96c8c06 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:40.452827 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 228/465] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:40.454040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106cbaaa-b33e-48b0-9b68-2efa30c88830 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:40.454328 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106cbaaa-b33e-48b0-9b68-2efa30c88830 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:40.454604 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106cbaaa-b33e-48b0-9b68-2efa30c88830 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:40.455958 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 229/466] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:40.458398 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106cbaaa-b33e-48b0-9b68-2efa30c88830 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:40.485731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 238/467] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jul 18 02:16:40 2022] POST /identity/v3/users => generated 246 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:16:40.485731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b5253-2f36-4953-a01a-ab02fe550c8d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:40.583390 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106cbaaa-b33e-48b0-9b68-2efa30c88830 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:40.622199 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4b5253-2f36-4953-a01a-ab02fe550c8d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:40.627008 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1c0bf-8fdb-48c8-9d5b-6d098ee85881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:40.627993 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1c0bf-8fdb-48c8-9d5b-6d098ee85881 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:40.628385 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1c0bf-8fdb-48c8-9d5b-6d098ee85881 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:40.628765 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1c0bf-8fdb-48c8-9d5b-6d098ee85881 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:40.641199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1c0bf-8fdb-48c8-9d5b-6d098ee85881 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:40.642729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1c0bf-8fdb-48c8-9d5b-6d098ee85881 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:40.645004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:40.665101 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7ce20-cbb3-4b0d-ae73-959e08891d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:40.666051 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7ce20-cbb3-4b0d-ae73-959e08891d1d None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:40.666509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7ce20-cbb3-4b0d-ae73-959e08891d1d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:40.666926 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7ce20-cbb3-4b0d-ae73-959e08891d1d None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:40.667813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7ce20-cbb3-4b0d-ae73-959e08891d1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:40.668618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-ada1c0bf-8fdb-48c8-9d5b-6d098ee85881 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:40.668618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:40.668618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:40.668618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:40.668618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:40.668618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:40.668618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:40.668618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:40.668618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:40.668618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:40.668618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:40.668618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:40.668618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:40.668618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:40.668618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:40.676730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:40.676730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:40.676730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:40.676730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:40.676730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:40.676730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:40.676730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:40.676730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:40.676730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:40.676730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:40.676730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:40.676730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:40.676730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:40.676730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:40.676730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:40.676730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:40.676730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:40.677625 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:40.677625 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:40.677625 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:40.677625 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:40.677625 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 230/468] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:40.677953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7ce20-cbb3-4b0d-ae73-959e08891d1d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:40.678032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b14865-43fa-494f-b3d3-d3b2935dc45b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:40.678032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b14865-43fa-494f-b3d3-d3b2935dc45b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:40.678032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b14865-43fa-494f-b3d3-d3b2935dc45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:40.685682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:40.693866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-89b14865-43fa-494f-b3d3-d3b2935dc45b None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:40.695520 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-89b14865-43fa-494f-b3d3-d3b2935dc45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:40.769094 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 231/469] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:40.770285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b14865-43fa-494f-b3d3-d3b2935dc45b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:40.817217 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 239/470] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jul 18 02:16:40 2022] POST /identity/v3/users => generated 248 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:16:40.818409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7ce20-cbb3-4b0d-ae73-959e08891d1d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:40.921840 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b14865-43fa-494f-b3d3-d3b2935dc45b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:40.936294 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7ce20-cbb3-4b0d-ae73-959e08891d1d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:40.949926 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:40.963496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c71338-e4aa-4f17-bd17-9f490b2132d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:40.964471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c71338-e4aa-4f17-bd17-9f490b2132d5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:40.964983 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c71338-e4aa-4f17-bd17-9f490b2132d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:40.965466 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c71338-e4aa-4f17-bd17-9f490b2132d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:40.966438 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c71338-e4aa-4f17-bd17-9f490b2132d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:40.966924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c71338-e4aa-4f17-bd17-9f490b2132d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:40.968489 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c71338-e4aa-4f17-bd17-9f490b2132d5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:40.981294 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bbf15-55ed-4178-af08-bb875a953dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:40.982182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bbf15-55ed-4178-af08-bb875a953dce None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:40.982560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bbf15-55ed-4178-af08-bb875a953dce None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:40.982744 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16bbf15-55ed-4178-af08-bb875a953dce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:40.983033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 232/471] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:40.988286 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c71338-e4aa-4f17-bd17-9f490b2132d5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:41.010989 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bbf15-55ed-4178-af08-bb875a953dce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:41.013998 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16bbf15-55ed-4178-af08-bb875a953dce None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:41.036088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-a16bbf15-55ed-4178-af08-bb875a953dce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:41.036088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:41.036088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:41.036088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:41.036088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:41.036088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:41.036088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:41.036088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:41.036088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:41.036088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:41.036088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:41.036088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:41.036088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:41.036088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:41.036088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:41.037005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:41.037005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:41.037005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:41.037005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:41.037005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:41.037005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:41.037005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:41.037005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:41.037005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:41.037005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:41.037005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:41.037005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:41.037005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:41.037005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:41.037005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:41.037005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:41.037005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:41.037947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:41.037947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:41.037947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:41.037947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:41.040435 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 240/472] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:41.047216 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bbf15-55ed-4178-af08-bb875a953dce None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:41.110991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:41.157353 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c71338-e4aa-4f17-bd17-9f490b2132d5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:41.190497 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16bbf15-55ed-4178-af08-bb875a953dce None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:41.194640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c47f52c-2886-47be-af93-6eee6f1f53c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:41.195564 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47f52c-2886-47be-af93-6eee6f1f53c7 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:41.196060 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47f52c-2886-47be-af93-6eee6f1f53c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:41.196558 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c47f52c-2886-47be-af93-6eee6f1f53c7 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:41.197456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47f52c-2886-47be-af93-6eee6f1f53c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:41.199159 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c47f52c-2886-47be-af93-6eee6f1f53c7 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:41.231802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede962f2-b449-4736-b59e-c0ecc5d95d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:41.233008 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede962f2-b449-4736-b59e-c0ecc5d95d7e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:41.233303 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede962f2-b449-4736-b59e-c0ecc5d95d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:41.233583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede962f2-b449-4736-b59e-c0ecc5d95d7e None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:41.234354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede962f2-b449-4736-b59e-c0ecc5d95d7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:41.234662 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede962f2-b449-4736-b59e-c0ecc5d95d7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:41.236051 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede962f2-b449-4736-b59e-c0ecc5d95d7e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:41.248760 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 241/473] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:41.250139 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6e7e1-27a8-4f75-bbb9-17ff3a3465e1 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:41.250432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6e7e1-27a8-4f75-bbb9-17ff3a3465e1 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:41.250714 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6e7e1-27a8-4f75-bbb9-17ff3a3465e1 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:41.252069 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 242/474] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:41.256682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6e7e1-27a8-4f75-bbb9-17ff3a3465e1 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:41.319303 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 233/475] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jul 18 02:16:40 2022] POST /identity/v3/users => generated 248 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:16:41.326473 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6ac5d-ff93-4517-94d8-4559d0092d5f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:41.326966 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6ac5d-ff93-4517-94d8-4559d0092d5f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:41.327441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6ac5d-ff93-4517-94d8-4559d0092d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:41.367126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-10c6ac5d-ff93-4517-94d8-4559d0092d5f None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:41.368497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-10c6ac5d-ff93-4517-94d8-4559d0092d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:41.379468 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6e7e1-27a8-4f75-bbb9-17ff3a3465e1 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:41.389885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:41.423895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118c890-8cec-40dd-a32b-88c775fa4484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:41.425032 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118c890-8cec-40dd-a32b-88c775fa4484 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:41.425504 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118c890-8cec-40dd-a32b-88c775fa4484 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:41.426517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118c890-8cec-40dd-a32b-88c775fa4484 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:41.427853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118c890-8cec-40dd-a32b-88c775fa4484 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:41.430003 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118c890-8cec-40dd-a32b-88c775fa4484 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:41.448182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:41.487080 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 234/476] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:41.510109 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6ac5d-ff93-4517-94d8-4559d0092d5f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:41.523867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 243/477] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jul 18 02:16:41 2022] POST /identity/v3/users => generated 249 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:16:41.641949 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6ac5d-ff93-4517-94d8-4559d0092d5f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:41.680844 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61fb1e-85c0-40ff-bf4e-7c88e0b0ad84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:41.681624 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61fb1e-85c0-40ff-bf4e-7c88e0b0ad84 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:41.681949 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61fb1e-85c0-40ff-bf4e-7c88e0b0ad84 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:41.682231 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61fb1e-85c0-40ff-bf4e-7c88e0b0ad84 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:41.683054 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61fb1e-85c0-40ff-bf4e-7c88e0b0ad84 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:41.684527 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61fb1e-85c0-40ff-bf4e-7c88e0b0ad84 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:41.730718 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.sql.core [None req-6b61fb1e-85c0-40ff-bf4e-7c88e0b0ad84 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 02:16:41.730718 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 18 02:16:41.730718 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [parameters: {'id': 'ccaf86ce866941da86a213218e7919f6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 18 02:16:41.730718 dv-cinder-850015-3-smb devstack@keystone.service[80358]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80358) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 02:16:41.748631 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-6b61fb1e-85c0-40ff-bf4e-7c88e0b0ad84 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 18 02:16:41.748631 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:41.748631 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 02:16:41.748631 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 02:16:41.748631 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 02:16:41.748631 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 02:16:41.748631 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 02:16:41.748631 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 02:16:41.748631 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 02:16:41.748631 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application conn.query(q) Jul 18 02:16:41.748631 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 02:16:41.748631 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 02:16:41.748631 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 02:16:41.748631 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application result.read() Jul 18 02:16:41.748631 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 02:16:41.749543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 02:16:41.749543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 02:16:41.749543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 02:16:41.749543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 02:16:41.749543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 02:16:41.749543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 02:16:41.749543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 02:16:41.749543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 02:16:41.749543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:41.749543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 02:16:41.749543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:41.749543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:41.749543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 02:16:41.749543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 02:16:41.749543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 18 02:16:41.749543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return ref.to_dict() Jul 18 02:16:41.749543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 02:16:41.749543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application next(self.gen) Jul 18 02:16:41.750722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 02:16:41.750722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application yield resource Jul 18 02:16:41.750722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 02:16:41.750722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application next(self.gen) Jul 18 02:16:41.750722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 02:16:41.750722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 02:16:41.750722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:16:41.750722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 02:16:41.750722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:16:41.750722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise self.value Jul 18 02:16:41.750722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 02:16:41.750722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 02:16:41.750722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 02:16:41.750722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application session.commit() Jul 18 02:16:41.750722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 02:16:41.750722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 02:16:41.750722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 02:16:41.752091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 02:16:41.752091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 02:16:41.752091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self.session.flush() Jul 18 02:16:41.752091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 02:16:41.752091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 02:16:41.752091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 02:16:41.752091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 02:16:41.752091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 02:16:41.752091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application compat.raise_( Jul 18 02:16:41.752091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 02:16:41.752091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception Jul 18 02:16:41.752091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 02:16:41.752091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 02:16:41.752091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 02:16:41.752091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 02:16:41.752091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 02:16:41.752091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 02:16:41.753166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 02:16:41.753166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 02:16:41.753166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 18 02:16:41.753166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 18 02:16:41.753166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 02:16:41.753166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 02:16:41.753166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 02:16:41.753166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 02:16:41.753166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 02:16:41.753166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 02:16:41.753166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 02:16:41.753166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 02:16:41.753166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 02:16:41.753166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 02:16:41.753166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 02:16:41.753166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception Jul 18 02:16:41.754258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 02:16:41.754258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 02:16:41.754258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 02:16:41.754258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 02:16:41.754258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 02:16:41.754258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 02:16:41.754258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 02:16:41.754258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application conn.query(q) Jul 18 02:16:41.754258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 02:16:41.754258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 02:16:41.754258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 02:16:41.754258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application result.read() Jul 18 02:16:41.754258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 02:16:41.754258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 02:16:41.754258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 02:16:41.754258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 02:16:41.755875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 02:16:41.755875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 02:16:41.755875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 02:16:41.755875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 02:16:41.755875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 02:16:41.755875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 18 02:16:41.755875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [parameters: {'id': 'ccaf86ce866941da86a213218e7919f6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 18 02:16:41.755875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 02:16:41.755875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:41.755875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:16:41.755875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:41.755875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:41.755875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:41.755875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:41.755875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:41.755875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:41.756877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:41.756877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:41.756877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:41.756877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:41.756877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:41.756877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:41.756877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 18 02:16:41.756877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 18 02:16:41.756877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:41.756877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:41.756877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 18 02:16:41.756877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 18 02:16:41.756877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 02:16:41.756877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 02:16:41.756877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 18 02:16:41.756877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:41.760233 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 235/478] 10.222.0.64 () {60 vars in 1131 bytes} [Mon Jul 18 02:16:41 2022] POST /identity/v3/roles => generated 144 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:16:41.760372 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118c890-8cec-40dd-a32b-88c775fa4484 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:41.878214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118c890-8cec-40dd-a32b-88c775fa4484 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:41.924774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83edfc7-5295-436c-a134-6db703da8984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:41.925600 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83edfc7-5295-436c-a134-6db703da8984 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:41.926154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83edfc7-5295-436c-a134-6db703da8984 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:41.926466 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83edfc7-5295-436c-a134-6db703da8984 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:41.943729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83edfc7-5295-436c-a134-6db703da8984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:41.952081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-e83edfc7-5295-436c-a134-6db703da8984 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:16:41.952081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:41.952081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:41.952081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:41.952081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:41.952081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:41.952081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:41.952081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:41.952081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:41.952081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:41.952081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:41.952081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:41.952081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:41.952081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:41.952081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:41.952081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:41.953024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:41.953024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:41.953024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:41.953024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:41.953024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:41.953024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:41.953024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:41.953024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:41.953024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:41.953024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:41.953024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:41.953024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:41.953024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:41.953024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:41.953024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:41.953024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:41.954408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:41.954408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:41.954408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:41.954408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:41.954408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:41.954408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:41.954408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:41.954408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:41.954408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:41.954408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:41.954408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 02:16:41.954408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:41.954408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 244/479] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jul 18 02:16:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:16:41.958937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61fb1e-85c0-40ff-bf4e-7c88e0b0ad84 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:42.020234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:42.109965 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61fb1e-85c0-40ff-bf4e-7c88e0b0ad84 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:42.167331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9957c50-f2ea-4268-80ed-045cf1d0ba54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:42.168015 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9957c50-f2ea-4268-80ed-045cf1d0ba54 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:42.168302 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9957c50-f2ea-4268-80ed-045cf1d0ba54 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:42.168580 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9957c50-f2ea-4268-80ed-045cf1d0ba54 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:42.169362 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9957c50-f2ea-4268-80ed-045cf1d0ba54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:42.169674 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9957c50-f2ea-4268-80ed-045cf1d0ba54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:42.171073 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9957c50-f2ea-4268-80ed-045cf1d0ba54 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:42.185298 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 236/480] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:16:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:42.791672 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc0501-f01a-41fb-b3e8-3ffedbb3db14 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:42.792695 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc0501-f01a-41fb-b3e8-3ffedbb3db14 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:42.793185 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc0501-f01a-41fb-b3e8-3ffedbb3db14 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:42.795588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 245/481] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:42.801582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af264310-356c-4a60-836c-3eff98059f38 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:42.802412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af264310-356c-4a60-836c-3eff98059f38 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:42.802894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af264310-356c-4a60-836c-3eff98059f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:42.824175 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-af264310-356c-4a60-836c-3eff98059f38 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:42.825742 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-af264310-356c-4a60-836c-3eff98059f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:42.916070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 237/482] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:16:42.955162 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc0501-f01a-41fb-b3e8-3ffedbb3db14 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:42.995670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:43.085768 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc0501-f01a-41fb-b3e8-3ffedbb3db14 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:43.121081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d2e7d-96d7-4014-ac34-6d87293a2eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:43.121924 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d2e7d-96d7-4014-ac34-6d87293a2eca None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:43.122214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d2e7d-96d7-4014-ac34-6d87293a2eca None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:43.123026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d2e7d-96d7-4014-ac34-6d87293a2eca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:43.133991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d2e7d-96d7-4014-ac34-6d87293a2eca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:43.142539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-130d2e7d-96d7-4014-ac34-6d87293a2eca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:43.142539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:43.142539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:43.142539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:43.142539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:43.142539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:43.142539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:43.142539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:43.142539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:43.142539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:43.142539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:43.142539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:43.142539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:43.142539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:43.142539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:43.142539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:43.143410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:43.143410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:43.143410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:43.143410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:43.143410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:43.143410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:43.143410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:43.143410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:43.143410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:43.143410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:43.143410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:43.143410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:43.143410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:43.143410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:43.143410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:43.143410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:43.144202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:43.144202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:43.144202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:43.144202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:43.144202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:43.144202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:43.144202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:43.144202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:43.144202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:43.144202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:43.144202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:43.144202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:43.144202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 246/483] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:16:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:43.150709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af264310-356c-4a60-836c-3eff98059f38 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:43.178473 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:43.255137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af264310-356c-4a60-836c-3eff98059f38 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:43.301492 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2248ae-a55f-46e3-bb07-d26e0a1373cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:43.302195 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2248ae-a55f-46e3-bb07-d26e0a1373cb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:43.302480 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2248ae-a55f-46e3-bb07-d26e0a1373cb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:43.302758 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2248ae-a55f-46e3-bb07-d26e0a1373cb None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:43.303497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2248ae-a55f-46e3-bb07-d26e0a1373cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:43.303804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2248ae-a55f-46e3-bb07-d26e0a1373cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:43.305176 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2248ae-a55f-46e3-bb07-d26e0a1373cb None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:43.314376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 238/484] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jul 18 02:16:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:43.320028 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d2e7d-96d7-4014-ac34-6d87293a2eca None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:43.418084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:43.425577 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d2e7d-96d7-4014-ac34-6d87293a2eca None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:43.460886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bec07f-657e-490d-a028-e001673289c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:43.461787 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bec07f-657e-490d-a028-e001673289c2 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:43.462412 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bec07f-657e-490d-a028-e001673289c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:43.462896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bec07f-657e-490d-a028-e001673289c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:43.474805 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bec07f-657e-490d-a028-e001673289c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:43.476369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bec07f-657e-490d-a028-e001673289c2 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:43.494595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-63bec07f-657e-490d-a028-e001673289c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:43.494595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:43.494595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:43.494595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:43.494595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:43.494595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:43.494595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:43.494595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:43.494595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:43.494595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:43.494595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:43.494595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:43.494595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:43.494595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:43.494595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:43.495453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:43.495453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:43.495453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:43.495453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:43.495453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:43.495453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:43.495453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:43.495453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:43.495453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:43.495453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:43.495453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:43.495453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:43.495453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:43.495453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:43.495453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:43.495453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:43.495453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:43.496268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:43.496268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:43.496268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:43.496268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:43.496268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 247/485] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:43.502247 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2248ae-a55f-46e3-bb07-d26e0a1373cb None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:43.570821 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5b376-1387-4d5e-bfdb-4352c433ed5d None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:43.571125 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5b376-1387-4d5e-bfdb-4352c433ed5d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:43.571386 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5b376-1387-4d5e-bfdb-4352c433ed5d None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:43.573133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 248/486] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:43.578793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e14f97-080e-4058-a3f1-71ad196a87db None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:43.579330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e14f97-080e-4058-a3f1-71ad196a87db None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:43.579800 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e14f97-080e-4058-a3f1-71ad196a87db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:43.614995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-94e14f97-080e-4058-a3f1-71ad196a87db None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:43.616212 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-94e14f97-080e-4058-a3f1-71ad196a87db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:43.660905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:43.675420 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2248ae-a55f-46e3-bb07-d26e0a1373cb None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:43.699859 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 249/487] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:16:43.722570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e14f97-080e-4058-a3f1-71ad196a87db None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:43.736608 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90e881-4daa-4771-850f-8a0f385f9fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:43.737278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90e881-4daa-4771-850f-8a0f385f9fac None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:43.737557 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90e881-4daa-4771-850f-8a0f385f9fac None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:43.738623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb90e881-4daa-4771-850f-8a0f385f9fac None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:43.739353 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90e881-4daa-4771-850f-8a0f385f9fac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:43.739660 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90e881-4daa-4771-850f-8a0f385f9fac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:43.742734 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb90e881-4daa-4771-850f-8a0f385f9fac None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:43.763011 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 239/488] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:43.770194 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90e881-4daa-4771-850f-8a0f385f9fac None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:43.827144 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:43.897151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e14f97-080e-4058-a3f1-71ad196a87db None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:43.964805 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb90e881-4daa-4771-850f-8a0f385f9fac None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:43.973886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122372a-c4bc-482e-8901-c5924a2d0b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:43.974910 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122372a-c4bc-482e-8901-c5924a2d0b86 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:43.975193 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122372a-c4bc-482e-8901-c5924a2d0b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:43.975466 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122372a-c4bc-482e-8901-c5924a2d0b86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:43.990738 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b122372a-c4bc-482e-8901-c5924a2d0b86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:44.002253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-b122372a-c4bc-482e-8901-c5924a2d0b86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:44.002253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:44.002253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:44.002253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:44.002253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:44.002253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:44.002253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:44.002253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:44.002253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:44.002253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:44.002253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:44.002253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:44.002253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:44.002253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:44.002253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:44.002253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:44.003158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:44.003158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:44.003158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:44.003158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:44.003158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:44.003158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:44.003158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:44.003158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:44.003158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:44.003158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:44.003158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:44.003158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:44.003158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:44.003158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:44.003158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:44.003158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:44.003991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:44.003991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:44.003991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:44.003991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:44.003991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:44.003991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:44.003991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:44.003991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:44.003991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:44.003991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:44.003991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:44.003991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:44.005198 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 250/489] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:16:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:16:44.015498 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122372a-c4bc-482e-8901-c5924a2d0b86 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:44.042182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbffaf-bf9d-443f-a5a8-ac02846a1c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:44.043050 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbffaf-bf9d-443f-a5a8-ac02846a1c6a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:44.043325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbffaf-bf9d-443f-a5a8-ac02846a1c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:44.043651 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbffaf-bf9d-443f-a5a8-ac02846a1c6a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:44.062525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbffaf-bf9d-443f-a5a8-ac02846a1c6a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:44.064001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbffaf-bf9d-443f-a5a8-ac02846a1c6a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:44.091072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-23cbffaf-bf9d-443f-a5a8-ac02846a1c6a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 02:16:44.091072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:44.091072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:44.091072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:44.091072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:44.091072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:44.091072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:44.091072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:44.091072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:44.091072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:44.091072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:44.091072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:44.091072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:16:44.091072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:16:44.091072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:16:44.091072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:16:44.092077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:44.092077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:44.092077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:16:44.092077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:44.092077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:16:44.092077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:44.092077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:44.092077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:44.092077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:44.092077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:44.092077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:44.092077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:44.092077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:44.092077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:44.092077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:44.092077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:44.092077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:44.092077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:44.092964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:44.092964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:44.092964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:16:44.092964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:16:44.092964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:16:44.092964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:16:44.092964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:16:44.092964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:16:44.092964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 02:16:44.092964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:44.092964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 240/490] 10.222.0.64 () {56 vars in 1093 bytes} [Mon Jul 18 02:16:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:44.100020 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8435e7d-862e-46bf-a49d-5e8a7b023f07 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:44.100313 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8435e7d-862e-46bf-a49d-5e8a7b023f07 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:44.100599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8435e7d-862e-46bf-a49d-5e8a7b023f07 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:44.102212 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 241/491] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:44.102988 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8435e7d-862e-46bf-a49d-5e8a7b023f07 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:44.115161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:44.147190 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122372a-c4bc-482e-8901-c5924a2d0b86 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:44.171659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:44.183390 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904726c9-0fbc-4dc0-8e0a-14d37faf4f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:44.184063 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904726c9-0fbc-4dc0-8e0a-14d37faf4f90 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:44.184350 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904726c9-0fbc-4dc0-8e0a-14d37faf4f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:44.184627 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904726c9-0fbc-4dc0-8e0a-14d37faf4f90 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:44.185406 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904726c9-0fbc-4dc0-8e0a-14d37faf4f90 None admin] RBAC: Adding query filter params (name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:44.185729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904726c9-0fbc-4dc0-8e0a-14d37faf4f90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:44.187107 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904726c9-0fbc-4dc0-8e0a-14d37faf4f90 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:44.196422 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 251/492] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jul 18 02:16:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:44.197725 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7466e-f6b8-4cb1-b964-f6a06197c053 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:44.198021 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7466e-f6b8-4cb1-b964-f6a06197c053 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:44.198300 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7466e-f6b8-4cb1-b964-f6a06197c053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:44.215117 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-d5a7466e-f6b8-4cb1-b964-f6a06197c053 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:44.216361 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d5a7466e-f6b8-4cb1-b964-f6a06197c053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:44.220741 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8435e7d-862e-46bf-a49d-5e8a7b023f07 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:44.256915 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d455b-e9d4-49c8-8239-811f0bc99729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:44.257986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d455b-e9d4-49c8-8239-811f0bc99729 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:44.258294 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d455b-e9d4-49c8-8239-811f0bc99729 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:44.258569 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d455b-e9d4-49c8-8239-811f0bc99729 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:44.259397 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d455b-e9d4-49c8-8239-811f0bc99729 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:44.260058 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d455b-e9d4-49c8-8239-811f0bc99729 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:44.262120 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d455b-e9d4-49c8-8239-811f0bc99729 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:44.293723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 252/493] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:44.293723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21a8c7-a8dc-4496-910c-087fc51a3f87 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:44.293723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21a8c7-a8dc-4496-910c-087fc51a3f87 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:44.293723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f21a8c7-a8dc-4496-910c-087fc51a3f87 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:44.293723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 253/494] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:44.293723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21a8c7-a8dc-4496-910c-087fc51a3f87 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:44.310527 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 242/495] 10.222.0.64 () {56 vars in 1133 bytes} [Mon Jul 18 02:16:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:44.312509 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43254c-fb34-41d4-8571-d45c13d4e283 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:44.312804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43254c-fb34-41d4-8571-d45c13d4e283 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:44.313085 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c43254c-fb34-41d4-8571-d45c13d4e283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:44.333235 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2c43254c-fb34-41d4-8571-d45c13d4e283 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:44.334567 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2c43254c-fb34-41d4-8571-d45c13d4e283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:44.398817 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:44.399371 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f21a8c7-a8dc-4496-910c-087fc51a3f87 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:44.406171 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 243/496] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:44.406991 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43254c-fb34-41d4-8571-d45c13d4e283 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:44.424070 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:44.444799 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b159426-a5a6-4f73-8e76-3b688b8c3723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:44.445181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b159426-a5a6-4f73-8e76-3b688b8c3723 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:44.445463 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b159426-a5a6-4f73-8e76-3b688b8c3723 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:44.445765 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b159426-a5a6-4f73-8e76-3b688b8c3723 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:44.456851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b159426-a5a6-4f73-8e76-3b688b8c3723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:44.458336 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b159426-a5a6-4f73-8e76-3b688b8c3723 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:44.478067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-7b159426-a5a6-4f73-8e76-3b688b8c3723 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:44.478067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:44.478067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:44.478067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:44.478067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:44.478067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:44.478067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:44.478067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:44.478067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:44.478067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:44.478067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:44.478067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:44.478067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:44.478067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:44.478067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:44.478915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:44.478915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:44.478915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:44.478915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:44.478915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:44.478915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:44.478915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:44.478915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:44.478915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:44.478915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:44.478915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:44.478915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:44.478915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:44.478915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:44.478915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:44.478915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:44.478915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:44.484559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:44.484559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:44.484559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:44.484559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:44.484559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 254/497] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:44.484559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b159426-a5a6-4f73-8e76-3b688b8c3723 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:44.519399 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c43254c-fb34-41d4-8571-d45c13d4e283 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:44.556957 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588991a-3752-48f7-8137-1a2f59093d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:44.557769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588991a-3752-48f7-8137-1a2f59093d9d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:44.558058 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588991a-3752-48f7-8137-1a2f59093d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:44.558339 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e588991a-3752-48f7-8137-1a2f59093d9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:44.569686 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e588991a-3752-48f7-8137-1a2f59093d9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:44.577585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-e588991a-3752-48f7-8137-1a2f59093d9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:44.577585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:44.577585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:44.577585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:44.577585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:44.577585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:44.577585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:44.577585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:44.577585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:44.577585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:44.577585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:44.577585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:44.577585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:44.577585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:44.577585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:44.577585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:44.578688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:44.578688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:44.578688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:44.578688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:44.578688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:44.578688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:44.578688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:44.578688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:44.578688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:44.578688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:44.578688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:44.578688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:44.578688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:44.578688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:44.578688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:44.578688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:44.579508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:44.579508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:44.579508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:44.579508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:44.579508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:44.579508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:44.579508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:44.579508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:44.579508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:44.579508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:44.579508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:44.579508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:44.579508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 244/498] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:16:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:44.580160 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588991a-3752-48f7-8137-1a2f59093d9d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:44.594137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b159426-a5a6-4f73-8e76-3b688b8c3723 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:44.628701 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd739ad-7dfc-4026-98e4-026f482efaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:44.629651 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd739ad-7dfc-4026-98e4-026f482efaa6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:44.630147 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd739ad-7dfc-4026-98e4-026f482efaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:44.630427 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd739ad-7dfc-4026-98e4-026f482efaa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:44.645192 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:44.665560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:44.697222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e588991a-3752-48f7-8137-1a2f59093d9d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:44.699514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd739ad-7dfc-4026-98e4-026f482efaa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:44.701732 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd739ad-7dfc-4026-98e4-026f482efaa6 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:44.733829 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591be5b-cd1d-497b-afa3-2365d3ffe12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:44.734568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591be5b-cd1d-497b-afa3-2365d3ffe12f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:44.734860 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591be5b-cd1d-497b-afa3-2365d3ffe12f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:44.735153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591be5b-cd1d-497b-afa3-2365d3ffe12f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:44.745668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591be5b-cd1d-497b-afa3-2365d3ffe12f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:44.753939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-a591be5b-cd1d-497b-afa3-2365d3ffe12f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:44.753939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:44.753939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:44.753939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:44.753939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:44.753939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:44.753939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:44.753939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:44.753939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:44.753939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:44.753939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:44.753939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:44.753939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:44.753939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:44.753939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:44.753939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:44.754803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:44.754803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:44.754803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:44.754803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:44.754803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:44.754803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:44.754803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:44.754803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:44.754803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:44.754803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:44.754803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:44.754803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:44.754803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:44.754803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:44.754803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:44.754803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:44.755668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:44.755668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:44.755668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:44.755668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:44.755668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:44.755668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:44.755668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:44.755668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:44.755668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:44.755668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:44.755668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:44.755668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:44.755668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 245/499] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:16:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:44.756304 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591be5b-cd1d-497b-afa3-2365d3ffe12f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:44.810216 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 255/500] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:44.811064 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd739ad-7dfc-4026-98e4-026f482efaa6 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:44.873984 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591be5b-cd1d-497b-afa3-2365d3ffe12f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:44.881365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:44.895924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:44.917144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf7122-7172-4747-9ca2-dcfb57cd3b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:44.917890 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf7122-7172-4747-9ca2-dcfb57cd3b2d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:44.918181 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf7122-7172-4747-9ca2-dcfb57cd3b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:44.918458 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf7122-7172-4747-9ca2-dcfb57cd3b2d None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:44.919782 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf7122-7172-4747-9ca2-dcfb57cd3b2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:44.920031 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd739ad-7dfc-4026-98e4-026f482efaa6 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:44.920134 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf7122-7172-4747-9ca2-dcfb57cd3b2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:44.921468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf7122-7172-4747-9ca2-dcfb57cd3b2d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:44.934174 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 246/501] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:44.935555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf7122-7172-4747-9ca2-dcfb57cd3b2d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:44.958775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318832a-5c91-411c-ad9f-8880bf6f0e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:44.959452 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318832a-5c91-411c-ad9f-8880bf6f0e2b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:44.959742 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318832a-5c91-411c-ad9f-8880bf6f0e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:44.960021 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318832a-5c91-411c-ad9f-8880bf6f0e2b None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:44.960764 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f318832a-5c91-411c-ad9f-8880bf6f0e2b None admin] RBAC: Adding query filter params (name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:44.961074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f318832a-5c91-411c-ad9f-8880bf6f0e2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:44.962492 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f318832a-5c91-411c-ad9f-8880bf6f0e2b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:44.970425 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 256/502] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jul 18 02:16:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:44.971036 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318832a-5c91-411c-ad9f-8880bf6f0e2b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:45.037554 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf7122-7172-4747-9ca2-dcfb57cd3b2d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:45.071734 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea0521-65cf-46c2-80e0-699c3751ed20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:45.072447 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea0521-65cf-46c2-80e0-699c3751ed20 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:45.072735 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea0521-65cf-46c2-80e0-699c3751ed20 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:45.073018 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea0521-65cf-46c2-80e0-699c3751ed20 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:45.073792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea0521-65cf-46c2-80e0-699c3751ed20 None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:45.074102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea0521-65cf-46c2-80e0-699c3751ed20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:45.076025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea0521-65cf-46c2-80e0-699c3751ed20 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:45.078916 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318832a-5c91-411c-ad9f-8880bf6f0e2b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:45.084598 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 247/503] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jul 18 02:16:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:45.085887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0139c-1e12-4d8b-96bd-f4fd947847b6 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:45.086507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0139c-1e12-4d8b-96bd-f4fd947847b6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:45.086507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0139c-1e12-4d8b-96bd-f4fd947847b6 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:45.087835 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 248/504] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:45.090470 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0139c-1e12-4d8b-96bd-f4fd947847b6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:45.107852 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:45.113131 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaaa09b-8e6d-46fe-9f6e-8244851574e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:45.113950 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaaa09b-8e6d-46fe-9f6e-8244851574e6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:45.114232 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaaa09b-8e6d-46fe-9f6e-8244851574e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:45.114506 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaaa09b-8e6d-46fe-9f6e-8244851574e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:45.124735 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaaa09b-8e6d-46fe-9f6e-8244851574e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:45.126229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaaa09b-8e6d-46fe-9f6e-8244851574e6 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:45.133775 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:45.145252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-abaaa09b-8e6d-46fe-9f6e-8244851574e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:45.145252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:45.145252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:45.145252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:45.145252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:45.145252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:45.145252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:45.145252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:45.145252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:45.145252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:45.145252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:45.145252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:45.145252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:45.145252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:45.145252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:45.146077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:45.146077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:45.146077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:45.146077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:45.146077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:45.146077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:45.146077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:45.146077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:45.146077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:45.146077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:45.146077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:45.146077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:45.146077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:45.146077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:45.146077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:45.146077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:45.146077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:45.146916 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:45.146916 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:45.146916 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:45.146916 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:45.146916 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 257/505] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:45.146916 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaaa09b-8e6d-46fe-9f6e-8244851574e6 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:45.197597 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0139c-1e12-4d8b-96bd-f4fd947847b6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:45.230776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a17b09-22e4-4398-9519-47def3696ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:45.232166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a17b09-22e4-4398-9519-47def3696ade None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:45.232454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a17b09-22e4-4398-9519-47def3696ade None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:45.232730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a17b09-22e4-4398-9519-47def3696ade None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:45.239672 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a17b09-22e4-4398-9519-47def3696ade None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:45.241118 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a17b09-22e4-4398-9519-47def3696ade None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:45.255445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-66a17b09-22e4-4398-9519-47def3696ade None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 02:16:45.255445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:45.255445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:45.255445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:45.255445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:45.255445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:45.255445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:45.255445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:45.255445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:45.255445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:45.255445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:45.255445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:45.255445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:16:45.255445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:16:45.255445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:16:45.255445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:16:45.256650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:45.256650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:45.256650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:16:45.256650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:45.256650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:16:45.256650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:45.256650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:45.256650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:45.256650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:45.256650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:45.256650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:45.256650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:45.256650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:45.256650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:45.256650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:45.256650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:45.256650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:45.256650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:45.257497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:45.257497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:45.257497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:16:45.257497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:16:45.257497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:16:45.257497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:16:45.257497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:16:45.257497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:16:45.257497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 02:16:45.257497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:45.257497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 249/506] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:45.257497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a17b09-22e4-4398-9519-47def3696ade None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:45.265664 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaaa09b-8e6d-46fe-9f6e-8244851574e6 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:45.300249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd6eb0-4dc3-4885-a173-e93c8c71c899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:45.301228 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd6eb0-4dc3-4885-a173-e93c8c71c899 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:45.301521 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd6eb0-4dc3-4885-a173-e93c8c71c899 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:45.301837 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd6eb0-4dc3-4885-a173-e93c8c71c899 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:45.312409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd6eb0-4dc3-4885-a173-e93c8c71c899 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:45.313883 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd6eb0-4dc3-4885-a173-e93c8c71c899 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:45.330495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-34dd6eb0-4dc3-4885-a173-e93c8c71c899 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:45.330495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:45.330495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:45.330495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:45.330495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:45.330495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:45.330495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:45.330495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:45.330495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:45.330495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:45.330495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:45.330495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:45.330495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:45.330495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:45.330495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:45.331501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:45.331501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:45.331501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:45.331501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:45.331501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:45.331501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:45.331501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:45.331501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:45.331501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:45.331501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:45.331501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:45.331501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:45.331501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:45.331501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:45.331501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:45.331501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:45.331501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:45.332369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:45.332369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:45.332369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:45.332369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:45.332369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 258/507] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:45.332958 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39455917-ebec-4dd2-b4d9-39e1fe40e55c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:45.333239 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39455917-ebec-4dd2-b4d9-39e1fe40e55c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:45.333515 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39455917-ebec-4dd2-b4d9-39e1fe40e55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:45.350023 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-39455917-ebec-4dd2-b4d9-39e1fe40e55c None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:45.351208 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-39455917-ebec-4dd2-b4d9-39e1fe40e55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:45.358866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:45.363008 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a17b09-22e4-4398-9519-47def3696ade None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:45.377960 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:45.396359 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56766bb-652b-4ae8-bc9e-76add1897fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:45.397157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56766bb-652b-4ae8-bc9e-76add1897fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:45.397447 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56766bb-652b-4ae8-bc9e-76add1897fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:45.397815 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56766bb-652b-4ae8-bc9e-76add1897fd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:45.408404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56766bb-652b-4ae8-bc9e-76add1897fd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:45.409924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56766bb-652b-4ae8-bc9e-76add1897fd6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:45.420038 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 259/508] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:45.420966 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39455917-ebec-4dd2-b4d9-39e1fe40e55c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:45.430157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-b56766bb-652b-4ae8-bc9e-76add1897fd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:45.430157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:45.430157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:45.430157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:45.430157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:45.430157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:45.430157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:45.430157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:45.430157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:45.430157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:45.430157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:45.430157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:45.430157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:45.430157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:45.430157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:45.431038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:45.431038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:45.431038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:45.431038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:45.431038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:45.431038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:45.431038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:45.431038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:45.431038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:45.431038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:45.431038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:45.431038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:45.431038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:45.431038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:45.431038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:45.431038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:45.431038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:45.431862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:45.431862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:45.431862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:45.431862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:45.431862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 250/509] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:45.432127 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56766bb-652b-4ae8-bc9e-76add1897fd6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:45.523567 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39455917-ebec-4dd2-b4d9-39e1fe40e55c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:45.531456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56766bb-652b-4ae8-bc9e-76add1897fd6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:45.558023 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a766f-ed98-42ed-9efa-94f59abf7d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:45.558621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a766f-ed98-42ed-9efa-94f59abf7d50 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:45.558918 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a766f-ed98-42ed-9efa-94f59abf7d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:45.559194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a766f-ed98-42ed-9efa-94f59abf7d50 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:45.560441 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a766f-ed98-42ed-9efa-94f59abf7d50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:45.560750 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a766f-ed98-42ed-9efa-94f59abf7d50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:45.562157 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a766f-ed98-42ed-9efa-94f59abf7d50 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:45.564659 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ba86e-eda2-4198-a608-fe55d91a193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:45.565315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ba86e-eda2-4198-a608-fe55d91a193e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:45.565596 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ba86e-eda2-4198-a608-fe55d91a193e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:45.565898 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ba86e-eda2-4198-a608-fe55d91a193e None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:45.566727 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ba86e-eda2-4198-a608-fe55d91a193e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:45.567034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ba86e-eda2-4198-a608-fe55d91a193e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:45.568586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ba86e-eda2-4198-a608-fe55d91a193e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:45.573183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 260/510] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:45.574046 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a766f-ed98-42ed-9efa-94f59abf7d50 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:45.586278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 251/511] 10.222.0.64 () {56 vars in 1137 bytes} [Mon Jul 18 02:16:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:45.587088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ba86e-eda2-4198-a608-fe55d91a193e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:45.598938 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:45.599169 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:45.672599 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a766f-ed98-42ed-9efa-94f59abf7d50 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:45.685279 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ba86e-eda2-4198-a608-fe55d91a193e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:45.705594 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7fb53-f834-42c2-800f-d726bcd59d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:45.706285 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7fb53-f834-42c2-800f-d726bcd59d17 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:45.706570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7fb53-f834-42c2-800f-d726bcd59d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:45.706848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c7fb53-f834-42c2-800f-d726bcd59d17 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:45.707563 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7fb53-f834-42c2-800f-d726bcd59d17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:45.707870 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7fb53-f834-42c2-800f-d726bcd59d17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:45.709264 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c7fb53-f834-42c2-800f-d726bcd59d17 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:45.718915 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733385cf-84a1-4f3d-b726-343ec86ebbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:45.719569 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733385cf-84a1-4f3d-b726-343ec86ebbee None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:45.719849 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733385cf-84a1-4f3d-b726-343ec86ebbee None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:45.720120 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733385cf-84a1-4f3d-b726-343ec86ebbee None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:45.720826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733385cf-84a1-4f3d-b726-343ec86ebbee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:45.721128 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733385cf-84a1-4f3d-b726-343ec86ebbee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:45.722021 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 261/512] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:45.722516 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733385cf-84a1-4f3d-b726-343ec86ebbee None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:45.722801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7fb53-f834-42c2-800f-d726bcd59d17 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:45.736784 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 252/513] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:45.737519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733385cf-84a1-4f3d-b726-343ec86ebbee None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:45.804496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:45.805492 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:45.821064 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c7fb53-f834-42c2-800f-d726bcd59d17 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:45.836795 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733385cf-84a1-4f3d-b726-343ec86ebbee None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:45.854803 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8275fb-05b5-44d2-975b-0d8d8217ce47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:45.855601 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8275fb-05b5-44d2-975b-0d8d8217ce47 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:45.855885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8275fb-05b5-44d2-975b-0d8d8217ce47 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:45.856160 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8275fb-05b5-44d2-975b-0d8d8217ce47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:45.867141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8275fb-05b5-44d2-975b-0d8d8217ce47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:45.868596 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8275fb-05b5-44d2-975b-0d8d8217ce47 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:45.870880 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67689a64-3225-4b82-acdb-34c0eea825bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:45.871681 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67689a64-3225-4b82-acdb-34c0eea825bd None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:45.871968 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67689a64-3225-4b82-acdb-34c0eea825bd None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:45.872813 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67689a64-3225-4b82-acdb-34c0eea825bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:45.879472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67689a64-3225-4b82-acdb-34c0eea825bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:45.880917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67689a64-3225-4b82-acdb-34c0eea825bd None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:45.886074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-cc8275fb-05b5-44d2-975b-0d8d8217ce47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:45.886074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:45.886074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:45.886074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:45.886074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:45.886074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:45.886074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:45.886074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:45.886074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:45.886074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:45.886074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:45.886074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:45.886074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:45.886074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:45.886074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:45.887354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:45.887354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:45.887354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:45.887354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:45.887354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:45.887354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:45.887354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:45.887354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:45.887354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:45.887354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:45.887354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:45.887354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:45.887354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:45.887354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:45.887354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:45.887354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:45.887354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:45.888346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:45.888346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:45.888346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:45.888346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:45.888346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 262/514] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:45.888346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8275fb-05b5-44d2-975b-0d8d8217ce47 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:45.898874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-67689a64-3225-4b82-acdb-34c0eea825bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:16:45.898874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:45.898874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:45.898874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:45.898874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:45.898874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:45.898874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:45.898874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:45.898874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:45.898874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:45.898874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:45.898874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:45.898874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:16:45.898874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:16:45.898874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:16:45.899717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:16:45.899717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:45.899717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:45.899717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:45.899717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:45.899717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:45.899717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:45.899717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:45.899717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:45.899717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:45.899717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:45.899717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:45.899717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:45.899717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:45.899717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:45.899717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:45.899717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:45.900542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:16:45.900542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:16:45.900542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:16:45.900542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:16:45.900542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:16:45.900542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:16:45.900542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:16:45.900542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:45.900542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 253/515] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:16:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:45.901172 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67689a64-3225-4b82-acdb-34c0eea825bd None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:45.989604 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8275fb-05b5-44d2-975b-0d8d8217ce47 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:46.001135 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67689a64-3225-4b82-acdb-34c0eea825bd None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:46.022891 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6fe67-6c5e-468e-903f-805b9592a8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:46.023702 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6fe67-6c5e-468e-903f-805b9592a8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:46.023993 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6fe67-6c5e-468e-903f-805b9592a8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:46.024301 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6fe67-6c5e-468e-903f-805b9592a8f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:46.027070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:46.028947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:46.035494 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8528d-84c4-4674-b465-8257e892cf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:46.036282 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8528d-84c4-4674-b465-8257e892cf9e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:46.036575 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8528d-84c4-4674-b465-8257e892cf9e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:46.036856 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8528d-84c4-4674-b465-8257e892cf9e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:46.043853 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8528d-84c4-4674-b465-8257e892cf9e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:46.045914 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8528d-84c4-4674-b465-8257e892cf9e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:46.060971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-a2a8528d-84c4-4674-b465-8257e892cf9e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 02:16:46.060971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:46.060971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:46.060971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:46.060971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:46.060971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:46.060971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:46.060971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:46.060971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:46.060971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:46.060971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:46.060971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:46.060971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:16:46.060971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:16:46.060971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:16:46.060971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:16:46.061912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:46.061912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:46.061912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:16:46.061912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:46.061912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:16:46.061912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:46.061912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:46.061912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:46.061912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:46.061912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:46.061912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:46.061912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:46.061912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:46.061912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:46.061912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:46.061912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:46.061912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:46.061912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:46.062798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:46.062798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:46.062798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:16:46.062798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:16:46.062798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:16:46.062798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:16:46.062798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:16:46.062798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:16:46.062798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 02:16:46.062798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:46.062798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 254/516] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:16:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:46.064094 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8528d-84c4-4674-b465-8257e892cf9e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:46.095376 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6fe67-6c5e-468e-903f-805b9592a8f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:46.096761 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6fe67-6c5e-468e-903f-805b9592a8f5 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:46.164166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8528d-84c4-4674-b465-8257e892cf9e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:46.194693 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 263/517] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:46.195605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6fe67-6c5e-468e-903f-805b9592a8f5 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:46.202324 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b4d88-9ba3-4d1a-8e02-c19ba8d7f657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:46.203128 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b4d88-9ba3-4d1a-8e02-c19ba8d7f657 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:46.203412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b4d88-9ba3-4d1a-8e02-c19ba8d7f657 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:46.203689 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b4d88-9ba3-4d1a-8e02-c19ba8d7f657 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:46.210812 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b4d88-9ba3-4d1a-8e02-c19ba8d7f657 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:46.212238 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7b4d88-9ba3-4d1a-8e02-c19ba8d7f657 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:46.226917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-7c7b4d88-9ba3-4d1a-8e02-c19ba8d7f657 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 02:16:46.226917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:46.226917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:46.226917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:46.226917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:46.226917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:46.226917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:46.226917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:46.226917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:46.226917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:46.226917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:46.226917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:46.226917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:16:46.226917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:16:46.226917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:16:46.226917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:16:46.227802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:46.227802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:46.227802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:16:46.227802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:46.227802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:16:46.227802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:46.227802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:46.227802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:46.227802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:46.227802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:46.227802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:46.227802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:46.227802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:46.227802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:46.227802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:46.227802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:46.227802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:46.227802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:46.228673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:46.228673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:46.228673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:16:46.228673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:16:46.228673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:16:46.228673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:16:46.228673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:16:46.228673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:16:46.228673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 02:16:46.228673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:46.228673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 255/518] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:46.229216 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b4d88-9ba3-4d1a-8e02-c19ba8d7f657 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:46.230219 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:46.276486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:46.297119 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6fe67-6c5e-468e-903f-805b9592a8f5 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:46.332075 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0529f6a-758e-478d-936c-d06a5c63b907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:46.332747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0529f6a-758e-478d-936c-d06a5c63b907 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:46.333026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0529f6a-758e-478d-936c-d06a5c63b907 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:46.333300 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0529f6a-758e-478d-936c-d06a5c63b907 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:46.334122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0529f6a-758e-478d-936c-d06a5c63b907 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:46.334426 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0529f6a-758e-478d-936c-d06a5c63b907 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:46.335862 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0529f6a-758e-478d-936c-d06a5c63b907 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:46.347676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 264/519] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:46.348397 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0529f6a-758e-478d-936c-d06a5c63b907 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:46.366727 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b4d88-9ba3-4d1a-8e02-c19ba8d7f657 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:46.401980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d3cb4-c372-416a-a95c-e0611d64d85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:46.402645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d3cb4-c372-416a-a95c-e0611d64d85c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:46.402931 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d3cb4-c372-416a-a95c-e0611d64d85c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:46.403210 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d3cb4-c372-416a-a95c-e0611d64d85c None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:46.404566 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d3cb4-c372-416a-a95c-e0611d64d85c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:46.404880 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d3cb4-c372-416a-a95c-e0611d64d85c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:46.406348 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d3cb4-c372-416a-a95c-e0611d64d85c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:46.423958 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 256/520] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:16:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:46.424794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d3cb4-c372-416a-a95c-e0611d64d85c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:46.448214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:46.454678 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0529f6a-758e-478d-936c-d06a5c63b907 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:46.488022 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f0180-4722-4e2b-91ad-b6e822361b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:46.488689 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f0180-4722-4e2b-91ad-b6e822361b49 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:46.488978 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f0180-4722-4e2b-91ad-b6e822361b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:46.489258 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f0180-4722-4e2b-91ad-b6e822361b49 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:46.490163 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f0180-4722-4e2b-91ad-b6e822361b49 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:46.490435 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f0180-4722-4e2b-91ad-b6e822361b49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:46.491874 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f0180-4722-4e2b-91ad-b6e822361b49 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:46.524493 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d3cb4-c372-416a-a95c-e0611d64d85c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:46.527499 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 265/521] 10.222.0.64 () {56 vars in 1139 bytes} [Mon Jul 18 02:16:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:46.528414 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f0180-4722-4e2b-91ad-b6e822361b49 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:46.534127 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:46.558346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb310973-a490-423b-883f-5f12cb304e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:46.559143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb310973-a490-423b-883f-5f12cb304e9f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:46.559427 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb310973-a490-423b-883f-5f12cb304e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:46.559737 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb310973-a490-423b-883f-5f12cb304e9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:46.570486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb310973-a490-423b-883f-5f12cb304e9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:46.571946 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb310973-a490-423b-883f-5f12cb304e9f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:46.589335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-cb310973-a490-423b-883f-5f12cb304e9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:46.589335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:46.589335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:46.589335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:46.589335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:46.589335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:46.589335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:46.589335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:46.589335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:46.589335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:46.589335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:46.589335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:46.589335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:46.589335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:46.589335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:46.590326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:46.590326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:46.590326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:46.590326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:46.590326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:46.590326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:46.590326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:46.590326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:46.590326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:46.590326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:46.590326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:46.590326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:46.590326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:46.590326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:46.590326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:46.590326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:46.590326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:46.591729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:46.591729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:46.591729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:46.591729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:46.591729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 257/522] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:46.591997 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb310973-a490-423b-883f-5f12cb304e9f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:46.642376 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f0180-4722-4e2b-91ad-b6e822361b49 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:46.678167 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc5069-1b3d-4193-abd1-edc6372b4d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:46.678846 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc5069-1b3d-4193-abd1-edc6372b4d19 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:46.679133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc5069-1b3d-4193-abd1-edc6372b4d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:46.679436 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc5069-1b3d-4193-abd1-edc6372b4d19 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:46.680273 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc5069-1b3d-4193-abd1-edc6372b4d19 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:46.680582 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc5069-1b3d-4193-abd1-edc6372b4d19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:46.682059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc5069-1b3d-4193-abd1-edc6372b4d19 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:46.689931 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb310973-a490-423b-883f-5f12cb304e9f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:46.698747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 266/523] 10.222.0.64 () {56 vars in 1137 bytes} [Mon Jul 18 02:16:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:46.699533 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc5069-1b3d-4193-abd1-edc6372b4d19 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:46.713570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:46.726253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e355b6e-9eca-4659-8181-3e30028d3c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:46.726929 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e355b6e-9eca-4659-8181-3e30028d3c62 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:46.727211 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e355b6e-9eca-4659-8181-3e30028d3c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:46.727483 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e355b6e-9eca-4659-8181-3e30028d3c62 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:46.728172 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e355b6e-9eca-4659-8181-3e30028d3c62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:46.729587 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e355b6e-9eca-4659-8181-3e30028d3c62 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:46.796256 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc5069-1b3d-4193-abd1-edc6372b4d19 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:46.801898 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 258/524] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jul 18 02:16:46 2022] POST /identity/v3/users => generated 247 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:16:46.802782 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e355b6e-9eca-4659-8181-3e30028d3c62 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:46.836524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5c396-d7fe-4ffb-afe4-a01bc217efed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:46.837484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5c396-d7fe-4ffb-afe4-a01bc217efed None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:46.837801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5c396-d7fe-4ffb-afe4-a01bc217efed None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:46.838085 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff5c396-d7fe-4ffb-afe4-a01bc217efed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:46.838566 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:46.839117 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5c396-d7fe-4ffb-afe4-a01bc217efed None admin] RBAC: Adding query filter params (role.id=1f864eb92c9545bfb36cb24aff0401e4, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=6f51aae36f0b42868567840fa957ffe9) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:46.839813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5c396-d7fe-4ffb-afe4-a01bc217efed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:46.841257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff5c396-d7fe-4ffb-afe4-a01bc217efed None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:46.857747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 267/525] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:16:46 2022] GET /identity/v3/role_assignments?user.id=6f51aae36f0b42868567840fa957ffe9&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=1f864eb92c9545bfb36cb24aff0401e4 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:46.857747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5c396-d7fe-4ffb-afe4-a01bc217efed None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:46.960163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e355b6e-9eca-4659-8181-3e30028d3c62 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:46.960823 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:46.989607 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff5c396-d7fe-4ffb-afe4-a01bc217efed None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:47.011510 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62bf10-4d73-4346-ac17-7044903949b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:47.011510 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62bf10-4d73-4346-ac17-7044903949b0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:47.011510 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62bf10-4d73-4346-ac17-7044903949b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:47.011510 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62bf10-4d73-4346-ac17-7044903949b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:47.034551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff49c6-cc0d-42f4-afc5-431f832098ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:47.035240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff49c6-cc0d-42f4-afc5-431f832098ef None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:47.035897 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff49c6-cc0d-42f4-afc5-431f832098ef None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:47.036180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ff49c6-cc0d-42f4-afc5-431f832098ef None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:47.036980 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff49c6-cc0d-42f4-afc5-431f832098ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:47.037295 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff49c6-cc0d-42f4-afc5-431f832098ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:47.038732 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ff49c6-cc0d-42f4-afc5-431f832098ef None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:47.052388 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 268/526] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:47.053238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff49c6-cc0d-42f4-afc5-431f832098ef None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:47.099085 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62bf10-4d73-4346-ac17-7044903949b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:47.100574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62bf10-4d73-4346-ac17-7044903949b0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:47.123601 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:47.184119 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ff49c6-cc0d-42f4-afc5-431f832098ef None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:47.223632 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c7402-47ca-4a19-b72c-ea0ffcc0476a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:47.224786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c7402-47ca-4a19-b72c-ea0ffcc0476a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:47.225264 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c7402-47ca-4a19-b72c-ea0ffcc0476a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:47.225784 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c7402-47ca-4a19-b72c-ea0ffcc0476a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:47.230785 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:47.245993 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 259/527] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:47.247230 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62bf10-4d73-4346-ac17-7044903949b0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:47.306836 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c7402-47ca-4a19-b72c-ea0ffcc0476a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:47.308368 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c7402-47ca-4a19-b72c-ea0ffcc0476a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:47.381822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62bf10-4d73-4346-ac17-7044903949b0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:47.400793 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:47.412559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 269/528] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:47.413408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c7402-47ca-4a19-b72c-ea0ffcc0476a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:47.421376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82757f40-d500-412b-94fe-ddad825ddf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:47.422510 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82757f40-d500-412b-94fe-ddad825ddf75 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:47.423014 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82757f40-d500-412b-94fe-ddad825ddf75 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:47.423485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82757f40-d500-412b-94fe-ddad825ddf75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:47.431521 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82757f40-d500-412b-94fe-ddad825ddf75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:47.433530 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82757f40-d500-412b-94fe-ddad825ddf75 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:47.448025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-82757f40-d500-412b-94fe-ddad825ddf75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:16:47.448025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:47.448025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:47.448025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:47.448025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:47.448025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:47.448025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:47.448025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:47.448025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:47.448025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:47.448025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:47.448025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:47.448025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:16:47.448025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:16:47.448025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:16:47.448870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:16:47.448870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:47.448870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:47.448870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:47.448870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:47.448870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:47.448870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:47.448870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:47.448870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:47.448870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:47.448870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:47.448870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:47.448870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:47.448870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:47.448870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:47.448870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:47.448870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:47.449726 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:16:47.449726 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:16:47.449726 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:16:47.449726 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:16:47.449726 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:16:47.449726 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:16:47.449726 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:16:47.449726 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:47.450907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:47.452599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 260/529] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:16:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:47.453312 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82757f40-d500-412b-94fe-ddad825ddf75 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:47.521075 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c7402-47ca-4a19-b72c-ea0ffcc0476a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:47.563818 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82757f40-d500-412b-94fe-ddad825ddf75 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:47.565917 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a66a77-ebfa-4516-b39f-987faa1e7f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:47.567623 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a66a77-ebfa-4516-b39f-987faa1e7f5b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:47.567917 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a66a77-ebfa-4516-b39f-987faa1e7f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:47.568198 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a66a77-ebfa-4516-b39f-987faa1e7f5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:47.582081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a66a77-ebfa-4516-b39f-987faa1e7f5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:47.583838 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a66a77-ebfa-4516-b39f-987faa1e7f5b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:47.604575 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7079b5b-0c9b-4d59-b706-a57436c14889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:47.605526 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7079b5b-0c9b-4d59-b706-a57436c14889 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:47.605950 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7079b5b-0c9b-4d59-b706-a57436c14889 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:47.606332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-a1a66a77-ebfa-4516-b39f-987faa1e7f5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:47.606332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:47.606332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:47.606332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:47.606332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:47.606332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:47.606332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:47.606332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:47.606332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:47.606332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:47.606332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:47.606332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:47.606332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:47.606332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:47.606332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:47.607268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:47.607268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:47.607268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:47.607268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:47.607268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:47.607268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:47.607268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:47.607268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:47.607268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:47.607268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:47.607268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:47.607268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:47.607268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:47.607268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:47.607268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:47.607268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:47.607268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:47.608102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:47.608102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:47.608102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:47.608102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:47.608336 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7079b5b-0c9b-4d59-b706-a57436c14889 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:47.608406 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 270/530] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:47.612748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a66a77-ebfa-4516-b39f-987faa1e7f5b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:47.627081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7079b5b-0c9b-4d59-b706-a57436c14889 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:47.629640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7079b5b-0c9b-4d59-b706-a57436c14889 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:47.653822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-c7079b5b-0c9b-4d59-b706-a57436c14889 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:47.653822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:47.653822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:47.653822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:47.653822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:47.653822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:47.653822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:47.653822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:47.653822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:47.653822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:47.653822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:47.653822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:47.653822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:47.653822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:47.653822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:47.655495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:47.655495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:47.655495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:47.655495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:47.655495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:47.655495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:47.655495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:47.655495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:47.655495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:47.655495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:47.655495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:47.655495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:47.655495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:47.655495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:47.655495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:47.655495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:47.655495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:47.657097 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:47.657097 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:47.657097 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:47.657097 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:47.661199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 261/531] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:47.662212 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7079b5b-0c9b-4d59-b706-a57436c14889 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:47.699112 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:47.715501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:47.728112 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a66a77-ebfa-4516-b39f-987faa1e7f5b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:47.763722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709823b7-a98e-4ca7-9a49-46277cc6f2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:47.764582 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709823b7-a98e-4ca7-9a49-46277cc6f2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:47.765207 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709823b7-a98e-4ca7-9a49-46277cc6f2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:47.765495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709823b7-a98e-4ca7-9a49-46277cc6f2e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:47.766314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709823b7-a98e-4ca7-9a49-46277cc6f2e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:47.766624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709823b7-a98e-4ca7-9a49-46277cc6f2e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:47.768075 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709823b7-a98e-4ca7-9a49-46277cc6f2e5 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:47.777062 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7079b5b-0c9b-4d59-b706-a57436c14889 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:47.786015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 271/532] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:16:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:47.786835 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709823b7-a98e-4ca7-9a49-46277cc6f2e5 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:47.814397 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8791b2-41c0-42e6-8beb-dcc0e8214ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:47.815277 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8791b2-41c0-42e6-8beb-dcc0e8214ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:47.815709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8791b2-41c0-42e6-8beb-dcc0e8214ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:47.816202 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8791b2-41c0-42e6-8beb-dcc0e8214ee2 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:47.817063 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8791b2-41c0-42e6-8beb-dcc0e8214ee2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:47.817556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8791b2-41c0-42e6-8beb-dcc0e8214ee2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:47.819158 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8791b2-41c0-42e6-8beb-dcc0e8214ee2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:47.831591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 262/533] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:47.832728 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8791b2-41c0-42e6-8beb-dcc0e8214ee2 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:47.890994 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709823b7-a98e-4ca7-9a49-46277cc6f2e5 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:47.927109 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:47.931763 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0053ad-9862-461f-9766-4bfeadfa955f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:47.932511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0053ad-9862-461f-9766-4bfeadfa955f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:47.932879 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0053ad-9862-461f-9766-4bfeadfa955f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:47.933282 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0053ad-9862-461f-9766-4bfeadfa955f None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:47.934044 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0053ad-9862-461f-9766-4bfeadfa955f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:47.934475 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0053ad-9862-461f-9766-4bfeadfa955f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:47.936012 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0053ad-9862-461f-9766-4bfeadfa955f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:47.941807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8791b2-41c0-42e6-8beb-dcc0e8214ee2 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:47.952366 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 272/534] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:47.953238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0053ad-9862-461f-9766-4bfeadfa955f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:47.968689 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:47.983203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75690e26-3500-469f-aebc-da28a6259ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:47.984202 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75690e26-3500-469f-aebc-da28a6259ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:47.984714 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75690e26-3500-469f-aebc-da28a6259ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:47.985193 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75690e26-3500-469f-aebc-da28a6259ed1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:47.986263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75690e26-3500-469f-aebc-da28a6259ed1 None admin] RBAC: Adding query filter params (role.id=1f864eb92c9545bfb36cb24aff0401e4, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=bdb0a04d568e4b14b07cd6d6092bc49f) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:47.986781 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75690e26-3500-469f-aebc-da28a6259ed1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:47.988416 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75690e26-3500-469f-aebc-da28a6259ed1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:47.994943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 263/535] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:16:47 2022] GET /identity/v3/role_assignments?user.id=bdb0a04d568e4b14b07cd6d6092bc49f&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=1f864eb92c9545bfb36cb24aff0401e4 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:47.996116 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75690e26-3500-469f-aebc-da28a6259ed1 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:48.074731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0053ad-9862-461f-9766-4bfeadfa955f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:48.113566 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c821ec2-409d-4e80-b501-c15588df91df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:48.114436 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c821ec2-409d-4e80-b501-c15588df91df None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:48.114722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c821ec2-409d-4e80-b501-c15588df91df None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:48.115000 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c821ec2-409d-4e80-b501-c15588df91df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:48.115880 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75690e26-3500-469f-aebc-da28a6259ed1 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:48.122369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c821ec2-409d-4e80-b501-c15588df91df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:48.123844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c821ec2-409d-4e80-b501-c15588df91df None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:48.141605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-0c821ec2-409d-4e80-b501-c15588df91df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:16:48.141605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:48.141605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:48.141605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:48.141605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:48.141605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:48.141605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:48.141605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:48.141605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:48.141605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:48.141605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:48.141605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:48.141605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:16:48.141605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:16:48.141605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:16:48.142591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:16:48.142591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:48.142591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:48.142591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:48.142591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:48.142591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:48.142591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:48.142591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:48.142591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:48.142591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:48.142591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:48.142591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:48.142591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:48.142591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:48.142591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:48.142591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:48.142591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:48.143461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:16:48.143461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:16:48.143461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:16:48.143461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:16:48.143461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:16:48.143461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:16:48.143461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:16:48.143461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:48.144937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 273/536] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:16:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:48.150783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c821ec2-409d-4e80-b501-c15588df91df None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:48.177767 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f08a01-526c-45cd-94cb-f4b390569026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:48.178978 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f08a01-526c-45cd-94cb-f4b390569026 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:48.179502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f08a01-526c-45cd-94cb-f4b390569026 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:48.179981 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f08a01-526c-45cd-94cb-f4b390569026 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:48.193141 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f08a01-526c-45cd-94cb-f4b390569026 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:48.195500 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f08a01-526c-45cd-94cb-f4b390569026 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:48.235293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-49f08a01-526c-45cd-94cb-f4b390569026 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:16:48.235293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:48.235293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:48.235293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:48.235293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:48.235293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:48.235293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:48.235293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:48.235293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:48.235293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:48.235293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:48.235293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:48.235293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:16:48.235293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:16:48.235293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:16:48.236222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:16:48.236222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:48.236222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:48.236222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:48.236222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:48.236222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:48.236222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:48.236222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:48.236222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:48.236222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:48.236222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:48.236222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:48.236222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:48.236222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:48.236222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:48.236222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:48.236222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:48.237051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:16:48.237051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:16:48.237051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:16:48.237051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:16:48.237051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:16:48.237051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:16:48.237051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:16:48.237051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:48.237447 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 264/537] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:16:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:48.244409 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f08a01-526c-45cd-94cb-f4b390569026 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:48.256904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:48.264493 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:48.298541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c821ec2-409d-4e80-b501-c15588df91df None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:48.358023 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072437c3-a5fe-448a-b186-1116094f34f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:48.358618 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072437c3-a5fe-448a-b186-1116094f34f7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:48.358906 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072437c3-a5fe-448a-b186-1116094f34f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:48.359181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072437c3-a5fe-448a-b186-1116094f34f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:48.359982 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072437c3-a5fe-448a-b186-1116094f34f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:48.360295 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072437c3-a5fe-448a-b186-1116094f34f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:48.361755 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072437c3-a5fe-448a-b186-1116094f34f7 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:48.389887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 274/538] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:16:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:48.395116 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f08a01-526c-45cd-94cb-f4b390569026 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:48.397468 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072437c3-a5fe-448a-b186-1116094f34f7 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:48.443328 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a594621-2edf-414f-9110-cd363759e52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:48.444002 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a594621-2edf-414f-9110-cd363759e52f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:48.444291 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a594621-2edf-414f-9110-cd363759e52f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:48.444576 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a594621-2edf-414f-9110-cd363759e52f None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:48.445368 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a594621-2edf-414f-9110-cd363759e52f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:48.445685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a594621-2edf-414f-9110-cd363759e52f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:48.449727 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a594621-2edf-414f-9110-cd363759e52f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:48.461141 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 265/539] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:16:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:48.467656 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a594621-2edf-414f-9110-cd363759e52f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:48.565862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:48.596985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a594621-2edf-414f-9110-cd363759e52f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:48.622301 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072437c3-a5fe-448a-b186-1116094f34f7 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:48.664619 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4848ea1-4069-42b0-b604-610946cc2a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:48.665289 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4848ea1-4069-42b0-b604-610946cc2a0a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:48.665577 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4848ea1-4069-42b0-b604-610946cc2a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:48.665885 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4848ea1-4069-42b0-b604-610946cc2a0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:48.666727 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4848ea1-4069-42b0-b604-610946cc2a0a None admin] RBAC: Adding query filter params (role.id=1f864eb92c9545bfb36cb24aff0401e4, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=b8948dc6a55344eaa85e2a6092215ec6) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:48.667044 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4848ea1-4069-42b0-b604-610946cc2a0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:48.668481 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4848ea1-4069-42b0-b604-610946cc2a0a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:48.676070 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:48.683668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 266/540] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:16:48 2022] GET /identity/v3/role_assignments?user.id=b8948dc6a55344eaa85e2a6092215ec6&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=1f864eb92c9545bfb36cb24aff0401e4 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:48.691651 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30134c9d-91ff-497e-9d2e-85fa31275005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:48.692785 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30134c9d-91ff-497e-9d2e-85fa31275005 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:48.693286 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30134c9d-91ff-497e-9d2e-85fa31275005 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:48.693799 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30134c9d-91ff-497e-9d2e-85fa31275005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:48.694897 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30134c9d-91ff-497e-9d2e-85fa31275005 None admin] RBAC: Adding query filter params (role.id=1f864eb92c9545bfb36cb24aff0401e4, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=fa9e6d3fe3e740e6aedab33d727ec478) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:48.695458 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30134c9d-91ff-497e-9d2e-85fa31275005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:48.697181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30134c9d-91ff-497e-9d2e-85fa31275005 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:48.712310 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 275/541] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:16:48 2022] GET /identity/v3/role_assignments?user.id=fa9e6d3fe3e740e6aedab33d727ec478&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=1f864eb92c9545bfb36cb24aff0401e4 => generated 259 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:49.079496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfc31b-4cb4-430e-aa07-0b57e774d6cc None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:49.079833 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfc31b-4cb4-430e-aa07-0b57e774d6cc None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:49.080010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cfc31b-4cb4-430e-aa07-0b57e774d6cc None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:49.081769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 267/542] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:49.086774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ad8ee-e384-4798-ac71-80fc160e9fe5 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:49.087229 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e335ee-71bc-422b-b198-b0cb11203a5f None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:49.087229 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e335ee-71bc-422b-b198-b0cb11203a5f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:49.087515 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e335ee-71bc-422b-b198-b0cb11203a5f None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:49.088001 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ad8ee-e384-4798-ac71-80fc160e9fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:49.088473 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ad8ee-e384-4798-ac71-80fc160e9fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:49.089012 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 268/543] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:49.094029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b2c87-2f58-49cd-a5ed-8eeac7325425 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:49.094322 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b2c87-2f58-49cd-a5ed-8eeac7325425 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:49.094605 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b2c87-2f58-49cd-a5ed-8eeac7325425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:49.113728 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f21b2c87-2f58-49cd-a5ed-8eeac7325425 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:49.113728 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f21b2c87-2f58-49cd-a5ed-8eeac7325425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:49.115092 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-743ad8ee-e384-4798-ac71-80fc160e9fe5 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:49.116512 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-743ad8ee-e384-4798-ac71-80fc160e9fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:49.199361 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 269/544] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:16:49.209538 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 276/545] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:49.240380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b2c87-2f58-49cd-a5ed-8eeac7325425 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:49.248214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ad8ee-e384-4798-ac71-80fc160e9fe5 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:49.373446 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:49.379648 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ad8ee-e384-4798-ac71-80fc160e9fe5 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:49.415039 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b2c87-2f58-49cd-a5ed-8eeac7325425 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:49.427768 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:49.449050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28072a1-f7a9-4d32-b43a-327d57fd9370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:49.450427 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28072a1-f7a9-4d32-b43a-327d57fd9370 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:49.450737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28072a1-f7a9-4d32-b43a-327d57fd9370 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:49.451009 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28072a1-f7a9-4d32-b43a-327d57fd9370 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:49.471839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28072a1-f7a9-4d32-b43a-327d57fd9370 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:49.480813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-d28072a1-f7a9-4d32-b43a-327d57fd9370 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:49.480813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:49.480813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:49.480813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:49.480813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:49.480813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:49.480813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:49.480813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:49.480813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:49.480813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:49.480813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:49.480813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:49.480813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:49.480813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:49.480813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:49.480813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:49.481779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:49.481779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:49.481779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:49.481779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:49.481779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:49.481779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:49.481779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:49.481779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:49.481779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:49.481779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:49.481779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:49.481779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:49.481779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:49.481779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:49.481779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:49.481779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:49.482559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:49.482559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:49.482559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:49.482559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:49.482559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:49.482559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:49.482559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:49.482559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:49.482559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:49.482559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:49.482559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:49.482559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:49.484187 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 277/546] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:16:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:16:49.489236 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28072a1-f7a9-4d32-b43a-327d57fd9370 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:49.491225 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7cfbd-5d14-43aa-9749-2d64cbe91917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:49.492053 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7cfbd-5d14-43aa-9749-2d64cbe91917 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:49.492342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7cfbd-5d14-43aa-9749-2d64cbe91917 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:49.492619 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d7cfbd-5d14-43aa-9749-2d64cbe91917 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:49.513448 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d7cfbd-5d14-43aa-9749-2d64cbe91917 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:49.532475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-72d7cfbd-5d14-43aa-9749-2d64cbe91917 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:49.532475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:49.532475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:49.532475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:49.532475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:49.532475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:49.532475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:49.532475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:49.532475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:49.532475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:49.532475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:49.532475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:49.532475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:49.532475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:49.532475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:49.532475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:49.533431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:49.533431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:49.533431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:49.533431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:49.533431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:49.533431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:49.533431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:49.533431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:49.533431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:49.533431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:49.533431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:49.533431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:49.533431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:49.533431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:49.533431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:49.533431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:49.534325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:49.534325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:49.534325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:49.534325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:49.534325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:49.534325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:49.534325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:49.534325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:49.534325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:49.534325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:49.534325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:49.534325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:49.534325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 270/547] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:16:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:49.542996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7cfbd-5d14-43aa-9749-2d64cbe91917 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:49.655999 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28072a1-f7a9-4d32-b43a-327d57fd9370 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:49.716248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d7cfbd-5d14-43aa-9749-2d64cbe91917 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:49.720268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f0022-dbfb-495f-9ac5-6789e355f827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:49.721238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f0022-dbfb-495f-9ac5-6789e355f827 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:49.721730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f0022-dbfb-495f-9ac5-6789e355f827 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:49.722186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f0022-dbfb-495f-9ac5-6789e355f827 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:49.723167 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f0022-dbfb-495f-9ac5-6789e355f827 None admin] RBAC: Adding query filter params (name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:49.723662 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f0022-dbfb-495f-9ac5-6789e355f827 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:49.725275 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f0022-dbfb-495f-9ac5-6789e355f827 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:49.751797 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 278/548] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jul 18 02:16:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:49.752892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f0022-dbfb-495f-9ac5-6789e355f827 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:49.779397 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:49.783704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d2cfa-6156-4257-a7f6-e604fdc69722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:49.784594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d2cfa-6156-4257-a7f6-e604fdc69722 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:49.784883 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d2cfa-6156-4257-a7f6-e604fdc69722 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:49.785168 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1d2cfa-6156-4257-a7f6-e604fdc69722 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:49.785949 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d2cfa-6156-4257-a7f6-e604fdc69722 None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:49.786263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d2cfa-6156-4257-a7f6-e604fdc69722 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:49.788939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1d2cfa-6156-4257-a7f6-e604fdc69722 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:49.806545 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 271/549] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jul 18 02:16:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:49.810298 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d2cfa-6156-4257-a7f6-e604fdc69722 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:49.836866 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:49.936924 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f0022-dbfb-495f-9ac5-6789e355f827 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:49.994747 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1d2cfa-6156-4257-a7f6-e604fdc69722 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:50.009594 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32970c-96f6-4f06-93a1-07b15e2f3d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:50.010453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32970c-96f6-4f06-93a1-07b15e2f3d27 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:50.010742 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32970c-96f6-4f06-93a1-07b15e2f3d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:50.011019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32970c-96f6-4f06-93a1-07b15e2f3d27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:50.031815 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32970c-96f6-4f06-93a1-07b15e2f3d27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:50.033643 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32970c-96f6-4f06-93a1-07b15e2f3d27 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:50.045955 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98055b8-88fb-4048-bd6c-3cbd365b8c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:50.046777 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98055b8-88fb-4048-bd6c-3cbd365b8c05 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:50.047062 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98055b8-88fb-4048-bd6c-3cbd365b8c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:50.047341 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98055b8-88fb-4048-bd6c-3cbd365b8c05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:50.059908 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98055b8-88fb-4048-bd6c-3cbd365b8c05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:50.061404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98055b8-88fb-4048-bd6c-3cbd365b8c05 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:50.073886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-4a32970c-96f6-4f06-93a1-07b15e2f3d27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:50.073886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:50.073886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:50.073886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:50.073886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:50.073886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:50.073886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:50.073886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:50.073886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:50.073886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:50.073886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:50.073886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:50.073886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:50.073886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:50.073886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:50.075579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:50.075579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:50.075579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:50.075579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:50.075579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:50.075579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:50.075579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:50.075579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:50.075579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:50.075579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:50.075579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:50.075579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:50.075579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:50.075579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:50.075579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:50.075579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:50.075579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:50.076434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:50.076434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:50.076434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:50.076434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:50.078058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 279/550] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:50.080924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-d98055b8-88fb-4048-bd6c-3cbd365b8c05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:50.080924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:50.080924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:50.080924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:50.080924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:50.080924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:50.080924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:50.080924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:50.080924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:50.080924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:50.080924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:50.080924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:50.080924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:50.080924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:50.080924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:50.081892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:50.081892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:50.081892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:50.081892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:50.081892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:50.081892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:50.081892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:50.081892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:50.081892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:50.081892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:50.081892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:50.081892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:50.081892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:50.081892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:50.081892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:50.081892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:50.081892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:50.082744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:50.082744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:50.082744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:50.082744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:50.085333 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 272/551] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:50.086314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32970c-96f6-4f06-93a1-07b15e2f3d27 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:50.091410 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98055b8-88fb-4048-bd6c-3cbd365b8c05 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:50.166141 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:50.236516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:50.247643 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32970c-96f6-4f06-93a1-07b15e2f3d27 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:50.280775 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98055b8-88fb-4048-bd6c-3cbd365b8c05 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:50.290193 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8cb19-4202-4163-99f4-f9b00b88dbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:50.290940 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8cb19-4202-4163-99f4-f9b00b88dbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:50.291298 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8cb19-4202-4163-99f4-f9b00b88dbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:50.291586 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8cb19-4202-4163-99f4-f9b00b88dbe8 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:50.292314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8cb19-4202-4163-99f4-f9b00b88dbe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:50.292623 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8cb19-4202-4163-99f4-f9b00b88dbe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:50.294661 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8cb19-4202-4163-99f4-f9b00b88dbe8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:50.314103 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 280/552] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:50.315096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8cb19-4202-4163-99f4-f9b00b88dbe8 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:50.342435 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46daba7c-8cf0-4a21-9745-3ec3c74629e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:50.343133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46daba7c-8cf0-4a21-9745-3ec3c74629e0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:50.343420 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46daba7c-8cf0-4a21-9745-3ec3c74629e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:50.343700 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46daba7c-8cf0-4a21-9745-3ec3c74629e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:50.344495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46daba7c-8cf0-4a21-9745-3ec3c74629e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:50.344804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46daba7c-8cf0-4a21-9745-3ec3c74629e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:50.346336 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46daba7c-8cf0-4a21-9745-3ec3c74629e0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:50.360129 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 273/553] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:50.370700 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46daba7c-8cf0-4a21-9745-3ec3c74629e0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:50.462972 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8cb19-4202-4163-99f4-f9b00b88dbe8 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:50.525725 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46daba7c-8cf0-4a21-9745-3ec3c74629e0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:50.538687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ed024-7e49-434c-a35d-20188533dca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:50.539487 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ed024-7e49-434c-a35d-20188533dca2 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:50.539768 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ed024-7e49-434c-a35d-20188533dca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:50.540044 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ed024-7e49-434c-a35d-20188533dca2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:50.543514 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:50.551616 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ed024-7e49-434c-a35d-20188533dca2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:50.553154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ed024-7e49-434c-a35d-20188533dca2 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:50.579509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-e46ed024-7e49-434c-a35d-20188533dca2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 02:16:50.579509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:50.579509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:50.579509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:50.579509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:50.579509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:50.579509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:50.579509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:50.579509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:50.579509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:50.579509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:50.579509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:50.579509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:16:50.579509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:16:50.579509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:16:50.579509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:16:50.581786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:50.581786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:50.581786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:16:50.581786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:50.581786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:16:50.581786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:50.581786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:50.581786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:50.581786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:50.581786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:50.581786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:50.581786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:50.581786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:50.581786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:50.581786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:50.581786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:50.581786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:50.581786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:50.584169 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:50.584169 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:50.584169 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:16:50.584169 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:16:50.584169 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:16:50.584169 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:16:50.584169 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:16:50.584169 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:16:50.584169 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 02:16:50.584169 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:50.584169 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 281/554] 10.222.0.64 () {56 vars in 1093 bytes} [Mon Jul 18 02:16:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:50.584169 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b504687-b1ad-4bea-8254-06d299549dca None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:50.584169 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b504687-b1ad-4bea-8254-06d299549dca None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:50.588783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b504687-b1ad-4bea-8254-06d299549dca None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:50.588783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 282/555] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:50.589049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b504687-b1ad-4bea-8254-06d299549dca None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:50.597044 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea01d7-97ac-4e90-9990-873dc169e9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:50.598194 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea01d7-97ac-4e90-9990-873dc169e9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:50.599231 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea01d7-97ac-4e90-9990-873dc169e9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:50.599742 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea01d7-97ac-4e90-9990-873dc169e9e7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:50.608532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:50.611677 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea01d7-97ac-4e90-9990-873dc169e9e7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:50.614259 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea01d7-97ac-4e90-9990-873dc169e9e7 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:50.636177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-f2ea01d7-97ac-4e90-9990-873dc169e9e7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 02:16:50.636177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:50.636177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:50.636177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:50.636177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:50.636177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:50.636177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:50.636177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:50.636177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:50.636177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:50.636177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:50.636177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:50.636177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:16:50.636177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:16:50.636177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:16:50.636177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:16:50.637185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:50.637185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:50.637185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:16:50.637185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:50.637185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:16:50.637185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:50.637185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:50.637185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:50.637185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:50.637185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:50.637185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:50.637185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:50.637185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:50.637185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:50.637185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:50.637185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:50.637185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:50.637185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:50.639729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:50.639729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:50.639729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:16:50.639729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:16:50.639729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:16:50.639729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:16:50.639729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:16:50.639729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:16:50.639729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 02:16:50.639729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:50.642454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 274/556] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:16:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:50.644040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d96dd-85c6-4d36-8be9-93fea3590472 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:50.644536 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d96dd-85c6-4d36-8be9-93fea3590472 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:50.645094 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d96dd-85c6-4d36-8be9-93fea3590472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:50.664515 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d70d96dd-85c6-4d36-8be9-93fea3590472 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:50.665728 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d70d96dd-85c6-4d36-8be9-93fea3590472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:50.709250 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b504687-b1ad-4bea-8254-06d299549dca None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:50.739601 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 275/557] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:50.740535 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d96dd-85c6-4d36-8be9-93fea3590472 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:50.758003 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75411ebf-77ea-4607-904d-c9e322a90b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:50.758812 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75411ebf-77ea-4607-904d-c9e322a90b77 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:50.759160 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75411ebf-77ea-4607-904d-c9e322a90b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:50.759541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75411ebf-77ea-4607-904d-c9e322a90b77 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:50.760450 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75411ebf-77ea-4607-904d-c9e322a90b77 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:50.760874 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75411ebf-77ea-4607-904d-c9e322a90b77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:50.763147 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75411ebf-77ea-4607-904d-c9e322a90b77 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:50.793521 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 283/558] 10.222.0.64 () {56 vars in 1133 bytes} [Mon Jul 18 02:16:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:50.794576 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75411ebf-77ea-4607-904d-c9e322a90b77 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:50.841365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:50.851590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d96dd-85c6-4d36-8be9-93fea3590472 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:50.873511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:50.888670 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36488c-45c5-489f-be1a-a798cc9abda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:50.889357 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36488c-45c5-489f-be1a-a798cc9abda9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:50.889648 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36488c-45c5-489f-be1a-a798cc9abda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:50.889960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36488c-45c5-489f-be1a-a798cc9abda9 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:50.890897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36488c-45c5-489f-be1a-a798cc9abda9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:50.891214 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36488c-45c5-489f-be1a-a798cc9abda9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:50.892735 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36488c-45c5-489f-be1a-a798cc9abda9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:50.899259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75411ebf-77ea-4607-904d-c9e322a90b77 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:50.911740 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 276/559] 10.222.0.64 () {56 vars in 1135 bytes} [Mon Jul 18 02:16:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:50.912700 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36488c-45c5-489f-be1a-a798cc9abda9 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:50.939978 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fec9b-1885-463b-bd0d-d85c56b9fafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:50.940842 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fec9b-1885-463b-bd0d-d85c56b9fafd None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:50.941122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fec9b-1885-463b-bd0d-d85c56b9fafd None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:50.941445 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fec9b-1885-463b-bd0d-d85c56b9fafd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:50.953111 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fec9b-1885-463b-bd0d-d85c56b9fafd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:50.961384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-811fec9b-1885-463b-bd0d-d85c56b9fafd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:50.961384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:50.961384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:50.961384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:50.961384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:50.961384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:50.961384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:50.961384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:50.961384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:50.961384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:50.961384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:50.961384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:50.961384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:50.961384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:50.961384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:50.961384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:50.962347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:50.962347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:50.962347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:50.962347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:50.962347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:50.962347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:50.962347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:50.962347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:50.962347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:50.962347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:50.962347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:50.962347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:50.962347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:50.962347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:50.962347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:50.962347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:50.963579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:50.963579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:50.963579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:50.963579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:50.963579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:50.963579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:50.963579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:50.963579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:50.963579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:50.963579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:50.963579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:50.963579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:50.963579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 284/560] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:16:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:50.964857 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fec9b-1885-463b-bd0d-d85c56b9fafd None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:51.029001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36488c-45c5-489f-be1a-a798cc9abda9 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:51.081622 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e51de-cc6f-48c2-8277-5f1b62614fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:51.082455 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e51de-cc6f-48c2-8277-5f1b62614fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:51.082742 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e51de-cc6f-48c2-8277-5f1b62614fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:51.083026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e51de-cc6f-48c2-8277-5f1b62614fc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:51.088178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fec9b-1885-463b-bd0d-d85c56b9fafd None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:51.094149 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e51de-cc6f-48c2-8277-5f1b62614fc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:51.095830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6e51de-cc6f-48c2-8277-5f1b62614fc8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:51.104895 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:51.115503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-ef6e51de-cc6f-48c2-8277-5f1b62614fc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:51.115503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:51.115503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:51.115503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:51.115503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:51.115503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:51.115503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:51.115503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:51.115503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:51.115503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:51.115503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:51.115503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:51.115503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:51.115503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:51.115503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:51.117033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:51.117033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:51.117033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:51.117033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:51.117033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:51.117033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:51.117033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:51.117033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:51.117033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:51.117033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:51.117033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:51.117033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:51.117033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:51.117033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:51.117033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:51.117033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:51.117033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:51.117962 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:51.117962 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:51.117962 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:51.117962 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:51.117962 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 277/561] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:51.118232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d350a8-f40e-436d-bb0f-b063e7cb77fa None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:51.118698 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d350a8-f40e-436d-bb0f-b063e7cb77fa None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:51.118698 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d350a8-f40e-436d-bb0f-b063e7cb77fa None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:51.121832 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 278/562] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:51.124848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d350a8-f40e-436d-bb0f-b063e7cb77fa None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:51.133547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2da2e6-404a-4441-9c7c-4526950aaf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:51.134263 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2da2e6-404a-4441-9c7c-4526950aaf1e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:51.134552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2da2e6-404a-4441-9c7c-4526950aaf1e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:51.135238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2da2e6-404a-4441-9c7c-4526950aaf1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:51.137846 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:51.210193 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2da2e6-404a-4441-9c7c-4526950aaf1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:51.211780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2da2e6-404a-4441-9c7c-4526950aaf1e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:51.232820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d350a8-f40e-436d-bb0f-b063e7cb77fa None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:51.265803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42585461-b159-424d-9818-32f6f5149248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:51.266464 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42585461-b159-424d-9818-32f6f5149248 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:51.266750 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42585461-b159-424d-9818-32f6f5149248 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:51.267022 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42585461-b159-424d-9818-32f6f5149248 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:51.267760 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42585461-b159-424d-9818-32f6f5149248 None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:51.268064 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42585461-b159-424d-9818-32f6f5149248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:51.269418 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42585461-b159-424d-9818-32f6f5149248 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:51.277604 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 279/563] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jul 18 02:16:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:51.279002 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42585461-b159-424d-9818-32f6f5149248 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:51.313382 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 285/564] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:51.314782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05a639-9eff-4887-9646-1af396a67f4f None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:51.315073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05a639-9eff-4887-9646-1af396a67f4f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:51.315354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f05a639-9eff-4887-9646-1af396a67f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:51.331010 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-8f05a639-9eff-4887-9646-1af396a67f4f None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:51.332272 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8f05a639-9eff-4887-9646-1af396a67f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:51.344911 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:51.360084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:51.385564 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42585461-b159-424d-9818-32f6f5149248 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:51.398938 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 286/565] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:51.400241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4813a2-1231-4d13-ba4a-22274325c38b None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:51.400529 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4813a2-1231-4d13-ba4a-22274325c38b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:51.400803 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4813a2-1231-4d13-ba4a-22274325c38b None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:51.402352 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 287/566] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:51.403554 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4813a2-1231-4d13-ba4a-22274325c38b None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:51.427261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf2016-fc0a-4f80-8238-48beb032a0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:51.431106 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf2016-fc0a-4f80-8238-48beb032a0da None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:51.431106 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf2016-fc0a-4f80-8238-48beb032a0da None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:51.431106 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf2016-fc0a-4f80-8238-48beb032a0da None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:51.431106 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf2016-fc0a-4f80-8238-48beb032a0da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:51.431106 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf2016-fc0a-4f80-8238-48beb032a0da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:51.431106 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebf2016-fc0a-4f80-8238-48beb032a0da None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:51.442949 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 280/567] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:51.444312 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf2016-fc0a-4f80-8238-48beb032a0da None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:51.510611 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4813a2-1231-4d13-ba4a-22274325c38b None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:51.543754 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf2016-fc0a-4f80-8238-48beb032a0da None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:51.544367 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c57364-5445-422b-b561-578e0b932aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:51.545161 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c57364-5445-422b-b561-578e0b932aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:51.545443 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c57364-5445-422b-b561-578e0b932aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:51.545739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c57364-5445-422b-b561-578e0b932aa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:51.555781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c57364-5445-422b-b561-578e0b932aa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:51.557245 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c57364-5445-422b-b561-578e0b932aa3 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:51.566754 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:51.576358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-04c57364-5445-422b-b561-578e0b932aa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:51.576358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:51.576358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:51.576358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:51.576358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:51.576358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:51.576358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:51.576358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:51.576358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:51.576358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:51.576358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:51.576358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:51.576358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:51.576358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:51.576358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:51.578004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:51.578004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:51.578004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:51.578004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:51.578004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:51.578004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:51.578004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:51.578004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:51.578004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:51.578004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:51.578004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:51.578004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:51.578004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:51.578004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:51.578004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:51.578004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:51.578004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:51.578900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:51.578900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:51.578900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:51.578900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:51.578900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 288/568] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:51.578900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7a566-09f3-4702-bd16-8c638d62e235 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:51.579254 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7a566-09f3-4702-bd16-8c638d62e235 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:51.579509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a7a566-09f3-4702-bd16-8c638d62e235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:51.582811 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b4a40-f50b-4ae2-8f6b-3a8063dba8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:51.583663 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b4a40-f50b-4ae2-8f6b-3a8063dba8ae None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:51.583948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b4a40-f50b-4ae2-8f6b-3a8063dba8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:51.584226 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b4a40-f50b-4ae2-8f6b-3a8063dba8ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:51.595039 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b4a40-f50b-4ae2-8f6b-3a8063dba8ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:51.596478 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b4a40-f50b-4ae2-8f6b-3a8063dba8ae None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:51.596591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-19a7a566-09f3-4702-bd16-8c638d62e235 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:51.597664 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-19a7a566-09f3-4702-bd16-8c638d62e235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:51.608813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:51.615468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-143b4a40-f50b-4ae2-8f6b-3a8063dba8ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:51.615468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:51.615468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:51.615468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:51.615468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:51.615468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:51.615468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:51.615468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:51.615468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:51.615468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:51.615468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:51.615468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:51.615468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:51.615468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:51.615468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:51.616506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:51.616506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:51.616506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:51.616506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:51.616506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:51.616506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:51.616506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:51.616506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:51.616506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:51.616506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:51.616506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:51.616506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:51.616506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:51.616506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:51.616506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:51.616506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:51.616506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:51.617445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:51.617445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:51.617445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:51.617445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:51.617445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 281/569] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:51.617445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b4a40-f50b-4ae2-8f6b-3a8063dba8ae None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:51.664654 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 289/570] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:51.665690 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7a566-09f3-4702-bd16-8c638d62e235 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:51.756995 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b4a40-f50b-4ae2-8f6b-3a8063dba8ae None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:51.803635 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740783cf-cc27-4b1d-9576-d2d5a873fe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:51.804435 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740783cf-cc27-4b1d-9576-d2d5a873fe44 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:51.804718 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740783cf-cc27-4b1d-9576-d2d5a873fe44 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:51.804989 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740783cf-cc27-4b1d-9576-d2d5a873fe44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:51.813180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a7a566-09f3-4702-bd16-8c638d62e235 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:51.815482 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740783cf-cc27-4b1d-9576-d2d5a873fe44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:51.823154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-740783cf-cc27-4b1d-9576-d2d5a873fe44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:51.823154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:51.823154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:51.823154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:51.823154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:51.823154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:51.823154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:51.823154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:51.823154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:51.823154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:51.823154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:51.823154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:51.823154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:51.823154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:51.823154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:51.823154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:51.824206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:51.824206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:51.824206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:51.824206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:51.824206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:51.824206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:51.824206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:51.824206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:51.824206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:51.824206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:51.824206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:51.824206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:51.824206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:51.824206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:51.824206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:51.824206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:51.830186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:51.830186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:51.830186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:51.830186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:51.830186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:51.830186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:51.830186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:51.830186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:51.830186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:51.830186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:51.830186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:51.830186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:51.830186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 282/571] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:16:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:51.830186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740783cf-cc27-4b1d-9576-d2d5a873fe44 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:51.847546 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4c52b-a6ec-490d-998f-86fb293bd528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:51.848210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4c52b-a6ec-490d-998f-86fb293bd528 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:51.848500 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4c52b-a6ec-490d-998f-86fb293bd528 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:51.848782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4c52b-a6ec-490d-998f-86fb293bd528 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:51.855435 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4c52b-a6ec-490d-998f-86fb293bd528 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:51.857421 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d4c52b-a6ec-490d-998f-86fb293bd528 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:51.858620 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:51.871339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-06d4c52b-a6ec-490d-998f-86fb293bd528 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:16:51.871339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:51.871339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:51.871339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:51.871339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:51.871339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:51.871339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:51.871339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:51.871339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:51.871339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:51.871339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:51.871339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:51.871339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:16:51.871339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:16:51.871339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:16:51.872927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:16:51.872927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:51.872927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:51.872927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:51.872927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:51.872927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:51.872927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:51.872927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:51.872927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:51.872927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:51.872927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:51.872927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:51.872927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:51.872927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:51.872927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:51.872927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:51.872927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:51.873853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:16:51.873853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:16:51.873853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:16:51.873853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:16:51.873853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:16:51.873853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:16:51.873853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:16:51.873853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:51.873853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 290/572] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:16:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:51.874405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4c52b-a6ec-490d-998f-86fb293bd528 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:51.884110 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:51.924187 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740783cf-cc27-4b1d-9576-d2d5a873fe44 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:51.957446 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9629f-e5b2-4409-b8c4-4570c4eea5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:51.958131 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9629f-e5b2-4409-b8c4-4570c4eea5df None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:51.958412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9629f-e5b2-4409-b8c4-4570c4eea5df None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:51.958687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9629f-e5b2-4409-b8c4-4570c4eea5df None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:51.959395 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9629f-e5b2-4409-b8c4-4570c4eea5df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:51.959703 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9629f-e5b2-4409-b8c4-4570c4eea5df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:51.961063 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9629f-e5b2-4409-b8c4-4570c4eea5df None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:51.972471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d4c52b-a6ec-490d-998f-86fb293bd528 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:51.972756 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 283/573] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:51.973559 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9629f-e5b2-4409-b8c4-4570c4eea5df None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:52.006003 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9af83e-1037-44e0-8812-8fd7f50bc199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:52.006670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9af83e-1037-44e0-8812-8fd7f50bc199 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:52.006956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9af83e-1037-44e0-8812-8fd7f50bc199 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:52.007240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9af83e-1037-44e0-8812-8fd7f50bc199 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:52.007960 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9af83e-1037-44e0-8812-8fd7f50bc199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:52.008269 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9af83e-1037-44e0-8812-8fd7f50bc199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:52.009632 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9af83e-1037-44e0-8812-8fd7f50bc199 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:52.026485 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 291/574] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:52.026485 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9af83e-1037-44e0-8812-8fd7f50bc199 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:52.066936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:52.073425 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9629f-e5b2-4409-b8c4-4570c4eea5df None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:52.087085 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:52.106830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60354a19-5f3b-4b47-92fc-6b6652efb3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:52.107570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60354a19-5f3b-4b47-92fc-6b6652efb3bb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:52.107861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60354a19-5f3b-4b47-92fc-6b6652efb3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:52.108144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60354a19-5f3b-4b47-92fc-6b6652efb3bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:52.118305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60354a19-5f3b-4b47-92fc-6b6652efb3bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:52.119278 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9af83e-1037-44e0-8812-8fd7f50bc199 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:52.126529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-60354a19-5f3b-4b47-92fc-6b6652efb3bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:52.126529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:52.126529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:52.126529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:52.126529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:52.126529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:52.126529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:52.126529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:52.126529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:52.126529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:52.126529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:52.126529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:52.126529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:52.126529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:52.126529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:52.126529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:52.127454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:52.127454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:52.127454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:52.127454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:52.127454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:52.127454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:52.127454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:52.127454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:52.127454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:52.127454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:52.127454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:52.127454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:52.127454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:52.127454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:52.127454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:52.127454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:52.128285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:52.128285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:52.128285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:52.128285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:52.128285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:52.128285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:52.128285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:52.128285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:52.128285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:52.128285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:52.128285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:52.128285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:52.128285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 284/575] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:16:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:52.128986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60354a19-5f3b-4b47-92fc-6b6652efb3bb None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:52.159517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61108ada-c237-42dd-aca8-c36822fe1337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:52.160190 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61108ada-c237-42dd-aca8-c36822fe1337 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:52.160475 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61108ada-c237-42dd-aca8-c36822fe1337 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:52.160760 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61108ada-c237-42dd-aca8-c36822fe1337 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:52.161504 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61108ada-c237-42dd-aca8-c36822fe1337 None admin] RBAC: Adding query filter params (name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:52.161844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61108ada-c237-42dd-aca8-c36822fe1337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:52.163212 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61108ada-c237-42dd-aca8-c36822fe1337 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:52.171005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 292/576] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jul 18 02:16:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:52.171779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61108ada-c237-42dd-aca8-c36822fe1337 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:52.235950 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60354a19-5f3b-4b47-92fc-6b6652efb3bb None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:52.269448 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed79a0-22a1-452b-acb1-db7f402be6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:52.270130 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed79a0-22a1-452b-acb1-db7f402be6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:52.270417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed79a0-22a1-452b-acb1-db7f402be6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:52.270735 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61108ada-c237-42dd-aca8-c36822fe1337 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:52.270832 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed79a0-22a1-452b-acb1-db7f402be6a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:52.271539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed79a0-22a1-452b-acb1-db7f402be6a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:52.271850 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed79a0-22a1-452b-acb1-db7f402be6a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:52.273269 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed79a0-22a1-452b-acb1-db7f402be6a9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:52.284920 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 285/577] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:16:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:52.285693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed79a0-22a1-452b-acb1-db7f402be6a9 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:52.296239 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:52.300967 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:52.304132 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8089f5a-3f64-472f-b7c1-005482a4b436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:52.304932 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8089f5a-3f64-472f-b7c1-005482a4b436 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:52.309824 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8089f5a-3f64-472f-b7c1-005482a4b436 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:52.309824 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8089f5a-3f64-472f-b7c1-005482a4b436 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:52.314126 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8089f5a-3f64-472f-b7c1-005482a4b436 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:52.315570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8089f5a-3f64-472f-b7c1-005482a4b436 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:52.329816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-e8089f5a-3f64-472f-b7c1-005482a4b436 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 02:16:52.329816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:52.329816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:52.329816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:52.329816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:52.329816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:52.329816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:52.329816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:52.329816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:52.329816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:52.329816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:52.329816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:52.329816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:16:52.329816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:16:52.329816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:16:52.329816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:16:52.330896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:52.330896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:52.330896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:16:52.330896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:52.330896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:16:52.330896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:52.330896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:52.330896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:52.330896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:52.330896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:52.330896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:52.330896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:52.330896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:52.330896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:52.330896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:52.330896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:52.330896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:52.330896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:52.332043 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:52.332043 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:52.332043 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:16:52.332043 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:16:52.332043 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:16:52.332043 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:16:52.332043 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:16:52.332043 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:16:52.332043 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 02:16:52.332043 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:52.332043 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 293/578] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:52.332043 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8089f5a-3f64-472f-b7c1-005482a4b436 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:52.388555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed79a0-22a1-452b-acb1-db7f402be6a9 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:52.422171 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712ad12-d3dc-430c-b777-e27a125a7dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:52.422966 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712ad12-d3dc-430c-b777-e27a125a7dca None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:52.423251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712ad12-d3dc-430c-b777-e27a125a7dca None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:52.423527 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712ad12-d3dc-430c-b777-e27a125a7dca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:52.430468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712ad12-d3dc-430c-b777-e27a125a7dca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:52.431913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712ad12-d3dc-430c-b777-e27a125a7dca None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:52.435409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8089f5a-3f64-472f-b7c1-005482a4b436 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:52.445356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-5712ad12-d3dc-430c-b777-e27a125a7dca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:16:52.445356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:52.445356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:52.445356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:52.445356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:52.445356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:52.445356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:52.445356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:52.445356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:52.445356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:52.445356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:52.445356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:52.445356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:16:52.445356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:16:52.445356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:16:52.446251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:16:52.446251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:52.446251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:52.446251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:52.446251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:52.446251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:52.446251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:52.446251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:52.446251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:52.446251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:52.446251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:52.446251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:52.446251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:52.446251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:52.446251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:52.446251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:52.446251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:52.447108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:16:52.447108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:16:52.447108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:16:52.447108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:16:52.447108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:16:52.447108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:16:52.447108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:16:52.447108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:52.447108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 286/579] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:16:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:52.447581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712ad12-d3dc-430c-b777-e27a125a7dca None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:52.472392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c7231-1d32-4416-bc32-b567eefa46f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:52.473065 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c7231-1d32-4416-bc32-b567eefa46f6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:52.473350 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c7231-1d32-4416-bc32-b567eefa46f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:52.473631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c7231-1d32-4416-bc32-b567eefa46f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:52.474402 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c7231-1d32-4416-bc32-b567eefa46f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:52.474709 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c7231-1d32-4416-bc32-b567eefa46f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:52.476068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c7231-1d32-4416-bc32-b567eefa46f6 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:52.483991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 294/580] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jul 18 02:16:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:52.484739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c7231-1d32-4416-bc32-b567eefa46f6 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:52.523128 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:52.533986 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:52.546517 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712ad12-d3dc-430c-b777-e27a125a7dca None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:52.579722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483fc75-530d-44cc-a670-a8b29f9c9303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:52.580493 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483fc75-530d-44cc-a670-a8b29f9c9303 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:52.580771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483fc75-530d-44cc-a670-a8b29f9c9303 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:52.581049 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483fc75-530d-44cc-a670-a8b29f9c9303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:52.581925 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c7231-1d32-4416-bc32-b567eefa46f6 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:52.592360 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483fc75-530d-44cc-a670-a8b29f9c9303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:52.593804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483fc75-530d-44cc-a670-a8b29f9c9303 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:52.610673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-2483fc75-530d-44cc-a670-a8b29f9c9303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:52.610673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:52.610673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:52.610673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:52.610673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:52.610673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:52.610673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:52.610673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:52.610673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:52.610673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:52.610673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:52.610673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:52.610673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:52.610673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:52.610673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:52.611711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:52.611711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:52.611711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:52.611711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:52.611711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:52.611711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:52.611711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:52.611711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:52.611711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:52.611711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:52.611711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:52.611711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:52.611711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:52.611711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:52.611711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:52.611711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:52.611711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:52.612794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:52.612794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:52.612794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:52.612794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:52.612794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 287/581] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:52.612794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483fc75-530d-44cc-a670-a8b29f9c9303 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:52.618256 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009eedf-6fa4-4c80-9ef8-77d14099f992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:52.619149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009eedf-6fa4-4c80-9ef8-77d14099f992 None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:52.619426 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009eedf-6fa4-4c80-9ef8-77d14099f992 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:52.619695 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009eedf-6fa4-4c80-9ef8-77d14099f992 None admin] PATH_INFO: `/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/6f51aae36f0b42868567840fa957ffe9/roles/1f864eb92c9545bfb36cb24aff0401e4` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:52.634170 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009eedf-6fa4-4c80-9ef8-77d14099f992 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f6f840feba049ee9eeaf7bf0b300730, user_id=6f51aae36f0b42868567840fa957ffe9, role_id=1f864eb92c9545bfb36cb24aff0401e4)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:52.635637 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009eedf-6fa4-4c80-9ef8-77d14099f992 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:52.706770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 295/582] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:16:52 2022] PUT /identity/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/6f51aae36f0b42868567840fa957ffe9/roles/1f864eb92c9545bfb36cb24aff0401e4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:16:52.707727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009eedf-6fa4-4c80-9ef8-77d14099f992 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:52.712878 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483fc75-530d-44cc-a670-a8b29f9c9303 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:52.744134 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:52.753624 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2ae51-ebdd-4c50-88e6-b4aee1cb1197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:52.754528 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2ae51-ebdd-4c50-88e6-b4aee1cb1197 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:52.754937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2ae51-ebdd-4c50-88e6-b4aee1cb1197 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:52.755356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2ae51-ebdd-4c50-88e6-b4aee1cb1197 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:52.756426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2ae51-ebdd-4c50-88e6-b4aee1cb1197 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:52.756817 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2ae51-ebdd-4c50-88e6-b4aee1cb1197 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:52.758519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb2ae51-ebdd-4c50-88e6-b4aee1cb1197 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:52.783108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 288/583] 10.222.0.64 () {56 vars in 1137 bytes} [Mon Jul 18 02:16:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:52.783108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2ae51-ebdd-4c50-88e6-b4aee1cb1197 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:52.834064 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:52.837147 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009eedf-6fa4-4c80-9ef8-77d14099f992 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:52.878848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865d9c7-6fe1-4e2d-818f-6db10b32c53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:52.879510 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865d9c7-6fe1-4e2d-818f-6db10b32c53e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:52.879792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865d9c7-6fe1-4e2d-818f-6db10b32c53e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:52.880124 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c865d9c7-6fe1-4e2d-818f-6db10b32c53e None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:52.880943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865d9c7-6fe1-4e2d-818f-6db10b32c53e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:52.881249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865d9c7-6fe1-4e2d-818f-6db10b32c53e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:52.882730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c865d9c7-6fe1-4e2d-818f-6db10b32c53e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:52.896061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 296/584] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:16:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:52.897112 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865d9c7-6fe1-4e2d-818f-6db10b32c53e None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:52.910749 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb2ae51-ebdd-4c50-88e6-b4aee1cb1197 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:52.948725 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044328a4-727e-4fa1-ada3-c8bb0d440dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:52.949568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044328a4-727e-4fa1-ada3-c8bb0d440dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:52.949886 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044328a4-727e-4fa1-ada3-c8bb0d440dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:52.950161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044328a4-727e-4fa1-ada3-c8bb0d440dd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:52.961680 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044328a4-727e-4fa1-ada3-c8bb0d440dd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:52.963230 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044328a4-727e-4fa1-ada3-c8bb0d440dd8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:52.981930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-044328a4-727e-4fa1-ada3-c8bb0d440dd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:52.981930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:52.981930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:52.981930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:52.981930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:52.981930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:52.981930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:52.981930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:52.981930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:52.981930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:52.981930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:52.981930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:52.981930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:52.981930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:52.981930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:52.982830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:52.982830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:52.982830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:52.982830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:52.982830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:52.982830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:52.982830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:52.982830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:52.982830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:52.982830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:52.982830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:52.982830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:52.982830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:52.982830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:52.982830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:52.982830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:52.982830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:52.984130 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:52.984130 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:52.984130 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:52.984130 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:52.984130 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 289/585] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:52.984409 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044328a4-727e-4fa1-ada3-c8bb0d440dd8 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:53.024573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c865d9c7-6fe1-4e2d-818f-6db10b32c53e None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:53.026292 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:53.059850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbef23-3e2c-4c58-9ebb-b8cab52d5968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:53.060610 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbef23-3e2c-4c58-9ebb-b8cab52d5968 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:53.060899 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbef23-3e2c-4c58-9ebb-b8cab52d5968 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:53.061176 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbef23-3e2c-4c58-9ebb-b8cab52d5968 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:53.061929 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbef23-3e2c-4c58-9ebb-b8cab52d5968 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:53.062236 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbef23-3e2c-4c58-9ebb-b8cab52d5968 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:53.063621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbef23-3e2c-4c58-9ebb-b8cab52d5968 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:53.076057 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 297/586] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:53.076866 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbef23-3e2c-4c58-9ebb-b8cab52d5968 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:53.107109 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:53.121171 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044328a4-727e-4fa1-ada3-c8bb0d440dd8 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:53.161304 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5878e21-a21f-43c4-9c85-17477fca8201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:53.162216 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5878e21-a21f-43c4-9c85-17477fca8201 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:53.162503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5878e21-a21f-43c4-9c85-17477fca8201 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:53.162783 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5878e21-a21f-43c4-9c85-17477fca8201 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:53.174565 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5878e21-a21f-43c4-9c85-17477fca8201 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:53.176614 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5878e21-a21f-43c4-9c85-17477fca8201 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:53.196239 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbef23-3e2c-4c58-9ebb-b8cab52d5968 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:53.196441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-a5878e21-a21f-43c4-9c85-17477fca8201 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:53.196441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:53.196441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:53.196441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:53.196441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:53.196441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:53.196441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:53.196441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:53.196441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:53.196441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:53.196441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:53.196441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:53.196441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:53.196441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:53.196441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:53.197275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:53.197275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:53.197275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:53.197275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:53.197275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:53.197275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:53.197275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:53.197275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:53.197275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:53.197275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:53.197275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:53.197275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:53.197275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:53.197275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:53.197275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:53.197275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:53.197275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:53.198189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:53.198189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:53.198189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:53.198189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:53.202148 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 290/587] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:53.202992 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5878e21-a21f-43c4-9c85-17477fca8201 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:53.235151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eadbf87-10ce-4b32-a0bc-241e2ccbaa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:53.236078 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadbf87-10ce-4b32-a0bc-241e2ccbaa07 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:53.236366 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadbf87-10ce-4b32-a0bc-241e2ccbaa07 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:53.236646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eadbf87-10ce-4b32-a0bc-241e2ccbaa07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:53.237469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eadbf87-10ce-4b32-a0bc-241e2ccbaa07 None admin] RBAC: Adding query filter params (role.id=1f864eb92c9545bfb36cb24aff0401e4, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=6a4e51f478874d99a7fc4ee2dea77caf) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:53.237828 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eadbf87-10ce-4b32-a0bc-241e2ccbaa07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:53.239263 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eadbf87-10ce-4b32-a0bc-241e2ccbaa07 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:53.244798 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 298/588] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:16:53 2022] GET /identity/v3/role_assignments?user.id=6a4e51f478874d99a7fc4ee2dea77caf&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=1f864eb92c9545bfb36cb24aff0401e4 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:53.245574 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eadbf87-10ce-4b32-a0bc-241e2ccbaa07 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:53.313286 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:53.333625 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5878e21-a21f-43c4-9c85-17477fca8201 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:53.348318 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:53.365774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eadbf87-10ce-4b32-a0bc-241e2ccbaa07 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:53.384773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eff174-cb86-44c3-bdcd-330c2f18cdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:53.386080 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eff174-cb86-44c3-bdcd-330c2f18cdef None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:53.386478 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eff174-cb86-44c3-bdcd-330c2f18cdef None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:53.386762 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eff174-cb86-44c3-bdcd-330c2f18cdef None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:53.388048 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eff174-cb86-44c3-bdcd-330c2f18cdef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:53.388352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eff174-cb86-44c3-bdcd-330c2f18cdef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:53.389813 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eff174-cb86-44c3-bdcd-330c2f18cdef None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:53.407930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 291/589] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:53.407930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eff174-cb86-44c3-bdcd-330c2f18cdef None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:53.422621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b142fe-7b99-4762-a1bb-0b3b7bfc2317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:53.423502 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b142fe-7b99-4762-a1bb-0b3b7bfc2317 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:53.423706 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b142fe-7b99-4762-a1bb-0b3b7bfc2317 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:53.423979 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b142fe-7b99-4762-a1bb-0b3b7bfc2317 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:53.432782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b142fe-7b99-4762-a1bb-0b3b7bfc2317 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:53.434956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b142fe-7b99-4762-a1bb-0b3b7bfc2317 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:53.449739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-a9b142fe-7b99-4762-a1bb-0b3b7bfc2317 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 02:16:53.449739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:53.449739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:53.449739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:53.449739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:53.449739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:53.449739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:53.449739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:53.449739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:53.449739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:53.449739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:53.449739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:53.449739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:16:53.449739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:16:53.449739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:16:53.449739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:16:53.450710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:53.450710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:53.450710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:16:53.450710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:53.450710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:16:53.450710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:53.450710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:53.450710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:53.450710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:53.450710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:53.450710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:53.450710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:53.450710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:53.450710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:53.450710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:53.450710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:53.450710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:53.450710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:53.451626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:53.451626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:53.451626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:16:53.451626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:16:53.451626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:16:53.451626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:16:53.451626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:16:53.451626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:16:53.451626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 02:16:53.451626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:53.451626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 299/590] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:53.452207 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b142fe-7b99-4762-a1bb-0b3b7bfc2317 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:53.535036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eff174-cb86-44c3-bdcd-330c2f18cdef None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:53.570999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43937406-dc1d-405d-903f-520e3dbbdc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:53.571909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43937406-dc1d-405d-903f-520e3dbbdc96 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:53.572341 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43937406-dc1d-405d-903f-520e3dbbdc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:53.572828 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43937406-dc1d-405d-903f-520e3dbbdc96 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:53.573743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43937406-dc1d-405d-903f-520e3dbbdc96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:53.574233 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43937406-dc1d-405d-903f-520e3dbbdc96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:53.575830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43937406-dc1d-405d-903f-520e3dbbdc96 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:53.581503 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b142fe-7b99-4762-a1bb-0b3b7bfc2317 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:53.588666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 292/591] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:53.589832 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43937406-dc1d-405d-903f-520e3dbbdc96 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:53.602089 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:53.628096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6b1e1-4678-406f-baa3-b438dde393f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:53.629638 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6b1e1-4678-406f-baa3-b438dde393f7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:53.630143 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6b1e1-4678-406f-baa3-b438dde393f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:53.630490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6b1e1-4678-406f-baa3-b438dde393f7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:53.641147 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6b1e1-4678-406f-baa3-b438dde393f7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:53.642646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db6b1e1-4678-406f-baa3-b438dde393f7 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:53.657262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-3db6b1e1-4678-406f-baa3-b438dde393f7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 02:16:53.657262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:53.657262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:53.657262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:53.657262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:53.657262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:53.657262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:53.657262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:53.657262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:53.657262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:53.657262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:53.657262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:53.657262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:16:53.657262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:16:53.657262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:16:53.657262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:16:53.658225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:53.658225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:53.658225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:16:53.658225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:53.658225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:16:53.658225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:53.658225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:53.658225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:53.658225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:53.658225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:53.658225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:53.658225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:53.658225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:53.658225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:53.658225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:53.658225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:53.658225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:53.658225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:53.659176 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:53.659176 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:53.659176 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:16:53.659176 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:16:53.659176 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:16:53.659176 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:16:53.659176 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:16:53.659176 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:16:53.659176 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 02:16:53.659176 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:53.663109 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 300/592] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:16:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:53.663967 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6b1e1-4678-406f-baa3-b438dde393f7 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:53.668408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:53.718592 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43937406-dc1d-405d-903f-520e3dbbdc96 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:53.767492 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fd414-aa87-47ef-8d23-87aa3c17a509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:53.767850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6b1e1-4678-406f-baa3-b438dde393f7 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:53.768723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fd414-aa87-47ef-8d23-87aa3c17a509 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:53.769465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fd414-aa87-47ef-8d23-87aa3c17a509 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:53.769975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147fd414-aa87-47ef-8d23-87aa3c17a509 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:53.771985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147fd414-aa87-47ef-8d23-87aa3c17a509 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:53.772497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147fd414-aa87-47ef-8d23-87aa3c17a509 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:53.774139 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147fd414-aa87-47ef-8d23-87aa3c17a509 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:53.803587 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 293/593] 10.222.0.64 () {56 vars in 1137 bytes} [Mon Jul 18 02:16:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:53.803587 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fd414-aa87-47ef-8d23-87aa3c17a509 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:53.814925 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ead737-78f8-4898-935d-7114b6de54ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:53.816450 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ead737-78f8-4898-935d-7114b6de54ff None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:53.816886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ead737-78f8-4898-935d-7114b6de54ff None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:53.817798 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ead737-78f8-4898-935d-7114b6de54ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:53.827411 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ead737-78f8-4898-935d-7114b6de54ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:53.830495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ead737-78f8-4898-935d-7114b6de54ff None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:53.851127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-f9ead737-78f8-4898-935d-7114b6de54ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:16:53.851127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:53.851127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:53.851127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:53.851127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:53.851127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:53.851127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:53.851127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:53.851127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:53.851127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:53.851127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:53.851127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:53.851127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:16:53.851127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:16:53.851127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:16:53.852266 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:16:53.852266 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:53.852266 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:53.852266 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:53.852266 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:53.852266 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:53.852266 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:53.852266 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:53.852266 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:53.852266 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:53.852266 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:53.852266 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:53.852266 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:53.852266 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:53.852266 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:53.852266 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:53.852266 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:53.853365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:16:53.853365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:16:53.853365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:16:53.853365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:16:53.853365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:16:53.853365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:16:53.853365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:16:53.853365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:53.856513 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 301/594] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:16:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:53.857760 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ead737-78f8-4898-935d-7114b6de54ff None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:53.881587 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:53.921013 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147fd414-aa87-47ef-8d23-87aa3c17a509 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:53.944936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:53.958614 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405defe-71f0-4e26-ad51-530ae23ec1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:53.959491 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405defe-71f0-4e26-ad51-530ae23ec1de None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:53.959872 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405defe-71f0-4e26-ad51-530ae23ec1de None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:53.960304 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405defe-71f0-4e26-ad51-530ae23ec1de None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:53.961296 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5405defe-71f0-4e26-ad51-530ae23ec1de None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:53.961737 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5405defe-71f0-4e26-ad51-530ae23ec1de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:53.963384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5405defe-71f0-4e26-ad51-530ae23ec1de None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:53.982738 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 294/595] 10.222.0.64 () {56 vars in 1139 bytes} [Mon Jul 18 02:16:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:53.988060 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405defe-71f0-4e26-ad51-530ae23ec1de None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:53.995026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ead737-78f8-4898-935d-7114b6de54ff None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:54.045243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fd949-bcee-4676-bcba-4d66d4432298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:54.046346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fd949-bcee-4676-bcba-4d66d4432298 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:54.046774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fd949-bcee-4676-bcba-4d66d4432298 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:54.047212 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fd949-bcee-4676-bcba-4d66d4432298 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:54.063422 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fd949-bcee-4676-bcba-4d66d4432298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:54.065582 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fd949-bcee-4676-bcba-4d66d4432298 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:54.089469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-a32fd949-bcee-4676-bcba-4d66d4432298 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:54.089469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:54.089469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:54.089469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:54.089469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:54.089469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:54.089469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:54.089469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:54.089469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:54.089469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:54.089469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:54.089469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:54.089469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:54.089469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:54.089469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:54.091122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:54.091122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:54.091122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:54.091122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:54.091122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:54.091122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:54.091122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:54.091122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:54.091122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:54.091122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:54.091122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:54.091122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:54.091122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:54.091122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:54.091122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:54.091122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:54.091122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:54.092198 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:54.092198 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:54.092198 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:54.092198 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:54.099962 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 302/596] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:54.099962 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fd949-bcee-4676-bcba-4d66d4432298 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:54.106602 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5405defe-71f0-4e26-ad51-530ae23ec1de None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:54.131094 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:54.142967 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cfd10a-7a10-4bc3-be4b-41ebfb264836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:54.143645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cfd10a-7a10-4bc3-be4b-41ebfb264836 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:54.143928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cfd10a-7a10-4bc3-be4b-41ebfb264836 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:54.154714 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cfd10a-7a10-4bc3-be4b-41ebfb264836 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:54.154714 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cfd10a-7a10-4bc3-be4b-41ebfb264836 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:54.154714 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cfd10a-7a10-4bc3-be4b-41ebfb264836 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:54.154714 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cfd10a-7a10-4bc3-be4b-41ebfb264836 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:54.159715 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 295/597] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:16:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:54.160539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cfd10a-7a10-4bc3-be4b-41ebfb264836 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:54.225121 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fd949-bcee-4676-bcba-4d66d4432298 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:54.241155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:54.259830 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283338f8-37e0-4aeb-89e6-f82ea28bdc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:54.262051 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283338f8-37e0-4aeb-89e6-f82ea28bdc05 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:54.262051 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283338f8-37e0-4aeb-89e6-f82ea28bdc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:54.262051 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283338f8-37e0-4aeb-89e6-f82ea28bdc05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:54.272065 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283338f8-37e0-4aeb-89e6-f82ea28bdc05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:54.273518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283338f8-37e0-4aeb-89e6-f82ea28bdc05 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:54.285645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cfd10a-7a10-4bc3-be4b-41ebfb264836 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:54.292068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-283338f8-37e0-4aeb-89e6-f82ea28bdc05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:54.292068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:54.292068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:54.292068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:54.292068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:54.292068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:54.292068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:54.292068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:54.292068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:54.292068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:54.292068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:54.292068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:54.292068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:54.292068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:54.292068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:54.292921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:54.292921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:54.292921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:54.292921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:54.292921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:54.292921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:54.292921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:54.292921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:54.292921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:54.292921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:54.292921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:54.292921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:54.292921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:54.292921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:54.292921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:54.292921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:54.292921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:54.293878 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:54.293878 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:54.293878 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:54.293878 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:54.298014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 303/598] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:54.298839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283338f8-37e0-4aeb-89e6-f82ea28bdc05 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:54.329327 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ecdfe-578a-47fe-b4df-f6cccfff3d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:54.329953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ecdfe-578a-47fe-b4df-f6cccfff3d5d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:54.330288 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ecdfe-578a-47fe-b4df-f6cccfff3d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:54.330570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ecdfe-578a-47fe-b4df-f6cccfff3d5d None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:54.331388 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ecdfe-578a-47fe-b4df-f6cccfff3d5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:54.331702 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ecdfe-578a-47fe-b4df-f6cccfff3d5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:54.333074 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ecdfe-578a-47fe-b4df-f6cccfff3d5d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:54.350579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 296/599] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:54.350579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ecdfe-578a-47fe-b4df-f6cccfff3d5d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:54.404589 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:54.431619 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283338f8-37e0-4aeb-89e6-f82ea28bdc05 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:54.470451 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b997ed9-0910-4654-bf28-cceea5ac7fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:54.470860 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ecdfe-578a-47fe-b4df-f6cccfff3d5d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:54.471346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b997ed9-0910-4654-bf28-cceea5ac7fb8 None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:54.471631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b997ed9-0910-4654-bf28-cceea5ac7fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:54.471909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b997ed9-0910-4654-bf28-cceea5ac7fb8 None admin] PATH_INFO: `/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/bdb0a04d568e4b14b07cd6d6092bc49f/roles/1f864eb92c9545bfb36cb24aff0401e4` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:54.489230 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b997ed9-0910-4654-bf28-cceea5ac7fb8 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f6f840feba049ee9eeaf7bf0b300730, user_id=bdb0a04d568e4b14b07cd6d6092bc49f, role_id=1f864eb92c9545bfb36cb24aff0401e4)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:54.490879 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b997ed9-0910-4654-bf28-cceea5ac7fb8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:54.510314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11078584-23ba-4a6b-ac38-cf9cbf5950c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:54.511135 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11078584-23ba-4a6b-ac38-cf9cbf5950c9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:54.511522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11078584-23ba-4a6b-ac38-cf9cbf5950c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:54.511921 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11078584-23ba-4a6b-ac38-cf9cbf5950c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:54.513250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11078584-23ba-4a6b-ac38-cf9cbf5950c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:54.513674 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11078584-23ba-4a6b-ac38-cf9cbf5950c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:54.515198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11078584-23ba-4a6b-ac38-cf9cbf5950c9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:54.531946 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 297/600] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:54.531946 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11078584-23ba-4a6b-ac38-cf9cbf5950c9 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:54.561121 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 304/601] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:16:54 2022] PUT /identity/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/bdb0a04d568e4b14b07cd6d6092bc49f/roles/1f864eb92c9545bfb36cb24aff0401e4 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:16:54.563122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b997ed9-0910-4654-bf28-cceea5ac7fb8 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:54.589829 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:54.659274 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11078584-23ba-4a6b-ac38-cf9cbf5950c9 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:54.663177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:54.728260 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b997ed9-0910-4654-bf28-cceea5ac7fb8 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:54.731906 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7dff1d-5e53-45e0-86b4-9f317a35dc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:54.732732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dff1d-5e53-45e0-86b4-9f317a35dc49 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:54.733012 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dff1d-5e53-45e0-86b4-9f317a35dc49 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:54.733290 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dff1d-5e53-45e0-86b4-9f317a35dc49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:54.752913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7dff1d-5e53-45e0-86b4-9f317a35dc49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:54.754443 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7dff1d-5e53-45e0-86b4-9f317a35dc49 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:54.776694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-0c7dff1d-5e53-45e0-86b4-9f317a35dc49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:16:54.776694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:54.776694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:54.776694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:54.776694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:54.776694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:54.776694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:54.776694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:54.776694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:54.776694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:54.776694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:54.776694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:54.776694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:16:54.776694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:16:54.776694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:16:54.777755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:16:54.777755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:54.777755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:54.777755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:54.777755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:54.777755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:54.777755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:54.777755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:54.777755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:54.777755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:54.777755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:54.777755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:54.777755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:54.777755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:54.777755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:54.777755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:54.777755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:54.778637 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:16:54.778637 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:16:54.778637 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:16:54.778637 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:16:54.778637 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:16:54.778637 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:16:54.778637 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:16:54.778637 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:54.779048 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 298/602] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:16:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:54.780093 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f524e-765c-465b-bef6-221cead59803 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:54.780376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f524e-765c-465b-bef6-221cead59803 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:54.780655 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f524e-765c-465b-bef6-221cead59803 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:54.786650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 299/603] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:54.787612 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f524e-765c-465b-bef6-221cead59803 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:54.795173 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758c387-dca4-4b00-b119-7fb54802702d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:54.795998 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758c387-dca4-4b00-b119-7fb54802702d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:54.796283 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758c387-dca4-4b00-b119-7fb54802702d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:54.796560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758c387-dca4-4b00-b119-7fb54802702d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:54.804831 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758c387-dca4-4b00-b119-7fb54802702d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:54.806380 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758c387-dca4-4b00-b119-7fb54802702d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:54.822748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-b758c387-dca4-4b00-b119-7fb54802702d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:16:54.822748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:54.822748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:54.822748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:54.822748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:54.822748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:54.822748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:54.822748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:54.822748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:54.822748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:54.822748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:54.822748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:54.822748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:16:54.822748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:16:54.822748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:16:54.823642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:16:54.823642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:54.823642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:54.823642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:54.823642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:54.823642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:54.823642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:54.823642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:54.823642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:54.823642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:54.823642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:54.823642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:54.823642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:54.823642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:54.823642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:54.823642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:54.823642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:54.824555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:16:54.824555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:16:54.824555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:16:54.824555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:16:54.824555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:16:54.824555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:16:54.824555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:16:54.824555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:54.824555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 305/604] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:16:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:54.826230 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b72ad-8f27-4fb9-8644-3c7326325a5c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:54.826230 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b72ad-8f27-4fb9-8644-3c7326325a5c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:54.826230 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b72ad-8f27-4fb9-8644-3c7326325a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:54.849644 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-7d4b72ad-8f27-4fb9-8644-3c7326325a5c None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:54.850889 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7d4b72ad-8f27-4fb9-8644-3c7326325a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:54.904389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f524e-765c-465b-bef6-221cead59803 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:54.940108 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 306/605] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:54.945920 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b72ad-8f27-4fb9-8644-3c7326325a5c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:54.949811 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb52bac-1d49-4d64-8d96-7e367d20ee70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:54.950792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb52bac-1d49-4d64-8d96-7e367d20ee70 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:54.951257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb52bac-1d49-4d64-8d96-7e367d20ee70 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:54.951363 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:54.951801 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb52bac-1d49-4d64-8d96-7e367d20ee70 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:54.952828 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb52bac-1d49-4d64-8d96-7e367d20ee70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:54.953331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb52bac-1d49-4d64-8d96-7e367d20ee70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:54.955057 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb52bac-1d49-4d64-8d96-7e367d20ee70 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:54.976853 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 300/606] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:16:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:54.983652 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb52bac-1d49-4d64-8d96-7e367d20ee70 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:55.016322 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:55.054647 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b72ad-8f27-4fb9-8644-3c7326325a5c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:55.092281 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d40c4-6f60-48d4-b37e-e1b42fdf7183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:55.093338 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d40c4-6f60-48d4-b37e-e1b42fdf7183 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:55.093863 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d40c4-6f60-48d4-b37e-e1b42fdf7183 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:55.094343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463d40c4-6f60-48d4-b37e-e1b42fdf7183 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:55.095357 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d40c4-6f60-48d4-b37e-e1b42fdf7183 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:55.095868 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d40c4-6f60-48d4-b37e-e1b42fdf7183 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:55.097530 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463d40c4-6f60-48d4-b37e-e1b42fdf7183 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:55.102629 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb52bac-1d49-4d64-8d96-7e367d20ee70 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:55.111002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 307/607] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:16:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:55.112082 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d40c4-6f60-48d4-b37e-e1b42fdf7183 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:55.150945 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1560714-ceff-4cf4-b5ec-b0feecdbbb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:55.151849 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1560714-ceff-4cf4-b5ec-b0feecdbbb76 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:55.152133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1560714-ceff-4cf4-b5ec-b0feecdbbb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:55.152412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1560714-ceff-4cf4-b5ec-b0feecdbbb76 None admin] PATH_INFO: `/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/b8948dc6a55344eaa85e2a6092215ec6/roles/1f864eb92c9545bfb36cb24aff0401e4` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:55.173863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1560714-ceff-4cf4-b5ec-b0feecdbbb76 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f6f840feba049ee9eeaf7bf0b300730, user_id=b8948dc6a55344eaa85e2a6092215ec6, role_id=1f864eb92c9545bfb36cb24aff0401e4)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:55.176438 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1560714-ceff-4cf4-b5ec-b0feecdbbb76 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:55.206255 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:55.240391 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463d40c4-6f60-48d4-b37e-e1b42fdf7183 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:55.269738 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 301/608] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:16:54 2022] PUT /identity/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/b8948dc6a55344eaa85e2a6092215ec6/roles/1f864eb92c9545bfb36cb24aff0401e4 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:16:55.269738 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1560714-ceff-4cf4-b5ec-b0feecdbbb76 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:55.314193 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb670b8b-9690-4c16-9ad9-732512eec78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:55.315019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb670b8b-9690-4c16-9ad9-732512eec78f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:55.315351 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb670b8b-9690-4c16-9ad9-732512eec78f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:55.315629 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb670b8b-9690-4c16-9ad9-732512eec78f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:55.338113 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb670b8b-9690-4c16-9ad9-732512eec78f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:55.354346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-fb670b8b-9690-4c16-9ad9-732512eec78f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:55.354346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:55.354346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:55.354346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:55.354346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:55.354346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:55.354346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:55.354346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:55.354346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:55.354346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:55.354346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:55.354346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:55.354346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:55.354346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:55.354346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:55.354346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:55.355321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:55.355321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:55.355321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:55.355321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:55.355321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:55.355321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:55.355321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:55.355321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:55.355321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:55.355321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:55.355321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:55.355321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:55.355321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:55.355321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:55.355321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:55.355321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:55.356700 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:55.356700 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:55.356700 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:55.356700 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:55.356700 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:55.356700 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:55.356700 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:55.356700 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:55.356700 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:55.356700 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:55.356700 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:55.356700 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:55.360526 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 308/609] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:16:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:55.361504 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb670b8b-9690-4c16-9ad9-732512eec78f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:55.365036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:55.401361 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1560714-ceff-4cf4-b5ec-b0feecdbbb76 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:55.447691 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6283931a-707b-4283-abc8-bf9af5360432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:55.450055 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283931a-707b-4283-abc8-bf9af5360432 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:55.450552 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283931a-707b-4283-abc8-bf9af5360432 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:55.451055 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6283931a-707b-4283-abc8-bf9af5360432 None admin] PATH_INFO: `/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/fa9e6d3fe3e740e6aedab33d727ec478/roles/1f864eb92c9545bfb36cb24aff0401e4` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:55.473495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283931a-707b-4283-abc8-bf9af5360432 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f6f840feba049ee9eeaf7bf0b300730, user_id=fa9e6d3fe3e740e6aedab33d727ec478, role_id=1f864eb92c9545bfb36cb24aff0401e4)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:55.475050 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6283931a-707b-4283-abc8-bf9af5360432 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:55.507769 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb670b8b-9690-4c16-9ad9-732512eec78f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:55.535503 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:55.545408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9562e5-e332-4d6f-b0d4-282135494b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:55.546109 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 302/610] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:16:55 2022] PUT /identity/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/fa9e6d3fe3e740e6aedab33d727ec478/roles/1f864eb92c9545bfb36cb24aff0401e4 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:16:55.546224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9562e5-e332-4d6f-b0d4-282135494b9b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:55.546512 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9562e5-e332-4d6f-b0d4-282135494b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:55.546853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9562e5-e332-4d6f-b0d4-282135494b9b None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:55.549857 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9562e5-e332-4d6f-b0d4-282135494b9b None admin] RBAC: Adding query filter params (name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:55.549857 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9562e5-e332-4d6f-b0d4-282135494b9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:55.550034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fef89-fb39-4d46-a9d5-f15de660f377 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:55.550034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fef89-fb39-4d46-a9d5-f15de660f377 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:55.550034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42fef89-fb39-4d46-a9d5-f15de660f377 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:55.550238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9562e5-e332-4d6f-b0d4-282135494b9b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:55.551952 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 303/611] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:55.559334 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91250291-8370-4302-bc49-13f1f3cf85d2 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:55.559918 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91250291-8370-4302-bc49-13f1f3cf85d2 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:55.560428 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91250291-8370-4302-bc49-13f1f3cf85d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:55.561857 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 309/612] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jul 18 02:16:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:55.570037 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9562e5-e332-4d6f-b0d4-282135494b9b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:55.590356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-91250291-8370-4302-bc49-13f1f3cf85d2 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:55.591614 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-91250291-8370-4302-bc49-13f1f3cf85d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:55.732874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 304/613] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:55.748853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9562e5-e332-4d6f-b0d4-282135494b9b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:55.763512 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91250291-8370-4302-bc49-13f1f3cf85d2 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:55.790813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc115d48-592e-415b-8aaa-4f2f7126f087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:55.791682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc115d48-592e-415b-8aaa-4f2f7126f087 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:55.791973 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc115d48-592e-415b-8aaa-4f2f7126f087 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:55.792247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc115d48-592e-415b-8aaa-4f2f7126f087 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:55.803715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc115d48-592e-415b-8aaa-4f2f7126f087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:55.805247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc115d48-592e-415b-8aaa-4f2f7126f087 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:55.825642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-bc115d48-592e-415b-8aaa-4f2f7126f087 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:55.825642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:55.825642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:55.825642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:55.825642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:55.825642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:55.825642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:55.825642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:55.825642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:55.825642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:55.825642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:55.825642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:55.825642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:55.825642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:55.825642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:55.826592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:55.826592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:55.826592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:55.826592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:55.826592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:55.826592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:55.826592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:55.826592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:55.826592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:55.826592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:55.826592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:55.826592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:55.826592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:55.826592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:55.826592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:55.826592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:55.826592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:55.827458 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:55.827458 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:55.827458 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:55.827458 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:55.827458 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 310/614] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:55.830115 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:55.833041 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc115d48-592e-415b-8aaa-4f2f7126f087 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:55.892714 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91250291-8370-4302-bc49-13f1f3cf85d2 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:55.894725 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:55.939652 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49c392-a3e9-4907-91b5-57c157e279eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:55.941417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49c392-a3e9-4907-91b5-57c157e279eb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:55.942285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49c392-a3e9-4907-91b5-57c157e279eb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:55.942717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49c392-a3e9-4907-91b5-57c157e279eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:55.960354 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49c392-a3e9-4907-91b5-57c157e279eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:55.967278 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc115d48-592e-415b-8aaa-4f2f7126f087 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:55.971495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-fa49c392-a3e9-4907-91b5-57c157e279eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:55.971495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:55.971495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:55.971495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:55.971495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:55.971495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:55.971495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:55.971495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:55.971495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:55.971495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:55.971495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:55.971495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:55.971495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:55.971495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:55.971495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:55.971495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:55.972394 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:55.972394 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:55.972394 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:55.972394 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:55.972394 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:55.972394 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:55.972394 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:55.972394 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:55.972394 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:55.972394 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:55.972394 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:55.972394 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:55.972394 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:55.972394 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:55.972394 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:55.972394 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:55.973234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:55.973234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:55.973234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:55.973234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:55.973234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:55.973234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:55.973234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:55.973234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:55.973234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:55.973234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:55.973234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:55.973234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:55.981274 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 305/615] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:16:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:16:55.983468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49c392-a3e9-4907-91b5-57c157e279eb None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:56.034526 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9c964-fc8a-4059-a019-271742b1787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:56.036175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9c964-fc8a-4059-a019-271742b1787c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:56.036817 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9c964-fc8a-4059-a019-271742b1787c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:56.038442 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9c964-fc8a-4059-a019-271742b1787c None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:56.039374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9c964-fc8a-4059-a019-271742b1787c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:56.040622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9c964-fc8a-4059-a019-271742b1787c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:56.043882 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9c964-fc8a-4059-a019-271742b1787c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:56.065818 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 311/616] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:56.067476 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9c964-fc8a-4059-a019-271742b1787c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:56.184469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9c964-fc8a-4059-a019-271742b1787c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:56.186396 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:56.220965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373aa2c-3214-4ade-a623-b73c3c1a2eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:56.222149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373aa2c-3214-4ade-a623-b73c3c1a2eae None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:56.222658 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373aa2c-3214-4ade-a623-b73c3c1a2eae None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:56.223138 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373aa2c-3214-4ade-a623-b73c3c1a2eae None admin] PATH_INFO: `/v3/users/nova` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:56.232686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373aa2c-3214-4ade-a623-b73c3c1a2eae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:56.234572 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373aa2c-3214-4ade-a623-b73c3c1a2eae None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:56.239798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49c392-a3e9-4907-91b5-57c157e279eb None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:56.249392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-6373aa2c-3214-4ade-a623-b73c3c1a2eae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 02:16:56.249392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:56.249392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:56.249392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:56.249392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:56.249392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:56.249392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:56.249392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:56.249392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:56.249392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:56.249392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:56.249392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:56.249392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:16:56.249392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:16:56.249392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:16:56.249392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:16:56.250365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:56.250365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:56.250365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:16:56.250365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:56.250365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:16:56.250365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:56.250365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:56.250365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:56.250365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:56.250365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:56.250365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:56.250365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:56.250365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:56.250365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:56.250365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:56.250365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:56.250365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:56.250365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:56.251344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:56.251344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:56.251344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:16:56.251344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:16:56.251344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:16:56.251344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:16:56.251344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:16:56.251344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:16:56.251344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 02:16:56.251344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:56.257981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 312/617] 10.222.0.64 () {56 vars in 1093 bytes} [Mon Jul 18 02:16:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:16:56.258437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:56.260045 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373aa2c-3214-4ade-a623-b73c3c1a2eae None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:56.310935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687612a-0c8d-4ba7-8e7e-4a8a6480e5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:56.311620 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687612a-0c8d-4ba7-8e7e-4a8a6480e5ae None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:56.311961 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687612a-0c8d-4ba7-8e7e-4a8a6480e5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:56.312166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f687612a-0c8d-4ba7-8e7e-4a8a6480e5ae None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:56.312910 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687612a-0c8d-4ba7-8e7e-4a8a6480e5ae None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:56.313214 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687612a-0c8d-4ba7-8e7e-4a8a6480e5ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:56.314612 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f687612a-0c8d-4ba7-8e7e-4a8a6480e5ae None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:56.340659 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 306/618] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jul 18 02:16:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:56.354735 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687612a-0c8d-4ba7-8e7e-4a8a6480e5ae None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:56.372461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373aa2c-3214-4ade-a623-b73c3c1a2eae None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:56.446452 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245cf09-0245-4320-bd03-76bc233bafd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:56.447174 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245cf09-0245-4320-bd03-76bc233bafd3 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:56.447445 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245cf09-0245-4320-bd03-76bc233bafd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:56.447726 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245cf09-0245-4320-bd03-76bc233bafd3 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:56.448573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245cf09-0245-4320-bd03-76bc233bafd3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:56.448886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245cf09-0245-4320-bd03-76bc233bafd3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:56.450420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245cf09-0245-4320-bd03-76bc233bafd3 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:56.491328 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 313/619] 10.222.0.64 () {56 vars in 1133 bytes} [Mon Jul 18 02:16:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:16:56.494717 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245cf09-0245-4320-bd03-76bc233bafd3 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:56.530363 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f687612a-0c8d-4ba7-8e7e-4a8a6480e5ae None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:56.539284 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:56.604157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829819e1-73b5-4d4c-8a83-6f0bbdf7b0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:56.604978 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829819e1-73b5-4d4c-8a83-6f0bbdf7b0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:56.605264 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829819e1-73b5-4d4c-8a83-6f0bbdf7b0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:56.605609 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829819e1-73b5-4d4c-8a83-6f0bbdf7b0e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:56.625995 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829819e1-73b5-4d4c-8a83-6f0bbdf7b0e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:56.627464 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829819e1-73b5-4d4c-8a83-6f0bbdf7b0e5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:56.646024 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-829819e1-73b5-4d4c-8a83-6f0bbdf7b0e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:56.646024 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:56.646024 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:56.646024 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:56.646024 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:56.646024 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:56.646024 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:56.646024 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:56.646024 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:56.646024 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:56.646024 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:56.646024 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:56.646024 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:56.646024 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:56.646024 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:56.646986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:56.646986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:56.646986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:56.646986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:56.646986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:56.646986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:56.646986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:56.646986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:56.646986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:56.646986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:56.646986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:56.646986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:56.646986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:56.646986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:56.646986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:56.646986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:56.646986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:56.649275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:56.649275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:56.649275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:56.649275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:56.649275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 307/620] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:56.654391 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829819e1-73b5-4d4c-8a83-6f0bbdf7b0e5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:56.688449 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245cf09-0245-4320-bd03-76bc233bafd3 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:56.706252 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:56.748142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328414bc-beb1-4a30-b220-42fc123b8ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:56.748729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328414bc-beb1-4a30-b220-42fc123b8ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:56.749014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328414bc-beb1-4a30-b220-42fc123b8ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:56.749295 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328414bc-beb1-4a30-b220-42fc123b8ed9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:56.826602 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829819e1-73b5-4d4c-8a83-6f0bbdf7b0e5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:56.854282 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328414bc-beb1-4a30-b220-42fc123b8ed9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:56.856274 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328414bc-beb1-4a30-b220-42fc123b8ed9 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:56.881842 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:56.893604 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e8b2b-60f8-4ba1-b91c-bd0474b71ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:56.894771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e8b2b-60f8-4ba1-b91c-bd0474b71ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:56.894771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e8b2b-60f8-4ba1-b91c-bd0474b71ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:56.894932 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e8b2b-60f8-4ba1-b91c-bd0474b71ad0 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:56.895623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e8b2b-60f8-4ba1-b91c-bd0474b71ad0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:56.895933 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e8b2b-60f8-4ba1-b91c-bd0474b71ad0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:56.897295 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e8b2b-60f8-4ba1-b91c-bd0474b71ad0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:56.921620 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 308/621] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:56.927958 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e8b2b-60f8-4ba1-b91c-bd0474b71ad0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:57.003080 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 314/622] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:57.004821 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc6c8a-aa1a-4c6f-af96-082212c4ae84 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:57.005388 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc6c8a-aa1a-4c6f-af96-082212c4ae84 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:57.005673 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc6c8a-aa1a-4c6f-af96-082212c4ae84 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:57.007673 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 315/623] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:57.009437 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc6c8a-aa1a-4c6f-af96-082212c4ae84 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:57.054612 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:57.070768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e8b2b-60f8-4ba1-b91c-bd0474b71ad0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:57.120667 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41657c-f3d7-4230-88b8-99b5e641eb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:57.122120 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41657c-f3d7-4230-88b8-99b5e641eb29 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:57.122812 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41657c-f3d7-4230-88b8-99b5e641eb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:57.123444 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41657c-f3d7-4230-88b8-99b5e641eb29 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:57.133010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41657c-f3d7-4230-88b8-99b5e641eb29 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:57.134805 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41657c-f3d7-4230-88b8-99b5e641eb29 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:57.147103 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc6c8a-aa1a-4c6f-af96-082212c4ae84 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:57.155102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-be41657c-f3d7-4230-88b8-99b5e641eb29 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 02:16:57.155102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:57.155102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:57.155102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:57.155102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:57.155102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:57.155102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:57.155102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:57.155102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:57.155102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:57.155102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:57.155102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:57.155102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:16:57.155102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:16:57.155102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:16:57.155102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:16:57.156263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:57.156263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:57.156263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:16:57.156263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:57.156263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:16:57.156263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:57.156263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:57.156263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:57.156263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:57.156263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:57.156263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:57.156263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:57.156263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:57.156263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:57.156263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:57.156263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:57.156263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:57.156263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:57.157435 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:57.157435 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:57.157435 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:16:57.157435 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:16:57.157435 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:16:57.157435 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:16:57.157435 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:16:57.157435 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:16:57.157435 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 02:16:57.157435 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:57.160231 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 309/624] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:16:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:16:57.162494 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f8f16-d87c-44c6-a78c-f638d224ae0b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:57.163237 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f8f16-d87c-44c6-a78c-f638d224ae0b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:57.163668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f8f16-d87c-44c6-a78c-f638d224ae0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:57.173960 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:57.189285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-339f8f16-d87c-44c6-a78c-f638d224ae0b None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:57.190602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8920b2-e56d-4201-93c6-729399bb5392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:57.191514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8920b2-e56d-4201-93c6-729399bb5392 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:57.191770 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-339f8f16-d87c-44c6-a78c-f638d224ae0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:57.192699 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8920b2-e56d-4201-93c6-729399bb5392 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:57.193127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8920b2-e56d-4201-93c6-729399bb5392 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:57.206649 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8920b2-e56d-4201-93c6-729399bb5392 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:57.208739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8920b2-e56d-4201-93c6-729399bb5392 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:57.233314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-ee8920b2-e56d-4201-93c6-729399bb5392 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:57.233314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:57.233314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:57.233314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:57.233314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:57.233314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:57.233314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:57.233314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:57.233314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:57.233314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:57.233314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:57.233314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:57.233314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:57.233314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:57.233314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:57.234330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:57.234330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:57.234330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:57.234330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:57.234330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:57.234330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:57.234330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:57.234330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:57.234330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:57.234330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:57.234330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:57.234330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:57.234330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:57.234330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:57.234330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:57.234330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:57.234330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:57.235211 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:57.235211 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:57.235211 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:57.235211 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:57.235211 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 316/625] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:57.236239 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8920b2-e56d-4201-93c6-729399bb5392 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:57.273112 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 310/626] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:57.274065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f8f16-d87c-44c6-a78c-f638d224ae0b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:57.346802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8920b2-e56d-4201-93c6-729399bb5392 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:57.358181 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:57.375892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f8f16-d87c-44c6-a78c-f638d224ae0b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:57.381769 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4aba6-7231-409e-9b21-f035df6e9f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:57.382457 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4aba6-7231-409e-9b21-f035df6e9f34 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:57.382745 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4aba6-7231-409e-9b21-f035df6e9f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:57.386869 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4aba6-7231-409e-9b21-f035df6e9f34 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:57.386869 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4aba6-7231-409e-9b21-f035df6e9f34 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:57.386869 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4aba6-7231-409e-9b21-f035df6e9f34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:57.386869 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4aba6-7231-409e-9b21-f035df6e9f34 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:57.404358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 317/627] 10.222.0.64 () {56 vars in 1135 bytes} [Mon Jul 18 02:16:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:57.405343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4aba6-7231-409e-9b21-f035df6e9f34 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:57.412706 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c58ed-8287-4b06-83c9-f590a949732b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:57.413466 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c58ed-8287-4b06-83c9-f590a949732b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:57.413851 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c58ed-8287-4b06-83c9-f590a949732b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:57.414203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c58ed-8287-4b06-83c9-f590a949732b None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:57.415088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c58ed-8287-4b06-83c9-f590a949732b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:57.415463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c58ed-8287-4b06-83c9-f590a949732b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:57.417022 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c58ed-8287-4b06-83c9-f590a949732b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:57.435005 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 311/628] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:57.436219 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c58ed-8287-4b06-83c9-f590a949732b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:57.438234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:57.514863 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4aba6-7231-409e-9b21-f035df6e9f34 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:57.545616 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c58ed-8287-4b06-83c9-f590a949732b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:57.552252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5154f78-3522-4372-b381-6c8a1e5eb4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:57.553063 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5154f78-3522-4372-b381-6c8a1e5eb4c8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:57.553404 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5154f78-3522-4372-b381-6c8a1e5eb4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:57.553693 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5154f78-3522-4372-b381-6c8a1e5eb4c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:57.564668 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5154f78-3522-4372-b381-6c8a1e5eb4c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:57.572814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-f5154f78-3522-4372-b381-6c8a1e5eb4c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:57.572814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:57.572814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:57.572814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:57.572814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:57.572814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:57.572814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:57.572814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:57.572814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:57.572814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:57.572814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:57.572814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:57.572814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:57.572814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:57.572814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:57.572814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:57.573795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:57.573795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:57.573795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:57.573795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:57.573795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:57.573795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:57.573795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:57.573795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:57.573795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:57.573795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:57.573795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:57.573795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:57.573795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:57.573795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:57.573795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:57.573795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:57.574781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:57.574781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:57.574781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:57.574781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:57.574781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:57.574781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:57.574781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:57.574781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:57.574781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:57.574781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:57.574781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:57.574781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:57.574781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 318/629] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:16:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:57.575555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5154f78-3522-4372-b381-6c8a1e5eb4c8 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:57.586246 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19885e48-e407-48b0-b059-96e89af184bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:57.587357 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19885e48-e407-48b0-b059-96e89af184bc None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:57.587787 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19885e48-e407-48b0-b059-96e89af184bc None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:57.588209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19885e48-e407-48b0-b059-96e89af184bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:57.596921 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:57.602803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19885e48-e407-48b0-b059-96e89af184bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:57.604263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19885e48-e407-48b0-b059-96e89af184bc None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:57.622232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-19885e48-e407-48b0-b059-96e89af184bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:57.622232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:57.622232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:57.622232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:57.622232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:57.622232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:57.622232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:57.622232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:57.622232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:57.622232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:57.622232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:57.622232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:57.622232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:57.622232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:57.622232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:57.623178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:57.623178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:57.623178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:57.623178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:57.623178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:57.623178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:57.623178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:57.623178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:57.623178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:57.623178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:57.623178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:57.623178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:57.623178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:57.623178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:57.623178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:57.623178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:57.623178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:57.624067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:57.624067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:57.624067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:57.624067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:57.624067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 312/630] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:57.624842 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa873c-7fd2-43a8-8b03-c0e1b997f828 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:57.624942 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa873c-7fd2-43a8-8b03-c0e1b997f828 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:57.625223 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa873c-7fd2-43a8-8b03-c0e1b997f828 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:57.630475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 313/631] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:57.631259 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa873c-7fd2-43a8-8b03-c0e1b997f828 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:57.675702 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:57.685036 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5154f78-3522-4372-b381-6c8a1e5eb4c8 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:57.718864 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90b77e-9fb0-49bd-a0e5-ce3dbefdc38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:57.719894 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90b77e-9fb0-49bd-a0e5-ce3dbefdc38c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:57.720420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90b77e-9fb0-49bd-a0e5-ce3dbefdc38c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:57.720845 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b90b77e-9fb0-49bd-a0e5-ce3dbefdc38c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:57.727565 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90b77e-9fb0-49bd-a0e5-ce3dbefdc38c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:57.729166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b90b77e-9fb0-49bd-a0e5-ce3dbefdc38c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:57.738878 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa873c-7fd2-43a8-8b03-c0e1b997f828 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:57.744384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-2b90b77e-9fb0-49bd-a0e5-ce3dbefdc38c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:16:57.744384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:57.744384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:57.744384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:57.744384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:57.744384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:57.744384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:57.744384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:57.744384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:57.744384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:57.744384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:57.744384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:57.744384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:16:57.744384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:16:57.744384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:16:57.745432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:16:57.745432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:57.745432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:57.745432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:57.745432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:57.745432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:57.745432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:57.745432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:57.745432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:57.745432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:57.745432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:57.745432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:57.745432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:57.745432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:57.745432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:57.745432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:57.745432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:57.746505 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:16:57.746505 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:16:57.746505 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:16:57.746505 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:16:57.746505 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:16:57.746505 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:16:57.746505 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:16:57.746505 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:57.748548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 319/632] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:16:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:57.749457 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90b77e-9fb0-49bd-a0e5-ce3dbefdc38c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:57.779661 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71988d8-0647-460e-a640-faee0fc12a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:57.780331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71988d8-0647-460e-a640-faee0fc12a87 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:57.780614 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71988d8-0647-460e-a640-faee0fc12a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:57.780888 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71988d8-0647-460e-a640-faee0fc12a87 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:57.781634 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71988d8-0647-460e-a640-faee0fc12a87 None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:57.781970 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71988d8-0647-460e-a640-faee0fc12a87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:57.783328 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71988d8-0647-460e-a640-faee0fc12a87 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:57.791639 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 314/633] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jul 18 02:16:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:57.792891 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1a591-fbb9-46bf-8150-21df371b4dd8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:57.793179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1a591-fbb9-46bf-8150-21df371b4dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:57.793455 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1a591-fbb9-46bf-8150-21df371b4dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:57.810788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c0b1a591-fbb9-46bf-8150-21df371b4dd8 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:57.812219 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c0b1a591-fbb9-46bf-8150-21df371b4dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:57.860900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b90b77e-9fb0-49bd-a0e5-ce3dbefdc38c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:57.866405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:57.888024 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 315/634] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:57.888929 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1a591-fbb9-46bf-8150-21df371b4dd8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:57.907949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25733446-3938-40bd-b7bb-d5449970dc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:57.908937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25733446-3938-40bd-b7bb-d5449970dc8b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:57.909397 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25733446-3938-40bd-b7bb-d5449970dc8b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:57.909886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25733446-3938-40bd-b7bb-d5449970dc8b None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:57.911231 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25733446-3938-40bd-b7bb-d5449970dc8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:57.912042 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25733446-3938-40bd-b7bb-d5449970dc8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:57.913827 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25733446-3938-40bd-b7bb-d5449970dc8b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:57.928751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 320/635] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:57.933305 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25733446-3938-40bd-b7bb-d5449970dc8b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:57.943952 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:57.993416 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1a591-fbb9-46bf-8150-21df371b4dd8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:58.032522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777e4ef-9caa-4c9c-af89-42afe023ab60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:58.033293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777e4ef-9caa-4c9c-af89-42afe023ab60 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:58.033639 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777e4ef-9caa-4c9c-af89-42afe023ab60 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:58.033943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777e4ef-9caa-4c9c-af89-42afe023ab60 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:58.034830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777e4ef-9caa-4c9c-af89-42afe023ab60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:58.035136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777e4ef-9caa-4c9c-af89-42afe023ab60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:58.036680 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777e4ef-9caa-4c9c-af89-42afe023ab60 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:58.040681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25733446-3938-40bd-b7bb-d5449970dc8b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:58.049200 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 316/636] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:16:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:58.050498 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777e4ef-9caa-4c9c-af89-42afe023ab60 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:58.077075 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6ec59-6a19-4eae-96f4-26ee8eebd313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:58.077843 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6ec59-6a19-4eae-96f4-26ee8eebd313 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:58.078135 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6ec59-6a19-4eae-96f4-26ee8eebd313 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:58.078413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b6ec59-6a19-4eae-96f4-26ee8eebd313 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:58.089468 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6ec59-6a19-4eae-96f4-26ee8eebd313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:58.090977 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b6ec59-6a19-4eae-96f4-26ee8eebd313 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:58.093553 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:58.108166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-90b6ec59-6a19-4eae-96f4-26ee8eebd313 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:58.108166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:58.108166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:58.108166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:58.108166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:58.108166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:58.108166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:58.108166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:58.108166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:58.108166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:58.108166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:58.108166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:58.108166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:58.108166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:58.108166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:58.115073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:58.115073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:58.115073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:58.115073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:58.115073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:58.115073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:58.115073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:58.115073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:58.115073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:58.115073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:58.115073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:58.115073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:58.115073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:58.115073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:58.115073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:58.115073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:58.115073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:58.115973 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:58.115973 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:58.115973 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:58.115973 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:58.115973 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 321/637] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:58.115973 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6ec59-6a19-4eae-96f4-26ee8eebd313 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:58.161243 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777e4ef-9caa-4c9c-af89-42afe023ab60 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:58.173346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:58.195151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de0f5a-627c-4546-9472-a319c8b94ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:58.195946 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de0f5a-627c-4546-9472-a319c8b94ffb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:58.196228 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de0f5a-627c-4546-9472-a319c8b94ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:58.196501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de0f5a-627c-4546-9472-a319c8b94ffb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:58.207467 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de0f5a-627c-4546-9472-a319c8b94ffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:58.211755 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b6ec59-6a19-4eae-96f4-26ee8eebd313 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:58.215091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-d4de0f5a-627c-4546-9472-a319c8b94ffb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:58.215091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:58.215091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:58.215091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:58.215091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:58.215091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:58.215091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:58.215091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:58.215091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:58.215091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:58.215091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:58.215091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:58.215091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:58.215091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:58.215091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:58.215091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:58.216144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:58.216144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:58.216144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:58.216144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:58.216144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:58.216144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:58.216144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:58.216144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:58.216144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:58.216144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:58.216144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:58.216144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:58.216144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:58.216144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:58.216144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:58.216144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:58.217001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:58.217001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:58.217001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:58.217001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:58.217001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:58.217001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:58.217001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:58.217001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:58.217001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:58.217001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:58.217001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:58.217001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:58.217001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 317/638] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:16:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:58.217694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa85d3-ac56-475f-9d05-58c6c29270be None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:58.217694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa85d3-ac56-475f-9d05-58c6c29270be None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:58.218271 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fa85d3-ac56-475f-9d05-58c6c29270be None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:58.222072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 318/639] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:16:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:16:58.222072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa85d3-ac56-475f-9d05-58c6c29270be None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:58.246774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e8a55-f383-44cd-b8ba-8d0913bb9824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:58.247563 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e8a55-f383-44cd-b8ba-8d0913bb9824 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:58.247843 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e8a55-f383-44cd-b8ba-8d0913bb9824 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:58.248121 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316e8a55-f383-44cd-b8ba-8d0913bb9824 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:58.254655 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e8a55-f383-44cd-b8ba-8d0913bb9824 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:58.256083 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316e8a55-f383-44cd-b8ba-8d0913bb9824 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:58.270491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-316e8a55-f383-44cd-b8ba-8d0913bb9824 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:16:58.270491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:58.270491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:58.270491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:58.270491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:58.270491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:58.270491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:58.270491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:58.270491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:58.270491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:58.270491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:58.270491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:58.270491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:16:58.270491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:16:58.270491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:16:58.271419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:16:58.271419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:58.271419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:58.271419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:58.271419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:58.271419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:58.271419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:58.271419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:58.271419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:58.271419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:58.271419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:58.271419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:58.271419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:58.271419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:58.271419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:58.271419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:58.271419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:58.272302 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:16:58.272302 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:16:58.272302 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:16:58.272302 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:16:58.272302 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:16:58.272302 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:16:58.272302 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:16:58.272302 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:58.272302 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 322/640] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:16:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:58.272789 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e8a55-f383-44cd-b8ba-8d0913bb9824 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:58.323379 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fa85d3-ac56-475f-9d05-58c6c29270be None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:58.325446 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:58.357527 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd354965-dd4f-4f81-bb2b-dd418071f766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:58.358601 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd354965-dd4f-4f81-bb2b-dd418071f766 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:58.359082 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd354965-dd4f-4f81-bb2b-dd418071f766 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:58.359621 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd354965-dd4f-4f81-bb2b-dd418071f766 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:58.360642 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd354965-dd4f-4f81-bb2b-dd418071f766 None admin] RBAC: Adding query filter params (role.id=1f864eb92c9545bfb36cb24aff0401e4, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=6f51aae36f0b42868567840fa957ffe9) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:58.361798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd354965-dd4f-4f81-bb2b-dd418071f766 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:58.363219 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd354965-dd4f-4f81-bb2b-dd418071f766 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:58.368918 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 319/641] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:16:58 2022] GET /identity/v3/role_assignments?user.id=6f51aae36f0b42868567840fa957ffe9&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=1f864eb92c9545bfb36cb24aff0401e4 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:58.369683 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd354965-dd4f-4f81-bb2b-dd418071f766 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:58.382101 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316e8a55-f383-44cd-b8ba-8d0913bb9824 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:58.415736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:58.428778 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ae5de-baa4-4dbd-b420-5442d8db20cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:58.429472 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ae5de-baa4-4dbd-b420-5442d8db20cb None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:58.429790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ae5de-baa4-4dbd-b420-5442d8db20cb None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:58.430181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ae5de-baa4-4dbd-b420-5442d8db20cb None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:58.430938 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ae5de-baa4-4dbd-b420-5442d8db20cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:58.431247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ae5de-baa4-4dbd-b420-5442d8db20cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:58.432672 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585ae5de-baa4-4dbd-b420-5442d8db20cb None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:58.450146 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 323/642] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:58.451626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c233f-46c3-4e66-8a18-277df5181505 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:58.451921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c233f-46c3-4e66-8a18-277df5181505 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:58.452200 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c233f-46c3-4e66-8a18-277df5181505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:58.469183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-417c233f-46c3-4e66-8a18-277df5181505 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:16:58.470465 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-417c233f-46c3-4e66-8a18-277df5181505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:16:58.491055 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd354965-dd4f-4f81-bb2b-dd418071f766 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:58.531662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97358b81-6356-4be7-8f9d-5bdaa0c90fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:58.532343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97358b81-6356-4be7-8f9d-5bdaa0c90fdb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:58.532676 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97358b81-6356-4be7-8f9d-5bdaa0c90fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:58.533426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97358b81-6356-4be7-8f9d-5bdaa0c90fdb None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:58.533804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97358b81-6356-4be7-8f9d-5bdaa0c90fdb None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:58.534751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97358b81-6356-4be7-8f9d-5bdaa0c90fdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:58.535482 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97358b81-6356-4be7-8f9d-5bdaa0c90fdb None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:58.548666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 320/643] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jul 18 02:16:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:58.549509 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97358b81-6356-4be7-8f9d-5bdaa0c90fdb None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:58.557913 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 324/644] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:16:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:16:58.557913 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c233f-46c3-4e66-8a18-277df5181505 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:58.586841 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:58.662850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c233f-46c3-4e66-8a18-277df5181505 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:58.664562 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97358b81-6356-4be7-8f9d-5bdaa0c90fdb None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:58.677625 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:58.698678 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a740567-547d-42f6-9d5a-1e5041e82428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:58.699503 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a740567-547d-42f6-9d5a-1e5041e82428 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:58.700673 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a740567-547d-42f6-9d5a-1e5041e82428 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:58.700673 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a740567-547d-42f6-9d5a-1e5041e82428 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:58.702434 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b3955-1694-4b3e-af36-7f6cbbdef065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:58.703108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b3955-1694-4b3e-af36-7f6cbbdef065 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:58.703391 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b3955-1694-4b3e-af36-7f6cbbdef065 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:58.703671 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b3955-1694-4b3e-af36-7f6cbbdef065 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:58.704460 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b3955-1694-4b3e-af36-7f6cbbdef065 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:58.704775 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b3955-1694-4b3e-af36-7f6cbbdef065 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:58.706263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b3955-1694-4b3e-af36-7f6cbbdef065 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:58.707481 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a740567-547d-42f6-9d5a-1e5041e82428 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:58.708917 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a740567-547d-42f6-9d5a-1e5041e82428 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:58.723603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 321/645] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:16:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:58.723603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b3955-1694-4b3e-af36-7f6cbbdef065 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:58.725060 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-9a740567-547d-42f6-9d5a-1e5041e82428 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 02:16:58.725060 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:58.725060 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:58.725060 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:58.725060 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:58.725060 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:58.725060 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:58.725060 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:58.725060 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:58.725060 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:58.725060 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:58.725060 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:58.725060 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:16:58.725060 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:16:58.725060 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:16:58.725060 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:16:58.726191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:58.726191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:58.726191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:16:58.726191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:58.726191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:16:58.726191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:58.726191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:58.726191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:58.726191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:58.726191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:58.726191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:58.726191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:58.726191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:58.726191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:58.726191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:58.726191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:58.726191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:58.726191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:58.727265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:58.727265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:58.727265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:16:58.727265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:16:58.727265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:16:58.727265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:16:58.727265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:16:58.727265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:16:58.727265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 02:16:58.727265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:58.731379 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 325/646] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:58.732218 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a740567-547d-42f6-9d5a-1e5041e82428 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:58.816309 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:58.829547 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b3955-1694-4b3e-af36-7f6cbbdef065 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:58.835554 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a740567-547d-42f6-9d5a-1e5041e82428 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:58.865103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c98b1-4340-4715-be07-638330935a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:58.865938 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c98b1-4340-4715-be07-638330935a83 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:58.866464 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c98b1-4340-4715-be07-638330935a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:58.866605 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416c98b1-4340-4715-be07-638330935a83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:58.871777 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964deb1-b145-4374-b1bf-5514d4300b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:58.872570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964deb1-b145-4374-b1bf-5514d4300b94 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:58.872851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964deb1-b145-4374-b1bf-5514d4300b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:58.873124 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964deb1-b145-4374-b1bf-5514d4300b94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:58.877532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c98b1-4340-4715-be07-638330935a83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:58.879014 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416c98b1-4340-4715-be07-638330935a83 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:58.884451 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964deb1-b145-4374-b1bf-5514d4300b94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:16:58.892715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-b964deb1-b145-4374-b1bf-5514d4300b94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:58.892715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:58.892715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:58.892715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:58.892715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:58.892715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:58.892715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:58.892715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:58.892715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:58.892715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:58.892715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:58.892715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:58.892715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:16:58.892715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:16:58.892715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:16:58.892715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:16:58.893622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:16:58.893622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:16:58.893622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:16:58.893622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:16:58.893622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:58.893622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:58.893622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:58.893622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:58.893622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:58.893622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:58.893622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:58.893622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:58.893622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:58.893622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:58.893622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:58.893622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:58.899621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:58.899621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:58.899621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:58.899621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:58.899621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:16:58.899621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:16:58.899621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:16:58.899621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:16:58.899621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:16:58.899621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:16:58.899621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:16:58.899621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:58.899621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 326/647] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:16:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:58.899621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964deb1-b145-4374-b1bf-5514d4300b94 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:58.900407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-416c98b1-4340-4715-be07-638330935a83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:58.900407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:58.900407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:58.900407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:58.900407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:58.900407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:58.900407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:58.900407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:58.900407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:58.900407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:58.900407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:58.900407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:58.900407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:58.900407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:58.900407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:58.901199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:58.901199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:58.901199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:58.901199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:58.901199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:58.901199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:58.901199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:58.901199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:58.901199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:58.901199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:58.901199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:58.901199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:58.901199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:58.901199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:58.901199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:58.901199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:58.901199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:58.902145 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:58.902145 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:58.902145 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:58.902145 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:58.902145 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 322/648] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:58.902145 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c98b1-4340-4715-be07-638330935a83 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:58.935683 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:59.004973 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416c98b1-4340-4715-be07-638330935a83 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:59.005453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964deb1-b145-4374-b1bf-5514d4300b94 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:59.039008 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e408491-c363-4cba-b67d-1fe76795bdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:59.039235 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f43026-9cee-43bc-abe6-c9d6976e533e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:59.039688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e408491-c363-4cba-b67d-1fe76795bdcc None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:59.039976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e408491-c363-4cba-b67d-1fe76795bdcc None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:59.040084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f43026-9cee-43bc-abe6-c9d6976e533e None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:59.040247 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e408491-c363-4cba-b67d-1fe76795bdcc None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:59.040340 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f43026-9cee-43bc-abe6-c9d6976e533e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:59.040618 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f43026-9cee-43bc-abe6-c9d6976e533e None admin] PATH_INFO: `/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/6a4e51f478874d99a7fc4ee2dea77caf/roles/1f864eb92c9545bfb36cb24aff0401e4` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:59.041080 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e408491-c363-4cba-b67d-1fe76795bdcc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:59.041397 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e408491-c363-4cba-b67d-1fe76795bdcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:59.042904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e408491-c363-4cba-b67d-1fe76795bdcc None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:59.052215 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:59.056174 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f43026-9cee-43bc-abe6-c9d6976e533e None admin] RBAC: Authorizing `identity:create_grant(project_id=1f6f840feba049ee9eeaf7bf0b300730, user_id=6a4e51f478874d99a7fc4ee2dea77caf, role_id=1f864eb92c9545bfb36cb24aff0401e4)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:59.057625 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f43026-9cee-43bc-abe6-c9d6976e533e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:59.066067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 323/649] 10.222.0.64 () {56 vars in 1137 bytes} [Mon Jul 18 02:16:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:59.066067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e408491-c363-4cba-b67d-1fe76795bdcc None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:59.138072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 327/650] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:16:58 2022] PUT /identity/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/6a4e51f478874d99a7fc4ee2dea77caf/roles/1f864eb92c9545bfb36cb24aff0401e4 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:16:59.138911 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f43026-9cee-43bc-abe6-c9d6976e533e None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:59.173574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e408491-c363-4cba-b67d-1fe76795bdcc None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:59.220052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a8ca7-efef-4c6a-9671-ae72b213da2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:59.220692 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a8ca7-efef-4c6a-9671-ae72b213da2c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:59.220977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a8ca7-efef-4c6a-9671-ae72b213da2c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:59.221253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a8ca7-efef-4c6a-9671-ae72b213da2c None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:59.222050 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a8ca7-efef-4c6a-9671-ae72b213da2c None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:59.222467 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a8ca7-efef-4c6a-9671-ae72b213da2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:59.223934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a8ca7-efef-4c6a-9671-ae72b213da2c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:59.252373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 324/651] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jul 18 02:16:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:59.252373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a8ca7-efef-4c6a-9671-ae72b213da2c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:59.290731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:59.318906 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f43026-9cee-43bc-abe6-c9d6976e533e None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:59.332863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:59.368546 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2352aa-3710-42c7-b88f-ccc2f58cd081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:59.369925 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2352aa-3710-42c7-b88f-ccc2f58cd081 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:59.370429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2352aa-3710-42c7-b88f-ccc2f58cd081 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:59.371151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2352aa-3710-42c7-b88f-ccc2f58cd081 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:59.372511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2352aa-3710-42c7-b88f-ccc2f58cd081 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:59.373247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2352aa-3710-42c7-b88f-ccc2f58cd081 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:59.375295 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2352aa-3710-42c7-b88f-ccc2f58cd081 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:59.381064 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a8ca7-efef-4c6a-9671-ae72b213da2c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:59.391338 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 328/652] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:59.392937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2352aa-3710-42c7-b88f-ccc2f58cd081 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:59.419904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d0af0-b409-44e1-a30a-c91ec146001b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:59.420693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d0af0-b409-44e1-a30a-c91ec146001b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:59.421001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d0af0-b409-44e1-a30a-c91ec146001b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:59.422411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d0af0-b409-44e1-a30a-c91ec146001b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:59.499006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d0af0-b409-44e1-a30a-c91ec146001b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:59.500433 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d0af0-b409-44e1-a30a-c91ec146001b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:59.520182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2352aa-3710-42c7-b88f-ccc2f58cd081 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:59.560730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a56b6c-430b-4e5f-b33d-7279e4115bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:59.561391 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a56b6c-430b-4e5f-b33d-7279e4115bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:59.561645 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a56b6c-430b-4e5f-b33d-7279e4115bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:59.562093 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a56b6c-430b-4e5f-b33d-7279e4115bf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:59.573216 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:59.574041 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a56b6c-430b-4e5f-b33d-7279e4115bf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:59.575523 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a56b6c-430b-4e5f-b33d-7279e4115bf8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:59.577811 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:59.601876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-f7a56b6c-430b-4e5f-b33d-7279e4115bf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:59.601876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:59.601876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:59.601876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:59.601876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:59.601876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:59.601876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:59.601876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:59.601876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:59.601876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:59.601876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:59.601876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:59.601876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:59.601876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:59.601876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:59.603292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:59.603292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:59.603292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:59.603292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:59.603292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:59.603292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:59.603292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:59.603292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:59.603292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:59.603292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:59.603292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:59.603292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:59.603292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:59.603292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:59.603292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:59.603292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:59.603292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:59.604263 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:59.604263 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:59.604263 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:59.604263 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:59.610859 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 329/653] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:59.612245 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a56b6c-430b-4e5f-b33d-7279e4115bf8 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:59.622713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 325/654] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:16:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:16:59.622713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d0af0-b409-44e1-a30a-c91ec146001b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:59.724456 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a56b6c-430b-4e5f-b33d-7279e4115bf8 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:59.727700 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d0af0-b409-44e1-a30a-c91ec146001b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:59.759660 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e536f46-ba3f-4b29-a92b-1ac3b4819a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:59.760973 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e536f46-ba3f-4b29-a92b-1ac3b4819a2f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:59.761533 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e536f46-ba3f-4b29-a92b-1ac3b4819a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:59.761989 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e536f46-ba3f-4b29-a92b-1ac3b4819a2f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:59.763682 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0551a-f63d-48d6-9073-86c9d791a28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:59.764550 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0551a-f63d-48d6-9073-86c9d791a28d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:59.764938 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0551a-f63d-48d6-9073-86c9d791a28d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:59.765318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0551a-f63d-48d6-9073-86c9d791a28d None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:59.766283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e0551a-f63d-48d6-9073-86c9d791a28d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:16:59.766710 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e0551a-f63d-48d6-9073-86c9d791a28d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:59.768173 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e0551a-f63d-48d6-9073-86c9d791a28d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:59.771270 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e536f46-ba3f-4b29-a92b-1ac3b4819a2f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:59.772885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e536f46-ba3f-4b29-a92b-1ac3b4819a2f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:59.785341 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 326/655] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:16:59.785341 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0551a-f63d-48d6-9073-86c9d791a28d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:59.792609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-5e536f46-ba3f-4b29-a92b-1ac3b4819a2f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 02:16:59.792609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:59.792609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:59.792609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:59.792609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:59.792609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:59.792609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:59.792609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:59.792609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:59.792609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:59.792609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:59.792609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:59.792609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:16:59.792609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:16:59.792609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:16:59.792609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:16:59.793734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:59.793734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:59.793734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:16:59.793734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:59.793734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:16:59.793734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:59.793734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:59.793734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:59.793734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:59.793734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:59.793734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:59.793734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:59.793734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:59.793734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:59.793734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:59.793734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:59.793734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:59.793734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:59.794687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:59.794687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:59.794687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:16:59.794687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:16:59.794687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:16:59.794687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:16:59.794687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:16:59.794687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:16:59.794687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 02:16:59.794687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:59.797276 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 330/656] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:16:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:59.798274 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e536f46-ba3f-4b29-a92b-1ac3b4819a2f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:59.814137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:59.857524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:16:59.901075 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0551a-f63d-48d6-9073-86c9d791a28d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:59.902998 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e536f46-ba3f-4b29-a92b-1ac3b4819a2f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:16:59.937779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de4f29-68b7-4a4f-a516-eab5ebb84170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:59.938720 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74c121-cf42-4ac8-8f89-7ee353c327bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:16:59.939141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de4f29-68b7-4a4f-a516-eab5ebb84170 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:59.939520 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74c121-cf42-4ac8-8f89-7ee353c327bb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:16:59.939804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74c121-cf42-4ac8-8f89-7ee353c327bb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:59.940001 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de4f29-68b7-4a4f-a516-eab5ebb84170 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:16:59.940111 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74c121-cf42-4ac8-8f89-7ee353c327bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:59.940557 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04de4f29-68b7-4a4f-a516-eab5ebb84170 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:16:59.948779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de4f29-68b7-4a4f-a516-eab5ebb84170 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:59.951069 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04de4f29-68b7-4a4f-a516-eab5ebb84170 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:59.951625 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74c121-cf42-4ac8-8f89-7ee353c327bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:16:59.953197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74c121-cf42-4ac8-8f89-7ee353c327bb None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:16:59.966048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-04de4f29-68b7-4a4f-a516-eab5ebb84170 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 02:16:59.966048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:59.966048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:59.966048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:59.966048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:59.966048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:59.966048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:59.966048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:59.966048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:59.966048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:59.966048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:59.966048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:59.966048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:16:59.966048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:16:59.966048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:16:59.966048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:16:59.967014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:59.967014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:59.967014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:16:59.967014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:59.967014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:16:59.967014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:16:59.967014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:59.967014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:59.967014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:59.967014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:59.967014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:59.967014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:59.967014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:59.967014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:59.967014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:59.967014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:59.967014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:59.967014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:59.967952 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:59.967952 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:59.967952 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:16:59.967952 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:16:59.967952 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:16:59.967952 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:16:59.967952 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:16:59.967952 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:16:59.967952 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 02:16:59.967952 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:16:59.974666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-2b74c121-cf42-4ac8-8f89-7ee353c327bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:59.974666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:16:59.974666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:16:59.974666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:16:59.974666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:16:59.974666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:16:59.974666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:16:59.974666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:16:59.974666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:16:59.974666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:16:59.974666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:16:59.974666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:16:59.974666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:16:59.974666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:16:59.974666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:16:59.975556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:16:59.975556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:16:59.975556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:16:59.975556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:16:59.975556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:16:59.975556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:16:59.975556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:16:59.975556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:16:59.975556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:16:59.975556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:16:59.975556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:16:59.975556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:16:59.975556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:16:59.975556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:16:59.975556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:16:59.975556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:16:59.975556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:16:59.976431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:16:59.976431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:16:59.976431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:16:59.976431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:16:59.977118 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 331/658] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:16:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:59.977221 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 327/658] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:16:59.978055 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74c121-cf42-4ac8-8f89-7ee353c327bb None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:16:59.978527 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de4f29-68b7-4a4f-a516-eab5ebb84170 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:00.054454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:00.083216 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04de4f29-68b7-4a4f-a516-eab5ebb84170 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:00.087023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74c121-cf42-4ac8-8f89-7ee353c327bb None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:00.097910 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:00.118671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c66501-e5df-417b-bfad-0517db7d8eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:00.119444 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c66501-e5df-417b-bfad-0517db7d8eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:00.119807 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c66501-e5df-417b-bfad-0517db7d8eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:00.120159 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c66501-e5df-417b-bfad-0517db7d8eb0 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:00.121632 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c66501-e5df-417b-bfad-0517db7d8eb0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:00.122036 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c66501-e5df-417b-bfad-0517db7d8eb0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:00.123716 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c66501-e5df-417b-bfad-0517db7d8eb0 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:00.126518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70807a79-62b3-43fb-92b5-779181199486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:00.127409 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70807a79-62b3-43fb-92b5-779181199486 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:00.127868 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70807a79-62b3-43fb-92b5-779181199486 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:00.128330 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70807a79-62b3-43fb-92b5-779181199486 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:00.129388 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70807a79-62b3-43fb-92b5-779181199486 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:00.129953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70807a79-62b3-43fb-92b5-779181199486 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:00.131613 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70807a79-62b3-43fb-92b5-779181199486 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:00.147015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 332/659] 10.222.0.64 () {56 vars in 1139 bytes} [Mon Jul 18 02:16:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:00.147917 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c66501-e5df-417b-bfad-0517db7d8eb0 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:00.157352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 328/660] 10.222.0.64 () {56 vars in 1137 bytes} [Mon Jul 18 02:16:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:00.158522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70807a79-62b3-43fb-92b5-779181199486 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:00.251185 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c66501-e5df-417b-bfad-0517db7d8eb0 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:00.269254 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70807a79-62b3-43fb-92b5-779181199486 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:00.286521 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d79f1-4053-4c02-9bba-3abe3dd34eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:00.287176 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d79f1-4053-4c02-9bba-3abe3dd34eef None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:00.287466 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d79f1-4053-4c02-9bba-3abe3dd34eef None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:00.287744 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d79f1-4053-4c02-9bba-3abe3dd34eef None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:00.288464 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d79f1-4053-4c02-9bba-3abe3dd34eef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:00.288771 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d79f1-4053-4c02-9bba-3abe3dd34eef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:00.290282 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d79f1-4053-4c02-9bba-3abe3dd34eef None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:00.307091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 333/661] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:00.307091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d79f1-4053-4c02-9bba-3abe3dd34eef None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:00.308828 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:00.318326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cb417-cc9d-4cc2-aff2-ee5d555080cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:00.319005 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cb417-cc9d-4cc2-aff2-ee5d555080cc None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:00.319292 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cb417-cc9d-4cc2-aff2-ee5d555080cc None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:00.319569 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cb417-cc9d-4cc2-aff2-ee5d555080cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:00.350122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:00.404239 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104cb417-cc9d-4cc2-aff2-ee5d555080cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:00.405912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104cb417-cc9d-4cc2-aff2-ee5d555080cc None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:00.435674 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d79f1-4053-4c02-9bba-3abe3dd34eef None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:00.474332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24116d-da32-4e1d-b0a3-82ac02402f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:00.475437 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24116d-da32-4e1d-b0a3-82ac02402f7e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:00.475920 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24116d-da32-4e1d-b0a3-82ac02402f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:00.476610 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24116d-da32-4e1d-b0a3-82ac02402f7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:00.518065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 329/662] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:17:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:00.518964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cb417-cc9d-4cc2-aff2-ee5d555080cc None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:00.552203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24116d-da32-4e1d-b0a3-82ac02402f7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:00.553305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:00.555374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24116d-da32-4e1d-b0a3-82ac02402f7e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:00.585863 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:00.625130 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cb417-cc9d-4cc2-aff2-ee5d555080cc None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:00.660986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce7f72-82c7-4a06-b427-1dd933636e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:00.661832 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce7f72-82c7-4a06-b427-1dd933636e2a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:00.662084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 334/663] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:17:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:00.662221 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce7f72-82c7-4a06-b427-1dd933636e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:00.662381 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce7f72-82c7-4a06-b427-1dd933636e2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:00.663436 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24116d-da32-4e1d-b0a3-82ac02402f7e None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:00.673062 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce7f72-82c7-4a06-b427-1dd933636e2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:00.674532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce7f72-82c7-4a06-b427-1dd933636e2a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:00.688743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-d9ce7f72-82c7-4a06-b427-1dd933636e2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:00.688743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:00.688743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:00.688743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:00.688743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:00.688743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:00.688743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:00.688743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:00.688743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:00.688743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:00.688743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:00.688743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:00.688743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:17:00.688743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:17:00.688743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:17:00.689636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:17:00.689636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:00.689636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:00.689636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:00.689636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:00.689636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:00.689636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:00.689636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:00.689636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:00.689636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:00.689636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:00.689636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:00.689636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:00.689636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:00.689636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:00.689636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:00.689636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:00.690549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:17:00.690549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:17:00.690549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:17:00.690549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:17:00.690549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:17:00.690549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:17:00.690549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:00.690549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:00.690549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 330/664] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:00.691541 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9adba-4d78-4160-b7cf-4aae4b9fa65e None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:00.691541 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9adba-4d78-4160-b7cf-4aae4b9fa65e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:00.691807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9adba-4d78-4160-b7cf-4aae4b9fa65e None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:00.693213 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 331/665] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:00.695287 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9adba-4d78-4160-b7cf-4aae4b9fa65e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:00.780305 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24116d-da32-4e1d-b0a3-82ac02402f7e None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:00.794250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:00.805735 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9adba-4d78-4160-b7cf-4aae4b9fa65e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:00.813100 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:00.819610 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4e394-4d94-4bc6-9a87-880271db4652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:00.820944 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4e394-4d94-4bc6-9a87-880271db4652 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:00.821429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4e394-4d94-4bc6-9a87-880271db4652 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:00.821969 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b4e394-4d94-4bc6-9a87-880271db4652 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:00.835287 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4e394-4d94-4bc6-9a87-880271db4652 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:00.838529 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b4e394-4d94-4bc6-9a87-880271db4652 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:00.844204 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0148ae72-31bf-498b-9c6d-39bd40c44f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:00.845433 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148ae72-31bf-498b-9c6d-39bd40c44f72 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:00.845747 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148ae72-31bf-498b-9c6d-39bd40c44f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:00.846036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0148ae72-31bf-498b-9c6d-39bd40c44f72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:00.856058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-93b4e394-4d94-4bc6-9a87-880271db4652 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:00.856058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:00.856058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:00.856058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:00.856058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:00.856058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:00.856058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:00.856058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:00.856058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:00.856058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:00.856058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:00.856058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:00.856058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:00.856058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:00.856058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:00.856957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:00.856957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:00.856957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:00.856957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:00.856957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:00.856957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:00.856957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:00.856957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:00.856957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:00.856957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:00.856957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:00.856957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:00.856957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:00.856957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:00.856957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:00.856957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:00.856957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:00.857886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:00.857886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:00.857886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:00.857886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:00.858106 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148ae72-31bf-498b-9c6d-39bd40c44f72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:00.858701 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0148ae72-31bf-498b-9c6d-39bd40c44f72 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:00.860593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 335/666] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:00.861647 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4e394-4d94-4bc6-9a87-880271db4652 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:00.883137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-0148ae72-31bf-498b-9c6d-39bd40c44f72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:00.883137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:00.883137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:00.883137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:00.883137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:00.883137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:00.883137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:00.883137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:00.883137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:00.883137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:00.883137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:00.883137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:00.883137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:00.883137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:00.883137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:00.884143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:00.884143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:00.884143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:00.884143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:00.884143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:00.884143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:00.884143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:00.884143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:00.884143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:00.884143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:00.884143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:00.884143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:00.884143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:00.884143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:00.884143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:00.884143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:00.884143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:00.885208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:00.885208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:00.885208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:00.885208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:00.887656 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 332/667] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:00.889112 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2196d6-b72b-45f1-abba-6606a8dba050 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:00.889404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2196d6-b72b-45f1-abba-6606a8dba050 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:00.889684 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2196d6-b72b-45f1-abba-6606a8dba050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:00.907286 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3a2196d6-b72b-45f1-abba-6606a8dba050 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:00.908496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3a2196d6-b72b-45f1-abba-6606a8dba050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:00.975213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b4e394-4d94-4bc6-9a87-880271db4652 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:00.986027 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 333/668] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:17:00.987318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2196d6-b72b-45f1-abba-6606a8dba050 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:01.011511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8cc83-0d6b-4ab0-9220-ff8975cfdc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:01.012478 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8cc83-0d6b-4ab0-9220-ff8975cfdc1d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:01.012758 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8cc83-0d6b-4ab0-9220-ff8975cfdc1d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:01.013032 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8cc83-0d6b-4ab0-9220-ff8975cfdc1d None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:01.013852 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8cc83-0d6b-4ab0-9220-ff8975cfdc1d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:01.014167 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8cc83-0d6b-4ab0-9220-ff8975cfdc1d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:01.015661 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8cc83-0d6b-4ab0-9220-ff8975cfdc1d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:01.033959 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 336/669] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:17:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:01.033959 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8cc83-0d6b-4ab0-9220-ff8975cfdc1d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:01.068041 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:01.087447 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:01.097518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2196d6-b72b-45f1-abba-6606a8dba050 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:01.139571 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b706f-6123-4759-ac7a-08c6bc06bd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:01.140248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b706f-6123-4759-ac7a-08c6bc06bd8e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:01.140532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b706f-6123-4759-ac7a-08c6bc06bd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:01.140810 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b706f-6123-4759-ac7a-08c6bc06bd8e None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:01.143772 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b706f-6123-4759-ac7a-08c6bc06bd8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:01.143772 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b706f-6123-4759-ac7a-08c6bc06bd8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:01.143772 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4b706f-6123-4759-ac7a-08c6bc06bd8e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:01.147072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8cc83-0d6b-4ab0-9220-ff8975cfdc1d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:01.163765 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 334/670] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:01.164830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b706f-6123-4759-ac7a-08c6bc06bd8e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:01.181052 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f67a93-e66a-4679-9b56-3f4adb0baf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:01.181740 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f67a93-e66a-4679-9b56-3f4adb0baf39 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:01.182026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f67a93-e66a-4679-9b56-3f4adb0baf39 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:01.182303 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f67a93-e66a-4679-9b56-3f4adb0baf39 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:01.183023 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f67a93-e66a-4679-9b56-3f4adb0baf39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:01.183865 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f67a93-e66a-4679-9b56-3f4adb0baf39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:01.185309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f67a93-e66a-4679-9b56-3f4adb0baf39 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:01.197825 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 337/671] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:01.198659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f67a93-e66a-4679-9b56-3f4adb0baf39 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:01.299756 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b706f-6123-4759-ac7a-08c6bc06bd8e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:01.308327 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f67a93-e66a-4679-9b56-3f4adb0baf39 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:01.311503 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:01.317355 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:01.322178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ace527-f207-4a5a-b79f-4933d51f722b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:01.325463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ace527-f207-4a5a-b79f-4933d51f722b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:01.325463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ace527-f207-4a5a-b79f-4933d51f722b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:01.325463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ace527-f207-4a5a-b79f-4933d51f722b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:01.334555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ace527-f207-4a5a-b79f-4933d51f722b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:17:01.341447 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a8bef-ba7d-4862-8d0a-b53f13c4368a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:01.342127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a8bef-ba7d-4862-8d0a-b53f13c4368a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:01.342409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a8bef-ba7d-4862-8d0a-b53f13c4368a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:01.342579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-64ace527-f207-4a5a-b79f-4933d51f722b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:17:01.342579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:01.342579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:01.342579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:01.342579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:01.342579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:01.342579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:01.342579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:01.342579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:01.342579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:01.342579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:01.342579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:01.342579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:17:01.342579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:17:01.342579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:17:01.342579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:17:01.343539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:17:01.343539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:17:01.343539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:17:01.343539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:17:01.343539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:01.343539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:01.343539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:01.343539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:01.343539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:01.343539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:01.343539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:01.343539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:01.343539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:01.343539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:01.343539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:01.343539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:01.344471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:01.344471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:01.344471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:01.344471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:01.344471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:17:01.344471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:17:01.344471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:17:01.344471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:17:01.344471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:17:01.344471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:17:01.344471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:17:01.344471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:01.345125 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a8bef-ba7d-4862-8d0a-b53f13c4368a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:01.345125 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a8bef-ba7d-4862-8d0a-b53f13c4368a None admin] RBAC: Adding query filter params (role.id=1f864eb92c9545bfb36cb24aff0401e4, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=bdb0a04d568e4b14b07cd6d6092bc49f) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:01.345258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 335/672] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:17:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:01.345343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a8bef-ba7d-4862-8d0a-b53f13c4368a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:01.345413 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ace527-f207-4a5a-b79f-4933d51f722b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:01.345493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a8bef-ba7d-4862-8d0a-b53f13c4368a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:01.358244 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 338/673] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:17:01 2022] GET /identity/v3/role_assignments?user.id=bdb0a04d568e4b14b07cd6d6092bc49f&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=1f864eb92c9545bfb36cb24aff0401e4 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:01.358244 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a8bef-ba7d-4862-8d0a-b53f13c4368a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:01.459836 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a8bef-ba7d-4862-8d0a-b53f13c4368a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:01.461498 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ace527-f207-4a5a-b79f-4933d51f722b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:01.497527 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f338b1-38b5-47ab-81f7-3629f0a6c88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:01.498402 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f338b1-38b5-47ab-81f7-3629f0a6c88f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:01.498692 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f338b1-38b5-47ab-81f7-3629f0a6c88f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:01.498969 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f338b1-38b5-47ab-81f7-3629f0a6c88f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:01.500572 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f18c7-ca72-4251-bc4a-8997005650b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:01.501369 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f18c7-ca72-4251-bc4a-8997005650b0 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:01.502434 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f18c7-ca72-4251-bc4a-8997005650b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:01.502718 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f18c7-ca72-4251-bc4a-8997005650b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:01.506324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f338b1-38b5-47ab-81f7-3629f0a6c88f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:01.507788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f338b1-38b5-47ab-81f7-3629f0a6c88f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:01.510384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f18c7-ca72-4251-bc4a-8997005650b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:01.512412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f18c7-ca72-4251-bc4a-8997005650b0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:01.524484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-04f338b1-38b5-47ab-81f7-3629f0a6c88f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:01.524484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:01.524484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:01.524484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:01.524484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:01.524484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:01.524484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:01.524484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:01.524484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:01.524484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:01.524484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:01.524484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:01.524484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:17:01.524484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:17:01.524484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:17:01.525571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:17:01.525571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:01.525571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:01.525571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:01.525571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:01.525571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:01.525571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:01.525571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:01.525571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:01.525571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:01.525571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:01.525571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:01.525571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:01.525571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:01.525571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:01.525571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:01.525571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:01.526601 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:17:01.526601 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:17:01.526601 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:17:01.526601 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:17:01.526601 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:17:01.526601 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:17:01.526601 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:01.526601 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:01.526601 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 339/674] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:01.527218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-1f6f18c7-ca72-4251-bc4a-8997005650b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:01.527218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:01.527218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:01.527218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:01.527218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:01.527218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:01.527218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:01.527218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:01.527218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:01.527218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:01.527218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:01.527218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:01.527218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:17:01.527218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:17:01.527218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:17:01.528144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:17:01.528144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:01.528144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:01.528144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:01.528144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:01.528144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:01.528144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:01.528144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:01.528144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:01.528144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:01.528144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:01.528144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:01.528144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:01.528144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:01.528144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:01.528144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:01.528144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:01.529019 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:17:01.529019 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:17:01.529019 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:17:01.529019 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:17:01.529019 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:17:01.529019 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:17:01.529019 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:01.529019 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:01.529547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8dad5-b184-409a-9144-a8fe84d811f3 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:01.529547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8dad5-b184-409a-9144-a8fe84d811f3 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:01.530496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 336/675] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:01.530612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8dad5-b184-409a-9144-a8fe84d811f3 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:01.530713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f18c7-ca72-4251-bc4a-8997005650b0 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:01.533221 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 340/676] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:01.534408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6a734-3a39-4a83-9baa-238188c9b678 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:01.534695 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6a734-3a39-4a83-9baa-238188c9b678 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:01.534969 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac6a734-3a39-4a83-9baa-238188c9b678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:01.554070 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-2ac6a734-3a39-4a83-9baa-238188c9b678 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:01.555279 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2ac6a734-3a39-4a83-9baa-238188c9b678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:01.583751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:01.588036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:01.632697 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 341/677] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:17:01.633453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6a734-3a39-4a83-9baa-238188c9b678 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:01.642138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f18c7-ca72-4251-bc4a-8997005650b0 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:01.684656 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e885f-8e2b-4688-b846-c3cc9514f223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:01.685331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e885f-8e2b-4688-b846-c3cc9514f223 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:01.685614 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e885f-8e2b-4688-b846-c3cc9514f223 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:01.685930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e885f-8e2b-4688-b846-c3cc9514f223 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:01.686676 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e885f-8e2b-4688-b846-c3cc9514f223 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:01.686988 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e885f-8e2b-4688-b846-c3cc9514f223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:01.688357 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543e885f-8e2b-4688-b846-c3cc9514f223 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:01.701176 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 337/678] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:17:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:01.701176 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e885f-8e2b-4688-b846-c3cc9514f223 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:01.746195 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac6a734-3a39-4a83-9baa-238188c9b678 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:01.781377 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc47c4-0685-4f4c-8a57-5b9bbc6bfc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:01.782109 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc47c4-0685-4f4c-8a57-5b9bbc6bfc6c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:01.782398 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc47c4-0685-4f4c-8a57-5b9bbc6bfc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:01.782677 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc47c4-0685-4f4c-8a57-5b9bbc6bfc6c None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:01.783465 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc47c4-0685-4f4c-8a57-5b9bbc6bfc6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:01.783777 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc47c4-0685-4f4c-8a57-5b9bbc6bfc6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:01.785210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc47c4-0685-4f4c-8a57-5b9bbc6bfc6c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:01.797304 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 342/679] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:17:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:01.798146 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc47c4-0685-4f4c-8a57-5b9bbc6bfc6c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:01.813992 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e885f-8e2b-4688-b846-c3cc9514f223 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:01.818842 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:01.829969 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:01.852946 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f87ea-5850-42f3-a546-238f819ff7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:01.853627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f87ea-5850-42f3-a546-238f819ff7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:01.853965 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f87ea-5850-42f3-a546-238f819ff7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:01.854249 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f87ea-5850-42f3-a546-238f819ff7a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:01.855108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f87ea-5850-42f3-a546-238f819ff7a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:01.855426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f87ea-5850-42f3-a546-238f819ff7a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:01.856974 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008f87ea-5850-42f3-a546-238f819ff7a3 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:01.869312 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 338/680] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:17:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:01.875044 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f87ea-5850-42f3-a546-238f819ff7a3 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:01.914575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc47c4-0685-4f4c-8a57-5b9bbc6bfc6c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:01.954003 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d0c50-f6ec-435a-b6a9-afb0d07f0d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:01.954915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d0c50-f6ec-435a-b6a9-afb0d07f0d4a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:01.955202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d0c50-f6ec-435a-b6a9-afb0d07f0d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:01.955480 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d0c50-f6ec-435a-b6a9-afb0d07f0d4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:01.966827 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d0c50-f6ec-435a-b6a9-afb0d07f0d4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:17:01.974793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-797d0c50-f6ec-435a-b6a9-afb0d07f0d4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:17:01.974793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:01.974793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:01.974793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:01.974793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:01.974793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:01.974793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:01.974793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:01.974793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:01.974793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:01.974793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:01.974793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:01.974793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:17:01.974793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:17:01.974793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:17:01.974793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:17:01.975728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:17:01.975728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:17:01.975728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:17:01.975728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:17:01.975728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:01.975728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:01.975728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:01.975728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:01.975728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:01.975728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:01.975728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:01.975728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:01.975728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:01.975728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:01.975728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:01.975728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:01.976583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:01.976583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:01.976583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:01.976583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:01.976583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:17:01.976583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:17:01.976583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:17:01.976583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:17:01.976583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:17:01.976583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:17:01.976583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:17:01.976583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:01.976583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 343/681] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:17:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:01.976583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d0c50-f6ec-435a-b6a9-afb0d07f0d4a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:01.983415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f87ea-5850-42f3-a546-238f819ff7a3 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:02.020282 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa46d3-39c6-47c6-8290-db09d5c22e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:02.022075 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa46d3-39c6-47c6-8290-db09d5c22e58 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:02.027541 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa46d3-39c6-47c6-8290-db09d5c22e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:02.027541 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa46d3-39c6-47c6-8290-db09d5c22e58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:02.037726 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa46d3-39c6-47c6-8290-db09d5c22e58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:02.039336 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aa46d3-39c6-47c6-8290-db09d5c22e58 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:02.059070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-41aa46d3-39c6-47c6-8290-db09d5c22e58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:02.059070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:02.059070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:02.059070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:02.059070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:02.059070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:02.059070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:02.059070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:02.059070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:02.059070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:02.059070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:02.059070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:02.059070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:02.059070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:02.059070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:02.060142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:02.060142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:02.060142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:02.060142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:02.060142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:02.060142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:02.060142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:02.060142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:02.060142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:02.060142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:02.060142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:02.060142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:02.060142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:02.060142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:02.060142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:02.060142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:02.060142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:02.061170 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:02.061170 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:02.061170 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:02.061170 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:02.062520 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:02.067208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 339/682] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:02.067208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa46d3-39c6-47c6-8290-db09d5c22e58 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:02.091544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d0c50-f6ec-435a-b6a9-afb0d07f0d4a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:02.096491 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:02.127633 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7eb4d-025b-4d44-b2cf-593575ab51bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:02.128291 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7eb4d-025b-4d44-b2cf-593575ab51bd None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:02.128573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7eb4d-025b-4d44-b2cf-593575ab51bd None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:02.128849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7eb4d-025b-4d44-b2cf-593575ab51bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:02.132191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7eb4d-025b-4d44-b2cf-593575ab51bd None admin] RBAC: Adding query filter params (role.id=1f864eb92c9545bfb36cb24aff0401e4, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=fa9e6d3fe3e740e6aedab33d727ec478) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:02.132191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7eb4d-025b-4d44-b2cf-593575ab51bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:02.132703 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e7eb4d-025b-4d44-b2cf-593575ab51bd None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:02.140069 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 344/683] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:17:01 2022] GET /identity/v3/role_assignments?user.id=fa9e6d3fe3e740e6aedab33d727ec478&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=1f864eb92c9545bfb36cb24aff0401e4 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:02.141301 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7eb4d-025b-4d44-b2cf-593575ab51bd None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:02.217334 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa46d3-39c6-47c6-8290-db09d5c22e58 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:02.267626 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed02ba2-4b56-420b-981e-d1917bb5b6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:02.268978 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed02ba2-4b56-420b-981e-d1917bb5b6bd None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:02.270100 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed02ba2-4b56-420b-981e-d1917bb5b6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:02.270794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed02ba2-4b56-420b-981e-d1917bb5b6bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:02.271802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed02ba2-4b56-420b-981e-d1917bb5b6bd None admin] RBAC: Adding query filter params (role.id=1f864eb92c9545bfb36cb24aff0401e4, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=b8948dc6a55344eaa85e2a6092215ec6) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:02.272315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed02ba2-4b56-420b-981e-d1917bb5b6bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:02.272777 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7eb4d-025b-4d44-b2cf-593575ab51bd None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:02.274128 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed02ba2-4b56-420b-981e-d1917bb5b6bd None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:02.284207 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 340/684] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:17:02 2022] GET /identity/v3/role_assignments?user.id=b8948dc6a55344eaa85e2a6092215ec6&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=1f864eb92c9545bfb36cb24aff0401e4 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:02.285316 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed02ba2-4b56-420b-981e-d1917bb5b6bd None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:02.314070 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095240b-7aad-42c4-82bd-8a8b150a48ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:02.314712 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095240b-7aad-42c4-82bd-8a8b150a48ac None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:02.315099 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095240b-7aad-42c4-82bd-8a8b150a48ac None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:02.315480 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095240b-7aad-42c4-82bd-8a8b150a48ac None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:02.316373 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095240b-7aad-42c4-82bd-8a8b150a48ac None admin] RBAC: Adding query filter params (name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:02.316840 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095240b-7aad-42c4-82bd-8a8b150a48ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:02.318812 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095240b-7aad-42c4-82bd-8a8b150a48ac None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:02.329677 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 345/685] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jul 18 02:17:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:02.334904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095240b-7aad-42c4-82bd-8a8b150a48ac None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:02.339187 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:02.389722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:02.400284 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed02ba2-4b56-420b-981e-d1917bb5b6bd None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:02.440420 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8541ffd-50c0-4106-afe9-b3b000b374ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:02.441543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8541ffd-50c0-4106-afe9-b3b000b374ca None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:02.442130 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8541ffd-50c0-4106-afe9-b3b000b374ca None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:02.442544 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8541ffd-50c0-4106-afe9-b3b000b374ca None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:02.443419 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8541ffd-50c0-4106-afe9-b3b000b374ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:02.443897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8541ffd-50c0-4106-afe9-b3b000b374ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:02.445472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8541ffd-50c0-4106-afe9-b3b000b374ca None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:02.457017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095240b-7aad-42c4-82bd-8a8b150a48ac None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:02.459483 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 341/686] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:02.470847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8541ffd-50c0-4106-afe9-b3b000b374ca None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:02.496086 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c949d-8f4f-4fd9-8371-ded343af2acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:02.496906 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c949d-8f4f-4fd9-8371-ded343af2acc None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:02.497190 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c949d-8f4f-4fd9-8371-ded343af2acc None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:02.497583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c949d-8f4f-4fd9-8371-ded343af2acc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:02.511917 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c949d-8f4f-4fd9-8371-ded343af2acc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:02.513561 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c949d-8f4f-4fd9-8371-ded343af2acc None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:02.534194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-e57c949d-8f4f-4fd9-8371-ded343af2acc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:02.534194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:02.534194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:02.534194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:02.534194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:02.534194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:02.534194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:02.534194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:02.534194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:02.534194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:02.534194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:02.534194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:02.534194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:02.534194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:02.534194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:02.535329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:02.535329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:02.535329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:02.535329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:02.535329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:02.535329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:02.535329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:02.535329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:02.535329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:02.535329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:02.535329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:02.535329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:02.535329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:02.535329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:02.535329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:02.535329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:02.535329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:02.536624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:02.536624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:02.536624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:02.536624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:02.536624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 346/687] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:02.540844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c949d-8f4f-4fd9-8371-ded343af2acc None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:02.613058 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8541ffd-50c0-4106-afe9-b3b000b374ca None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:02.613835 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:02.652338 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc72bfc-3926-49fa-ba0e-f72117fd67a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:02.653992 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc72bfc-3926-49fa-ba0e-f72117fd67a2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:02.654458 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc72bfc-3926-49fa-ba0e-f72117fd67a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:02.654885 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc72bfc-3926-49fa-ba0e-f72117fd67a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:02.659634 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c949d-8f4f-4fd9-8371-ded343af2acc None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:02.664409 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc72bfc-3926-49fa-ba0e-f72117fd67a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:02.666138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc72bfc-3926-49fa-ba0e-f72117fd67a2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:02.682857 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-1bc72bfc-3926-49fa-ba0e-f72117fd67a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 02:17:02.682857 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:02.682857 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:02.682857 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:02.682857 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:02.682857 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:02.682857 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:02.682857 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:02.682857 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:02.682857 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:02.682857 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:02.682857 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:02.682857 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:17:02.682857 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:17:02.682857 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:17:02.682857 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:17:02.684133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:02.684133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:02.684133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:17:02.684133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:02.684133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:17:02.684133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:02.684133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:02.684133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:02.684133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:02.684133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:02.684133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:02.684133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:02.684133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:02.684133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:02.684133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:02.684133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:02.684133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:02.684133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:02.685253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:02.685253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:02.685253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:17:02.685253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:17:02.685253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:17:02.685253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:17:02.685253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:17:02.685253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:17:02.685253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 02:17:02.685253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:02.687750 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 342/688] 10.222.0.64 () {56 vars in 1093 bytes} [Mon Jul 18 02:17:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:02.693094 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc72bfc-3926-49fa-ba0e-f72117fd67a2 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:02.698996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa7a91-784a-4f9d-8d1c-916242a52255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:02.699166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa7a91-784a-4f9d-8d1c-916242a52255 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:02.699400 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa7a91-784a-4f9d-8d1c-916242a52255 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:02.699676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa7a91-784a-4f9d-8d1c-916242a52255 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:02.700398 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa7a91-784a-4f9d-8d1c-916242a52255 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:02.700706 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa7a91-784a-4f9d-8d1c-916242a52255 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:02.702213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efa7a91-784a-4f9d-8d1c-916242a52255 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:02.710576 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:02.716248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 347/689] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:02.721631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa7a91-784a-4f9d-8d1c-916242a52255 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:02.841980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc72bfc-3926-49fa-ba0e-f72117fd67a2 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:02.858598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efa7a91-784a-4f9d-8d1c-916242a52255 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:02.885594 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:02.899816 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e61a53-d898-4f0d-b948-80cfcf75b187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:02.899816 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e61a53-d898-4f0d-b948-80cfcf75b187 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:02.899816 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e61a53-d898-4f0d-b948-80cfcf75b187 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:02.899816 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e61a53-d898-4f0d-b948-80cfcf75b187 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:02.900377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e61a53-d898-4f0d-b948-80cfcf75b187 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:02.900671 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e61a53-d898-4f0d-b948-80cfcf75b187 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:02.902132 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e61a53-d898-4f0d-b948-80cfcf75b187 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:02.913843 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47643e69-9604-4378-b687-d97d4c47845a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:02.914979 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47643e69-9604-4378-b687-d97d4c47845a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:02.915497 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47643e69-9604-4378-b687-d97d4c47845a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:02.915962 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47643e69-9604-4378-b687-d97d4c47845a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:02.927494 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47643e69-9604-4378-b687-d97d4c47845a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:02.929251 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47643e69-9604-4378-b687-d97d4c47845a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:02.940056 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 343/690] 10.222.0.64 () {56 vars in 1133 bytes} [Mon Jul 18 02:17:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:02.945194 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e61a53-d898-4f0d-b948-80cfcf75b187 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:02.946802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-47643e69-9604-4378-b687-d97d4c47845a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 02:17:02.946802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:02.946802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:02.946802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:02.946802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:02.946802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:02.946802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:02.946802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:02.946802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:02.946802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:02.946802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:02.946802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:02.946802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:17:02.946802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:17:02.946802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:17:02.946802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:17:02.947722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:02.947722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:02.947722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:17:02.947722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:02.947722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:17:02.947722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:02.947722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:02.947722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:02.947722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:02.947722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:02.947722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:02.947722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:02.947722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:02.947722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:02.947722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:02.947722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:02.947722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:02.947722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:02.948801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:02.948801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:02.948801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:17:02.948801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:17:02.948801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:17:02.948801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:17:02.948801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:17:02.948801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:17:02.948801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 02:17:02.948801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:02.951450 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 348/691] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:17:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:02.960631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47643e69-9604-4378-b687-d97d4c47845a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:03.102251 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47643e69-9604-4378-b687-d97d4c47845a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:03.114089 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:03.142826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c076e9b-c0ce-4101-8e5d-e708eaba91f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:03.143850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c076e9b-c0ce-4101-8e5d-e708eaba91f9 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:03.144351 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c076e9b-c0ce-4101-8e5d-e708eaba91f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:03.145024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c076e9b-c0ce-4101-8e5d-e708eaba91f9 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:03.149723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c076e9b-c0ce-4101-8e5d-e708eaba91f9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:03.149723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c076e9b-c0ce-4101-8e5d-e708eaba91f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:03.149723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c076e9b-c0ce-4101-8e5d-e708eaba91f9 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:03.166553 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 349/692] 10.222.0.64 () {56 vars in 1135 bytes} [Mon Jul 18 02:17:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:03.172846 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c076e9b-c0ce-4101-8e5d-e708eaba91f9 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:03.200898 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e61a53-d898-4f0d-b948-80cfcf75b187 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:03.240678 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:03.283873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720b9e0-ec53-47e7-b5eb-008072741f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:03.284538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720b9e0-ec53-47e7-b5eb-008072741f2b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:03.284830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720b9e0-ec53-47e7-b5eb-008072741f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:03.285119 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e720b9e0-ec53-47e7-b5eb-008072741f2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:03.316216 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c076e9b-c0ce-4101-8e5d-e708eaba91f9 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:03.353572 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21a294-c8eb-4ffb-b1a6-df45ca19c039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:03.354290 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21a294-c8eb-4ffb-b1a6-df45ca19c039 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:03.354578 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21a294-c8eb-4ffb-b1a6-df45ca19c039 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:03.354896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb21a294-c8eb-4ffb-b1a6-df45ca19c039 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:03.407341 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720b9e0-ec53-47e7-b5eb-008072741f2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:03.408808 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e720b9e0-ec53-47e7-b5eb-008072741f2b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:03.426793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21a294-c8eb-4ffb-b1a6-df45ca19c039 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:03.428278 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb21a294-c8eb-4ffb-b1a6-df45ca19c039 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:03.463351 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:03.477936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:03.516787 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 344/693] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:17:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:03.527206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720b9e0-ec53-47e7-b5eb-008072741f2b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:03.540340 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 350/694] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:17:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 02:17:03.545521 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21a294-c8eb-4ffb-b1a6-df45ca19c039 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:03.669935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e720b9e0-ec53-47e7-b5eb-008072741f2b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:03.691243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb21a294-c8eb-4ffb-b1a6-df45ca19c039 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:03.710639 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e966679e-80b0-40a9-897f-86371999ec32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:03.711927 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966679e-80b0-40a9-897f-86371999ec32 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:03.712393 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966679e-80b0-40a9-897f-86371999ec32 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:03.713090 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e966679e-80b0-40a9-897f-86371999ec32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:03.727267 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966679e-80b0-40a9-897f-86371999ec32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:03.729840 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e966679e-80b0-40a9-897f-86371999ec32 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:03.734133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae848c2-0b81-497d-bf94-ca79e516f113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:03.735068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae848c2-0b81-497d-bf94-ca79e516f113 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:03.735454 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae848c2-0b81-497d-bf94-ca79e516f113 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:03.735832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae848c2-0b81-497d-bf94-ca79e516f113 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:03.737988 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:03.748926 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae848c2-0b81-497d-bf94-ca79e516f113 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:03.753753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae848c2-0b81-497d-bf94-ca79e516f113 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:03.753884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-e966679e-80b0-40a9-897f-86371999ec32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:03.753884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:03.753884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:03.753884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:03.753884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:03.753884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:03.753884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:03.753884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:03.753884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:03.753884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:03.753884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:03.753884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:03.753884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:03.753884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:03.753884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:03.754730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:03.754730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:03.754730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:03.754730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:03.754730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:03.754730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:03.754730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:03.754730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:03.754730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:03.754730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:03.754730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:03.754730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:03.754730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:03.754730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:03.754730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:03.754730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:03.754730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:03.755627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:03.755627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:03.755627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:03.755627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:03.757869 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 345/695] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:03.760664 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a856a12-d4df-4bc7-874a-b1d4c0927377 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:03.760953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a856a12-d4df-4bc7-874a-b1d4c0927377 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:03.764447 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a856a12-d4df-4bc7-874a-b1d4c0927377 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:03.764447 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 346/696] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:03.764447 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a856a12-d4df-4bc7-874a-b1d4c0927377 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:03.776154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-cae848c2-0b81-497d-bf94-ca79e516f113 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:03.776154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:03.776154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:03.776154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:03.776154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:03.776154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:03.776154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:03.776154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:03.776154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:03.776154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:03.776154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:03.776154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:03.776154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:03.776154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:03.776154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:03.777142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:03.777142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:03.777142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:03.777142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:03.777142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:03.777142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:03.777142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:03.777142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:03.777142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:03.777142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:03.777142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:03.777142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:03.777142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:03.777142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:03.777142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:03.777142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:03.777142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:03.778072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:03.778072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:03.778072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:03.778072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:03.782201 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 351/697] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:03.783570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daef46-9ca1-4b74-9f2b-c7c326e1556b None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:03.783972 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daef46-9ca1-4b74-9f2b-c7c326e1556b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:03.784261 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9daef46-9ca1-4b74-9f2b-c7c326e1556b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:03.786914 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:03.803009 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-f9daef46-9ca1-4b74-9f2b-c7c326e1556b None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:03.804399 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f9daef46-9ca1-4b74-9f2b-c7c326e1556b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:03.871375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a856a12-d4df-4bc7-874a-b1d4c0927377 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:03.886650 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 352/698] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:17:03.887782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9daef46-9ca1-4b74-9f2b-c7c326e1556b None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:03.906929 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4c5bd-a4b6-413f-9435-0560342bfe2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:03.907660 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4c5bd-a4b6-413f-9435-0560342bfe2a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:03.907953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4c5bd-a4b6-413f-9435-0560342bfe2a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:03.908231 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c4c5bd-a4b6-413f-9435-0560342bfe2a None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:03.908953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4c5bd-a4b6-413f-9435-0560342bfe2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:03.909259 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4c5bd-a4b6-413f-9435-0560342bfe2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:03.917819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c4c5bd-a4b6-413f-9435-0560342bfe2a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:03.923323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 347/699] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:03.928817 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4c5bd-a4b6-413f-9435-0560342bfe2a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:04.008211 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9daef46-9ca1-4b74-9f2b-c7c326e1556b None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:04.018090 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:04.025327 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:04.037828 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c4c5bd-a4b6-413f-9435-0560342bfe2a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:04.049354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb1c5f-dbd3-49c4-a158-d9f3480eaefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:04.050823 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb1c5f-dbd3-49c4-a158-d9f3480eaefb None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:04.051568 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb1c5f-dbd3-49c4-a158-d9f3480eaefb None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:04.052135 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb1c5f-dbd3-49c4-a158-d9f3480eaefb None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:04.052925 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb1c5f-dbd3-49c4-a158-d9f3480eaefb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:04.053311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb1c5f-dbd3-49c4-a158-d9f3480eaefb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:04.055041 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb1c5f-dbd3-49c4-a158-d9f3480eaefb None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:04.076196 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 353/700] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:04.076196 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb1c5f-dbd3-49c4-a158-d9f3480eaefb None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:04.084833 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b4c5a-3546-490d-bd27-ba0a526562e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:04.086375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b4c5a-3546-490d-bd27-ba0a526562e5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:04.086878 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b4c5a-3546-490d-bd27-ba0a526562e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:04.087702 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562b4c5a-3546-490d-bd27-ba0a526562e5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:04.088549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b4c5a-3546-490d-bd27-ba0a526562e5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:04.091271 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562b4c5a-3546-490d-bd27-ba0a526562e5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:04.112859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-562b4c5a-3546-490d-bd27-ba0a526562e5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 02:17:04.112859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:04.112859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:17:04.112859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:17:04.112859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:17:04.112859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:17:04.112859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:17:04.112859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:04.112859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 02:17:04.112859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:04.112859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:04.112859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:04.112859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:04.112859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:04.112859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:04.112859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:04.113916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:04.113916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:04.113916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:04.113916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:04.113916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:04.113916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:04.113916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:04.113916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:17:04.113916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:17:04.113916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:17:04.113916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:17:04.113916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:04.113916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:04.113916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:04.113916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:04.113916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:04.114874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:04.114874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:04.114874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:04.114874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:04.114874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:04.114874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:04.114874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:04.114874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:04.114874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:04.114874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:04.114874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:04.114874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:17:04.114874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:04.114874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 02:17:04.114874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:04.123296 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 348/701] 10.222.0.64 () {56 vars in 1129 bytes} [Mon Jul 18 02:17:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:04.123296 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b4c5a-3546-490d-bd27-ba0a526562e5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:04.202442 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb1c5f-dbd3-49c4-a158-d9f3480eaefb None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:04.227974 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562b4c5a-3546-490d-bd27-ba0a526562e5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:04.238589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158e528-f897-4afb-95f2-3f51e82bb6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:04.239670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158e528-f897-4afb-95f2-3f51e82bb6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:04.240167 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158e528-f897-4afb-95f2-3f51e82bb6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:04.240697 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2158e528-f897-4afb-95f2-3f51e82bb6a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:04.248419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158e528-f897-4afb-95f2-3f51e82bb6a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:04.250130 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2158e528-f897-4afb-95f2-3f51e82bb6a1 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:04.263591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31c335-1880-4d64-9468-917f54a49bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:04.264393 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31c335-1880-4d64-9468-917f54a49bbe None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:04.264687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31c335-1880-4d64-9468-917f54a49bbe None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:04.264970 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac31c335-1880-4d64-9468-917f54a49bbe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:04.265783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-2158e528-f897-4afb-95f2-3f51e82bb6a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:04.265783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:04.265783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:04.265783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:04.265783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:04.265783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:04.265783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:04.265783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:04.265783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:04.265783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:04.265783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:04.265783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:04.265783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:17:04.265783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:17:04.265783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:17:04.266676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:17:04.266676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:04.266676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:04.266676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:04.266676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:04.266676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:04.266676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:04.266676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:04.266676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:04.266676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:04.266676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:04.266676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:04.266676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:04.266676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:04.266676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:04.266676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:04.266676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:04.267631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:17:04.267631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:17:04.267631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:17:04.267631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:17:04.267631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:17:04.267631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:17:04.267631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:04.267631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:04.274218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31c335-1880-4d64-9468-917f54a49bbe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:04.274218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac31c335-1880-4d64-9468-917f54a49bbe None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:04.274851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 354/702] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:04.275864 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158e528-f897-4afb-95f2-3f51e82bb6a1 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:04.288763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-ac31c335-1880-4d64-9468-917f54a49bbe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:04.288763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:04.288763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:04.288763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:04.288763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:04.288763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:04.288763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:04.288763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:04.288763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:04.288763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:04.288763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:04.288763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:04.288763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:17:04.288763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:17:04.288763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:17:04.289645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:17:04.289645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:04.289645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:04.289645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:04.289645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:04.289645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:04.289645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:04.289645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:04.289645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:04.289645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:04.289645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:04.289645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:04.289645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:04.289645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:04.289645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:04.289645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:04.289645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:04.290573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:17:04.290573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:17:04.290573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:17:04.290573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:17:04.290573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:17:04.290573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:17:04.290573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:04.290573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:04.293812 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 349/703] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:04.294623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31c335-1880-4d64-9468-917f54a49bbe None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:04.317214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:04.322065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:04.386702 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2158e528-f897-4afb-95f2-3f51e82bb6a1 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:04.399875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac31c335-1880-4d64-9468-917f54a49bbe None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:04.423412 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db20e47-dc62-4a76-afc3-dab297740323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:04.424453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db20e47-dc62-4a76-afc3-dab297740323 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:04.425203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db20e47-dc62-4a76-afc3-dab297740323 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:04.425680 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db20e47-dc62-4a76-afc3-dab297740323 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:04.426621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db20e47-dc62-4a76-afc3-dab297740323 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:04.427129 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db20e47-dc62-4a76-afc3-dab297740323 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:04.428726 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db20e47-dc62-4a76-afc3-dab297740323 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:04.437745 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701107f-1fe8-48d1-b4f9-55a59920b352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:04.437745 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701107f-1fe8-48d1-b4f9-55a59920b352 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:04.437745 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701107f-1fe8-48d1-b4f9-55a59920b352 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:04.438083 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701107f-1fe8-48d1-b4f9-55a59920b352 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:04.438606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 355/704] 10.222.0.64 () {56 vars in 1124 bytes} [Mon Jul 18 02:17:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:04.439176 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701107f-1fe8-48d1-b4f9-55a59920b352 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:04.439496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701107f-1fe8-48d1-b4f9-55a59920b352 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:04.439729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db20e47-dc62-4a76-afc3-dab297740323 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:04.440918 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701107f-1fe8-48d1-b4f9-55a59920b352 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:04.454231 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 350/705] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:17:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:04.455065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701107f-1fe8-48d1-b4f9-55a59920b352 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:04.524553 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:04.546788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:04.550778 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db20e47-dc62-4a76-afc3-dab297740323 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:04.580743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701107f-1fe8-48d1-b4f9-55a59920b352 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:04.587222 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3e3e2-fbe1-40b3-9313-e9389078a182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:04.588098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3e3e2-fbe1-40b3-9313-e9389078a182 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:04.588381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3e3e2-fbe1-40b3-9313-e9389078a182 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:04.588658 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3e3e2-fbe1-40b3-9313-e9389078a182 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:04.589510 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c3e3e2-fbe1-40b3-9313-e9389078a182 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:04.589868 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c3e3e2-fbe1-40b3-9313-e9389078a182 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:04.591306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c3e3e2-fbe1-40b3-9313-e9389078a182 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:04.606211 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 356/706] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:17:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:04.607041 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3e3e2-fbe1-40b3-9313-e9389078a182 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:04.624866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db83b36-4946-472b-8619-8119e7b484c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:04.625540 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db83b36-4946-472b-8619-8119e7b484c1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:04.625860 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db83b36-4946-472b-8619-8119e7b484c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:04.626130 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db83b36-4946-472b-8619-8119e7b484c1 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:04.626831 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db83b36-4946-472b-8619-8119e7b484c1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:04.627132 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db83b36-4946-472b-8619-8119e7b484c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:04.628492 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db83b36-4946-472b-8619-8119e7b484c1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:04.634379 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 351/707] 10.222.0.64 () {56 vars in 1124 bytes} [Mon Jul 18 02:17:04 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:04.635670 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6dbbe-e58a-42b5-b954-5366fc53263e None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:04.636455 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6dbbe-e58a-42b5-b954-5366fc53263e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:04.636735 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db6dbbe-e58a-42b5-b954-5366fc53263e None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:04.641750 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 352/708] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:04.641750 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6dbbe-e58a-42b5-b954-5366fc53263e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:04.730432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3e3e2-fbe1-40b3-9313-e9389078a182 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:04.768355 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24efa23-e317-408e-8c07-d6de4e367874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:04.769321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24efa23-e317-408e-8c07-d6de4e367874 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:04.769979 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24efa23-e317-408e-8c07-d6de4e367874 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:04.770397 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24efa23-e317-408e-8c07-d6de4e367874 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:04.771423 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24efa23-e317-408e-8c07-d6de4e367874 None admin] RBAC: Adding query filter params (role.id=5dfa34e7a4594751aed7c0495c9a2383, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=6f51aae36f0b42868567840fa957ffe9) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:04.771920 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24efa23-e317-408e-8c07-d6de4e367874 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:04.773694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24efa23-e317-408e-8c07-d6de4e367874 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:04.781223 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 357/709] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:17:04 2022] GET /identity/v3/role_assignments?user.id=6f51aae36f0b42868567840fa957ffe9&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=5dfa34e7a4594751aed7c0495c9a2383 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:04.782969 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafe8a4-42cf-4073-90a8-9f0fe6060ae9 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:04.783463 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafe8a4-42cf-4073-90a8-9f0fe6060ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:04.783944 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafe8a4-42cf-4073-90a8-9f0fe6060ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:04.786189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db6dbbe-e58a-42b5-b954-5366fc53263e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:04.811034 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-3bafe8a4-42cf-4073-90a8-9f0fe6060ae9 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:04.812272 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3bafe8a4-42cf-4073-90a8-9f0fe6060ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:04.825095 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:04.835923 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997da0bb-aa66-4857-a0ee-1bc43e4b53fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:04.844907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997da0bb-aa66-4857-a0ee-1bc43e4b53fd None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:04.844907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997da0bb-aa66-4857-a0ee-1bc43e4b53fd None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:04.845127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:04.845207 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997da0bb-aa66-4857-a0ee-1bc43e4b53fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:04.845207 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997da0bb-aa66-4857-a0ee-1bc43e4b53fd None admin] RBAC: Adding query filter params (role.id=1f864eb92c9545bfb36cb24aff0401e4, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=6a4e51f478874d99a7fc4ee2dea77caf) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:04.845207 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997da0bb-aa66-4857-a0ee-1bc43e4b53fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:04.845207 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997da0bb-aa66-4857-a0ee-1bc43e4b53fd None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:04.848335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 353/710] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:17:04 2022] GET /identity/v3/role_assignments?user.id=6a4e51f478874d99a7fc4ee2dea77caf&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=1f864eb92c9545bfb36cb24aff0401e4 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:04.908307 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 358/711] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:17:04.930727 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997da0bb-aa66-4857-a0ee-1bc43e4b53fd None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:04.988955 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41445cd-203f-4af1-b7e3-960f796c0885 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:04.989154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41445cd-203f-4af1-b7e3-960f796c0885 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:04.989422 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41445cd-203f-4af1-b7e3-960f796c0885 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:04.991038 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 359/712] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:17:04.996959 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f27269-b8dc-4c9c-8639-f7e2b0ed116b None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:04.997240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f27269-b8dc-4c9c-8639-f7e2b0ed116b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:04.997519 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f27269-b8dc-4c9c-8639-f7e2b0ed116b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:05.029817 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-84f27269-b8dc-4c9c-8639-f7e2b0ed116b None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:05.031331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-84f27269-b8dc-4c9c-8639-f7e2b0ed116b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:05.080582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997da0bb-aa66-4857-a0ee-1bc43e4b53fd None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:05.112592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 360/713] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:17:05.117422 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33d108-595e-433b-b89e-74f155e2a608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:05.118272 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33d108-595e-433b-b89e-74f155e2a608 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:05.118557 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33d108-595e-433b-b89e-74f155e2a608 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:05.118848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33d108-595e-433b-b89e-74f155e2a608 None admin] PATH_INFO: `/v3/services/network` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:05.119488 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33d108-595e-433b-b89e-74f155e2a608 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:05.120892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33d108-595e-433b-b89e-74f155e2a608 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:05.138769 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f27269-b8dc-4c9c-8639-f7e2b0ed116b None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:05.139068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-6c33d108-595e-433b-b89e-74f155e2a608 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 02:17:05.139068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:05.139068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:17:05.139068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:17:05.139068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:17:05.139068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:17:05.139068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:17:05.139068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:05.139068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 02:17:05.139068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:05.139068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:05.139068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:05.139068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:05.139068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:05.139068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:05.139068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:05.139068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:05.140091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:05.140091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:05.140091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:05.140091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:05.140091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:05.140091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:05.140091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:17:05.140091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:17:05.140091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:17:05.140091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:17:05.140091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:05.140091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:05.140091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:05.140091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:05.140091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:05.140091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:05.140897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:05.140897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:05.140897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:05.140897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:05.140897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:05.140897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:05.140897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:05.140897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:05.140897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:05.140897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:05.140897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:17:05.140897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:05.140897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 02:17:05.140897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:05.145613 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 354/714] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:04 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:05.154700 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33d108-595e-433b-b89e-74f155e2a608 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:05.218904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:05.241660 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:05.262039 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f27269-b8dc-4c9c-8639-f7e2b0ed116b None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:05.263825 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33d108-595e-433b-b89e-74f155e2a608 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:05.302839 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9469c51-b1ea-4c85-bf1e-27d0cfa4eab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:05.303205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f478c0-6153-4322-9e40-6d337eb551c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:05.303592 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9469c51-b1ea-4c85-bf1e-27d0cfa4eab4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:05.303882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9469c51-b1ea-4c85-bf1e-27d0cfa4eab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:05.304162 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9469c51-b1ea-4c85-bf1e-27d0cfa4eab4 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:05.304642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f478c0-6153-4322-9e40-6d337eb551c7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:05.304881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9469c51-b1ea-4c85-bf1e-27d0cfa4eab4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:05.305190 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9469c51-b1ea-4c85-bf1e-27d0cfa4eab4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:05.305397 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f478c0-6153-4322-9e40-6d337eb551c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:05.305845 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f478c0-6153-4322-9e40-6d337eb551c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:05.306609 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9469c51-b1ea-4c85-bf1e-27d0cfa4eab4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:05.312587 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 355/715] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jul 18 02:17:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:05.318079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9469c51-b1ea-4c85-bf1e-27d0cfa4eab4 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:05.318340 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f478c0-6153-4322-9e40-6d337eb551c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:05.320083 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f478c0-6153-4322-9e40-6d337eb551c7 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:05.340090 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-63f478c0-6153-4322-9e40-6d337eb551c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:05.340090 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:05.340090 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:05.340090 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:05.340090 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:05.340090 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:05.340090 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:05.340090 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:05.340090 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:05.340090 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:05.340090 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:05.340090 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:05.340090 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:05.340090 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:05.340090 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:05.341061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:05.341061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:05.341061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:05.341061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:05.341061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:05.341061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:05.341061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:05.341061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:05.341061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:05.341061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:05.341061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:05.341061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:05.341061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:05.341061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:05.341061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:05.341061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:05.341061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:05.342019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:05.342019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:05.342019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:05.342019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:05.344329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 361/716] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:05.350494 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f478c0-6153-4322-9e40-6d337eb551c7 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:05.435611 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9469c51-b1ea-4c85-bf1e-27d0cfa4eab4 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:05.459246 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:05.475457 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95875b97-e2c1-45b7-ae24-a8984f7c6e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:05.475817 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95875b97-e2c1-45b7-ae24-a8984f7c6e1d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:05.476106 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95875b97-e2c1-45b7-ae24-a8984f7c6e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:05.476386 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95875b97-e2c1-45b7-ae24-a8984f7c6e1d None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:05.477157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95875b97-e2c1-45b7-ae24-a8984f7c6e1d None admin] RBAC: Adding query filter params (type=network) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:05.477471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95875b97-e2c1-45b7-ae24-a8984f7c6e1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:05.478899 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95875b97-e2c1-45b7-ae24-a8984f7c6e1d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:05.488951 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 356/717] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jul 18 02:17:05 2022] GET /identity/v3/services?type=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:05.490882 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f478c0-6153-4322-9e40-6d337eb551c7 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:05.533040 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b28be-7169-449a-8d00-0c5624ecde74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:05.534130 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b28be-7169-449a-8d00-0c5624ecde74 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:05.534642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b28be-7169-449a-8d00-0c5624ecde74 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:05.535259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b28be-7169-449a-8d00-0c5624ecde74 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:05.536249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b28be-7169-449a-8d00-0c5624ecde74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:05.536783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b28be-7169-449a-8d00-0c5624ecde74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:05.538677 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b28be-7169-449a-8d00-0c5624ecde74 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:05.541913 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:05.553775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 362/718] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:05.561696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95875b97-e2c1-45b7-ae24-a8984f7c6e1d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:05.723201 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95875b97-e2c1-45b7-ae24-a8984f7c6e1d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:05.763139 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a995b683-cbc7-4499-a074-4baa188962fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:05.763819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995b683-cbc7-4499-a074-4baa188962fd None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:05.764106 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995b683-cbc7-4499-a074-4baa188962fd None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:05.764381 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a995b683-cbc7-4499-a074-4baa188962fd None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:05.765086 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995b683-cbc7-4499-a074-4baa188962fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:05.766549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a995b683-cbc7-4499-a074-4baa188962fd None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:05.866753 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 357/719] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jul 18 02:17:05 2022] POST /identity/v3/users => generated 254 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:17:06.960663 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc465c0b-a688-4909-b7a3-1b8222a0dbb0 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:06.961733 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc465c0b-a688-4909-b7a3-1b8222a0dbb0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:06.962235 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc465c0b-a688-4909-b7a3-1b8222a0dbb0 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:06.964666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 363/720] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:06.970389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b0e1d-63a3-4bcd-9293-98741eef680d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:06.971233 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b0e1d-63a3-4bcd-9293-98741eef680d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:06.971722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b0e1d-63a3-4bcd-9293-98741eef680d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:06.989933 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f61b0e1d-63a3-4bcd-9293-98741eef680d None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:06.991454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f61b0e1d-63a3-4bcd-9293-98741eef680d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:07.036090 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:07.076402 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 358/721] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:17:07.106542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc465c0b-a688-4909-b7a3-1b8222a0dbb0 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:07.170226 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79c301-3f79-4550-8464-6255d8066e72 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:07.170541 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79c301-3f79-4550-8464-6255d8066e72 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:07.170788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a79c301-3f79-4550-8464-6255d8066e72 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:07.172367 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 359/722] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:07.177464 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89fc8d-4d0c-4689-82fd-561bbddaff02 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:07.177786 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89fc8d-4d0c-4689-82fd-561bbddaff02 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:07.178070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c89fc8d-4d0c-4689-82fd-561bbddaff02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:07.195219 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-4c89fc8d-4d0c-4689-82fd-561bbddaff02 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:07.196405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4c89fc8d-4d0c-4689-82fd-561bbddaff02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:07.243359 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc465c0b-a688-4909-b7a3-1b8222a0dbb0 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:07.305125 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 360/723] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 02:17:07.305788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d621523-5cdb-464e-9d6a-44edd7d2419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:07.306473 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d621523-5cdb-464e-9d6a-44edd7d2419b None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:07.306760 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d621523-5cdb-464e-9d6a-44edd7d2419b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:07.307040 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d621523-5cdb-464e-9d6a-44edd7d2419b None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:07.308321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d621523-5cdb-464e-9d6a-44edd7d2419b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:07.309920 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d621523-5cdb-464e-9d6a-44edd7d2419b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:07.327796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89fc8d-4d0c-4689-82fd-561bbddaff02 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:07.434082 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:07.443846 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 364/724] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jul 18 02:17:07 2022] POST /identity/v3/services => generated 251 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:17:07.443996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c89fc8d-4d0c-4689-82fd-561bbddaff02 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:07.496500 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fe508-133c-4e54-a38e-a14a08148575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:07.497234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fe508-133c-4e54-a38e-a14a08148575 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:07.497523 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fe508-133c-4e54-a38e-a14a08148575 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:07.497834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fe508-133c-4e54-a38e-a14a08148575 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:07.509934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fe508-133c-4e54-a38e-a14a08148575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:17:07.518766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-5b7fe508-133c-4e54-a38e-a14a08148575 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:17:07.518766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:07.518766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:07.518766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:07.518766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:07.518766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:07.518766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:07.518766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:07.518766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:07.518766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:07.518766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:07.518766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:07.518766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:17:07.518766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:17:07.518766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:17:07.518766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:17:07.519771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:17:07.519771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:17:07.519771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:17:07.519771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:17:07.519771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:07.519771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:07.519771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:07.519771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:07.519771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:07.519771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:07.519771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:07.519771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:07.519771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:07.519771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:07.519771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:07.519771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:07.521067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:07.521067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:07.521067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:07.521067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:07.521067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:17:07.521067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:17:07.521067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:17:07.521067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:17:07.521067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:17:07.521067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:17:07.521067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:17:07.521067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:07.521067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 361/725] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:17:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:07.526223 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d621523-5cdb-464e-9d6a-44edd7d2419b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:07.601128 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:07.662391 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d621523-5cdb-464e-9d6a-44edd7d2419b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:07.701505 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451c2b0-782d-4934-8a4b-05228efce9e2 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:07.701839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff785b-ef1e-424a-96ea-71bf6a9b5247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:07.701944 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451c2b0-782d-4934-8a4b-05228efce9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:07.702173 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451c2b0-782d-4934-8a4b-05228efce9e2 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:07.702272 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff785b-ef1e-424a-96ea-71bf6a9b5247 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:07.702518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff785b-ef1e-424a-96ea-71bf6a9b5247 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:07.702793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff785b-ef1e-424a-96ea-71bf6a9b5247 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:07.703542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff785b-ef1e-424a-96ea-71bf6a9b5247 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:07.703752 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 362/726] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:07.703844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff785b-ef1e-424a-96ea-71bf6a9b5247 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:07.705202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ff785b-ef1e-424a-96ea-71bf6a9b5247 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:07.711974 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fefc6-e96b-4921-b561-e8633cf01110 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:07.711974 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fefc6-e96b-4921-b561-e8633cf01110 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:07.711974 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914fefc6-e96b-4921-b561-e8633cf01110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:07.720033 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 365/727] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:17:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:07.725592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff785b-ef1e-424a-96ea-71bf6a9b5247 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:07.737410 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-914fefc6-e96b-4921-b561-e8633cf01110 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:07.738891 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-914fefc6-e96b-4921-b561-e8633cf01110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:07.834229 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 363/728] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:07 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:17:07.845944 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff785b-ef1e-424a-96ea-71bf6a9b5247 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:07.860228 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fefc6-e96b-4921-b561-e8633cf01110 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:07.871928 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:07.891900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f2637-23ba-49f5-a05a-f410a338b18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:07.893503 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f2637-23ba-49f5-a05a-f410a338b18d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:07.894328 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f2637-23ba-49f5-a05a-f410a338b18d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:07.894818 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8f2637-23ba-49f5-a05a-f410a338b18d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:07.908543 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f2637-23ba-49f5-a05a-f410a338b18d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:07.910959 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8f2637-23ba-49f5-a05a-f410a338b18d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:07.933792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-7b8f2637-23ba-49f5-a05a-f410a338b18d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:07.933792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:07.933792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:07.933792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:07.933792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:07.933792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:07.933792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:07.933792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:07.933792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:07.933792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:07.933792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:07.933792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:07.933792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:07.933792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:07.933792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:07.934751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:07.934751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:07.934751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:07.934751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:07.934751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:07.934751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:07.934751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:07.934751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:07.934751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:07.934751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:07.934751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:07.934751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:07.934751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:07.934751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:07.934751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:07.934751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:07.934751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:07.935640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:07.935640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:07.935640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:07.935640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:07.938397 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 366/729] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:07.947383 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f2637-23ba-49f5-a05a-f410a338b18d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:08.018968 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:08.035133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914fefc6-e96b-4921-b561-e8633cf01110 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:08.072795 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a03492-fc6d-4a00-847b-c97e7696fff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:08.074194 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a03492-fc6d-4a00-847b-c97e7696fff7 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:08.074485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a03492-fc6d-4a00-847b-c97e7696fff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:08.074791 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a03492-fc6d-4a00-847b-c97e7696fff7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:08.086820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a03492-fc6d-4a00-847b-c97e7696fff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:17:08.090530 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8f2637-23ba-49f5-a05a-f410a338b18d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:08.094594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-96a03492-fc6d-4a00-847b-c97e7696fff7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:17:08.094594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:08.094594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:08.094594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:08.094594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:08.094594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:08.094594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:08.094594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:08.094594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:08.094594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:08.094594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:08.094594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:08.094594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:17:08.094594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:17:08.094594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:17:08.094594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:17:08.095532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:17:08.095532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:17:08.095532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:17:08.095532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:17:08.095532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:08.095532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:08.095532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:08.095532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:08.095532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:08.095532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:08.095532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:08.095532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:08.095532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:08.095532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:08.095532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:08.095532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:08.096373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:08.096373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:08.096373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:08.096373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:08.096373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:17:08.096373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:17:08.096373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:17:08.096373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:17:08.096373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:17:08.096373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:17:08.096373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:17:08.096373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:08.100773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 364/730] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:17:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:08.102305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ce62e-6fe4-4923-978d-322a241bd873 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:08.102421 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ce62e-6fe4-4923-978d-322a241bd873 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:08.102706 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ce62e-6fe4-4923-978d-322a241bd873 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:08.104275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 365/731] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:08.105688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ce62e-6fe4-4923-978d-322a241bd873 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:08.132125 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8a78c2-c48a-40e1-b87a-a5847265912b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:08.133176 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a78c2-c48a-40e1-b87a-a5847265912b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:08.133733 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a78c2-c48a-40e1-b87a-a5847265912b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:08.134236 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8a78c2-c48a-40e1-b87a-a5847265912b None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:08.135296 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a78c2-c48a-40e1-b87a-a5847265912b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:08.136421 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a78c2-c48a-40e1-b87a-a5847265912b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:08.139096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8a78c2-c48a-40e1-b87a-a5847265912b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:08.154023 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 367/732] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:08.155861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862efa4-6a6e-4f87-b65e-12546720439c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:08.156352 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862efa4-6a6e-4f87-b65e-12546720439c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:08.156829 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862efa4-6a6e-4f87-b65e-12546720439c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:08.175386 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-1862efa4-6a6e-4f87-b65e-12546720439c None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:08.176918 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1862efa4-6a6e-4f87-b65e-12546720439c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:08.209368 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:08.236063 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ce62e-6fe4-4923-978d-322a241bd873 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:08.256710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 368/733] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:08 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 02:17:08.257576 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862efa4-6a6e-4f87-b65e-12546720439c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:08.303527 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cdf1b-ae73-4322-a8dd-a5ba9c926b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:08.304993 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cdf1b-ae73-4322-a8dd-a5ba9c926b2b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:08.305383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cdf1b-ae73-4322-a8dd-a5ba9c926b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:08.305859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476cdf1b-ae73-4322-a8dd-a5ba9c926b2b None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:08.306718 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cdf1b-ae73-4322-a8dd-a5ba9c926b2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:08.307388 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cdf1b-ae73-4322-a8dd-a5ba9c926b2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:08.309864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476cdf1b-ae73-4322-a8dd-a5ba9c926b2b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:08.325906 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 366/734] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:17:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:08.327045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cdf1b-ae73-4322-a8dd-a5ba9c926b2b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:08.388714 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862efa4-6a6e-4f87-b65e-12546720439c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:08.427350 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc8892-299e-4758-8886-aab7f910dfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:08.428170 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc8892-299e-4758-8886-aab7f910dfa5 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:08.428453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc8892-299e-4758-8886-aab7f910dfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:08.428727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc8892-299e-4758-8886-aab7f910dfa5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:08.438154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc8892-299e-4758-8886-aab7f910dfa5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:08.439651 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc8892-299e-4758-8886-aab7f910dfa5 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:08.456030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-9dfc8892-299e-4758-8886-aab7f910dfa5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 02:17:08.456030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:08.456030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:08.456030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:08.456030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:08.456030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:08.456030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:08.456030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:08.456030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:08.456030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:08.456030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:08.456030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:08.456030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:17:08.456030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:17:08.456030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:17:08.456030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:17:08.457133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:08.457133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:08.457133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:17:08.457133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:08.457133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:17:08.457133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:08.457133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:08.457133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:08.457133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:08.457133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:08.457133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:08.457133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:08.457133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:08.457133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:08.457133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:08.457133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:08.457133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:08.457133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:08.458096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:08.458096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:08.458096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:17:08.458096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:17:08.458096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:17:08.458096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:17:08.458096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:17:08.458096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:17:08.458096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 02:17:08.458096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:08.458096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 369/735] 10.222.0.64 () {56 vars in 1093 bytes} [Mon Jul 18 02:17:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:08.463152 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc8892-299e-4758-8886-aab7f910dfa5 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:08.487860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:08.494776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:08.589838 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc8892-299e-4758-8886-aab7f910dfa5 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:08.614662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476cdf1b-ae73-4322-a8dd-a5ba9c926b2b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:08.635987 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c168f-d412-4398-9f52-bcc891a4a273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:08.637019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c168f-d412-4398-9f52-bcc891a4a273 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:08.637385 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c168f-d412-4398-9f52-bcc891a4a273 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:08.637749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c168f-d412-4398-9f52-bcc891a4a273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:08.650989 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c168f-d412-4398-9f52-bcc891a4a273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:08.653188 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c168f-d412-4398-9f52-bcc891a4a273 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:08.658715 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3634b-6363-4ae5-976a-a5defbad3a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:08.659649 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3634b-6363-4ae5-976a-a5defbad3a46 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:08.660134 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3634b-6363-4ae5-976a-a5defbad3a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:08.661121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3634b-6363-4ae5-976a-a5defbad3a46 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:08.662101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3634b-6363-4ae5-976a-a5defbad3a46 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:08.664180 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f3634b-6363-4ae5-976a-a5defbad3a46 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:08.674518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-e54c168f-d412-4398-9f52-bcc891a4a273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:08.674518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:08.674518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:08.674518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:08.674518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:08.674518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:08.674518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:08.674518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:08.674518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:08.674518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:08.674518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:08.674518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:08.674518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:08.674518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:08.674518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:08.675773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:08.675773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:08.675773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:08.675773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:08.675773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:08.675773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:08.675773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:08.675773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:08.675773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:08.675773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:08.675773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:08.675773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:08.675773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:08.675773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:08.675773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:08.675773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:08.675773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:08.676665 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:08.676665 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:08.676665 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:08.676665 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:08.680602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 370/736] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:08.681264 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c168f-d412-4398-9f52-bcc891a4a273 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:08.749837 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 367/737] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jul 18 02:17:08 2022] POST /identity/v3/services => generated 240 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:17:08.751169 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3634b-6363-4ae5-976a-a5defbad3a46 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:08.754679 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:08.788557 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c168f-d412-4398-9f52-bcc891a4a273 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:08.846640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befca260-ea39-447b-9ce7-7818beb3c0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:08.847358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befca260-ea39-447b-9ce7-7818beb3c0ee None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:08.847639 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befca260-ea39-447b-9ce7-7818beb3c0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:08.847911 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befca260-ea39-447b-9ce7-7818beb3c0ee None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:08.848774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befca260-ea39-447b-9ce7-7818beb3c0ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:08.849080 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befca260-ea39-447b-9ce7-7818beb3c0ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:08.850605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befca260-ea39-447b-9ce7-7818beb3c0ee None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:08.887174 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:08.891969 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 371/738] 10.222.0.64 () {56 vars in 1133 bytes} [Mon Jul 18 02:17:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:08.904298 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befca260-ea39-447b-9ce7-7818beb3c0ee None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:08.937389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f3634b-6363-4ae5-976a-a5defbad3a46 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:08.974902 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7592753-9d0a-4d57-83a7-4e7e52b6faf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:08.975867 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7592753-9d0a-4d57-83a7-4e7e52b6faf6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:08.976303 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7592753-9d0a-4d57-83a7-4e7e52b6faf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:08.976721 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7592753-9d0a-4d57-83a7-4e7e52b6faf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:08.977607 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7592753-9d0a-4d57-83a7-4e7e52b6faf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:08.978271 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7592753-9d0a-4d57-83a7-4e7e52b6faf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:08.980352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7592753-9d0a-4d57-83a7-4e7e52b6faf6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:08.992424 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 368/739] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:08.994047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0a988-1268-494b-8185-3d52bf7d05af None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:08.994507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0a988-1268-494b-8185-3d52bf7d05af None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:08.995489 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0a988-1268-494b-8185-3d52bf7d05af None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:08.996861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 369/740] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:08.998755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0a988-1268-494b-8185-3d52bf7d05af None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:09.021374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befca260-ea39-447b-9ce7-7818beb3c0ee None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:09.058844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:09.069879 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e967c6a8-959b-4df9-bb11-99a50e6f417e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:09.071021 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967c6a8-959b-4df9-bb11-99a50e6f417e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:09.071308 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967c6a8-959b-4df9-bb11-99a50e6f417e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:09.071948 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967c6a8-959b-4df9-bb11-99a50e6f417e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:09.086957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967c6a8-959b-4df9-bb11-99a50e6f417e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:09.089374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e967c6a8-959b-4df9-bb11-99a50e6f417e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:09.112615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-e967c6a8-959b-4df9-bb11-99a50e6f417e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:09.112615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:09.112615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:09.112615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:09.112615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:09.112615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:09.112615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:09.112615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:09.112615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:09.112615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:09.112615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:09.112615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:09.112615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:09.112615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:09.112615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:09.113995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:09.113995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:09.113995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:09.113995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:09.113995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:09.113995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:09.113995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:09.113995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:09.113995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:09.113995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:09.113995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:09.113995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:09.113995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:09.113995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:09.113995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:09.113995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:09.113995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:09.114910 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:09.114910 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:09.114910 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:09.114910 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:09.114910 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 372/741] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:09.116973 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07949727-4e3d-4a03-a70e-c4143cf13f44 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:09.118484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07949727-4e3d-4a03-a70e-c4143cf13f44 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:09.118484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07949727-4e3d-4a03-a70e-c4143cf13f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:09.120573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0a988-1268-494b-8185-3d52bf7d05af None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:09.136268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-07949727-4e3d-4a03-a70e-c4143cf13f44 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:09.137888 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-07949727-4e3d-4a03-a70e-c4143cf13f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:09.162751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:09.171892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94de1d-2ed5-407b-8365-719183926466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:09.173152 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94de1d-2ed5-407b-8365-719183926466 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:09.173499 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94de1d-2ed5-407b-8365-719183926466 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:09.174009 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c94de1d-2ed5-407b-8365-719183926466 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:09.182083 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94de1d-2ed5-407b-8365-719183926466 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:09.183964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c94de1d-2ed5-407b-8365-719183926466 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:09.200570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-7c94de1d-2ed5-407b-8365-719183926466 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 02:17:09.200570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:09.200570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:09.200570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:09.200570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:09.200570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:09.200570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:09.200570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:09.200570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:09.200570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:09.200570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:09.200570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:09.200570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:17:09.200570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:17:09.200570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:17:09.200570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:17:09.201546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:09.201546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:09.201546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:17:09.201546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:09.201546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:17:09.201546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:09.201546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:09.201546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:09.201546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:09.201546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:09.201546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:09.201546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:09.201546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:09.201546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:09.201546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:09.201546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:09.201546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:09.201546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:09.202497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:09.202497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:09.202497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:17:09.202497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:17:09.202497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:17:09.202497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:17:09.202497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:17:09.202497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:17:09.202497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 02:17:09.202497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:09.202497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 370/742] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:17:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:09.203080 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94de1d-2ed5-407b-8365-719183926466 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:09.229546 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 373/743] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:09.234849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07949727-4e3d-4a03-a70e-c4143cf13f44 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:09.310356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c94de1d-2ed5-407b-8365-719183926466 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:09.345321 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6114b5-8808-4d58-8abc-916891369b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:09.346333 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6114b5-8808-4d58-8abc-916891369b89 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:09.346824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6114b5-8808-4d58-8abc-916891369b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:09.347276 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6114b5-8808-4d58-8abc-916891369b89 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:09.348270 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6114b5-8808-4d58-8abc-916891369b89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:09.348749 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6114b5-8808-4d58-8abc-916891369b89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:09.350439 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6114b5-8808-4d58-8abc-916891369b89 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:09.364545 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 371/744] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:09.365804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6114b5-8808-4d58-8abc-916891369b89 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:09.369240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07949727-4e3d-4a03-a70e-c4143cf13f44 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:09.380455 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:09.408076 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba76616-4ad7-4b68-99e6-55d725fede1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:09.408875 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba76616-4ad7-4b68-99e6-55d725fede1b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:09.409241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba76616-4ad7-4b68-99e6-55d725fede1b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:09.410026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba76616-4ad7-4b68-99e6-55d725fede1b None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:09.410640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba76616-4ad7-4b68-99e6-55d725fede1b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:09.411024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba76616-4ad7-4b68-99e6-55d725fede1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:09.412705 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba76616-4ad7-4b68-99e6-55d725fede1b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:09.420814 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:09.433331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 374/745] 10.222.0.64 () {56 vars in 1135 bytes} [Mon Jul 18 02:17:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:09.434300 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba76616-4ad7-4b68-99e6-55d725fede1b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:09.489974 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6114b5-8808-4d58-8abc-916891369b89 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:09.533423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a69bad-bd45-4193-a0fd-78297d5cfb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:09.534675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a69bad-bd45-4193-a0fd-78297d5cfb02 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:09.535248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a69bad-bd45-4193-a0fd-78297d5cfb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:09.535534 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a69bad-bd45-4193-a0fd-78297d5cfb02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:09.546700 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba76616-4ad7-4b68-99e6-55d725fede1b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:09.548428 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a69bad-bd45-4193-a0fd-78297d5cfb02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:17:09.558985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-11a69bad-bd45-4193-a0fd-78297d5cfb02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:17:09.558985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:09.558985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:09.558985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:09.558985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:09.558985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:09.558985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:09.558985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:09.558985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:09.558985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:09.558985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:09.558985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:09.558985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:17:09.558985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:17:09.558985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:17:09.558985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:17:09.559928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:17:09.559928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:17:09.559928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:17:09.559928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:17:09.559928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:09.559928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:09.559928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:09.559928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:09.559928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:09.559928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:09.559928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:09.559928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:09.559928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:09.559928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:09.559928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:09.559928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:09.560776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:09.560776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:09.560776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:09.560776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:09.560776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:17:09.560776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:17:09.560776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:17:09.560776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:17:09.560776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:17:09.560776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:17:09.560776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:17:09.560776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:09.560776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 372/746] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:17:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:09.564307 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a69bad-bd45-4193-a0fd-78297d5cfb02 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:09.593822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ce420-fe04-488f-a99d-ce954a0fa9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:09.594641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ce420-fe04-488f-a99d-ce954a0fa9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:09.594931 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ce420-fe04-488f-a99d-ce954a0fa9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:09.595214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ce420-fe04-488f-a99d-ce954a0fa9a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:09.602256 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ce420-fe04-488f-a99d-ce954a0fa9a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:09.603726 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ce420-fe04-488f-a99d-ce954a0fa9a2 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:09.617949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-765ce420-fe04-488f-a99d-ce954a0fa9a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:09.617949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:09.617949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:09.617949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:09.617949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:09.617949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:09.617949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:09.617949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:09.617949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:09.617949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:09.617949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:09.617949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:09.617949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:17:09.617949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:17:09.617949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:17:09.619942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:17:09.619942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:09.619942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:09.619942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:09.619942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:09.619942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:09.619942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:09.619942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:09.619942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:09.619942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:09.619942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:09.619942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:09.619942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:09.619942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:09.619942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:09.619942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:09.619942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:09.622514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:17:09.622514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:17:09.622514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:17:09.622514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:17:09.622514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:17:09.622514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:17:09.622514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:09.622514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:09.622514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 375/747] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:09.622514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ce420-fe04-488f-a99d-ce954a0fa9a2 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:09.662698 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:09.701323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a69bad-bd45-4193-a0fd-78297d5cfb02 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:09.711909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:09.741294 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923aa5c9-b11b-4647-b679-b48994c73fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:09.742327 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923aa5c9-b11b-4647-b679-b48994c73fcc None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:09.742765 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923aa5c9-b11b-4647-b679-b48994c73fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:09.743292 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923aa5c9-b11b-4647-b679-b48994c73fcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:09.758352 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ce420-fe04-488f-a99d-ce954a0fa9a2 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:09.801940 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5373c-f8f2-4bd5-8d6d-460841f06ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:09.803131 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5373c-f8f2-4bd5-8d6d-460841f06ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:09.803418 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5373c-f8f2-4bd5-8d6d-460841f06ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:09.803695 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5373c-f8f2-4bd5-8d6d-460841f06ff0 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:09.804716 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5373c-f8f2-4bd5-8d6d-460841f06ff0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:09.805029 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5373c-f8f2-4bd5-8d6d-460841f06ff0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:09.806681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5373c-f8f2-4bd5-8d6d-460841f06ff0 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:09.818132 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 376/748] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jul 18 02:17:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:09.820114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5373c-f8f2-4bd5-8d6d-460841f06ff0 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:09.825845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923aa5c9-b11b-4647-b679-b48994c73fcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:09.827311 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923aa5c9-b11b-4647-b679-b48994c73fcc None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:09.911017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:09.923124 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5373c-f8f2-4bd5-8d6d-460841f06ff0 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:09.942275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 373/749] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:17:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 02:17:09.942275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660a2b7-7ad4-4757-b429-c22bfe567764 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:09.942275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660a2b7-7ad4-4757-b429-c22bfe567764 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:09.942275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660a2b7-7ad4-4757-b429-c22bfe567764 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:09.942275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 374/750] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:09.942275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660a2b7-7ad4-4757-b429-c22bfe567764 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:09.953937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:09.968448 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba6df0-75ce-47c3-b475-60a462f2de2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:09.969121 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba6df0-75ce-47c3-b475-60a462f2de2f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:09.969511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba6df0-75ce-47c3-b475-60a462f2de2f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:09.969681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba6df0-75ce-47c3-b475-60a462f2de2f None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:09.970494 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba6df0-75ce-47c3-b475-60a462f2de2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:09.970807 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba6df0-75ce-47c3-b475-60a462f2de2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:09.972252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ba6df0-75ce-47c3-b475-60a462f2de2f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:09.991537 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 377/751] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:17:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:09.991537 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba6df0-75ce-47c3-b475-60a462f2de2f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:10.062389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660a2b7-7ad4-4757-b429-c22bfe567764 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:10.107020 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba6df0-75ce-47c3-b475-60a462f2de2f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:10.109687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e0771-f2f1-42ed-8bee-673e9789c304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:10.110601 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e0771-f2f1-42ed-8bee-673e9789c304 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:10.110891 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e0771-f2f1-42ed-8bee-673e9789c304 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:10.111169 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e0771-f2f1-42ed-8bee-673e9789c304 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:10.122604 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e0771-f2f1-42ed-8bee-673e9789c304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:10.124053 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e0771-f2f1-42ed-8bee-673e9789c304 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:10.143574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-245e0771-f2f1-42ed-8bee-673e9789c304 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:10.143574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:10.143574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:10.143574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:10.143574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:10.143574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:10.143574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:10.143574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:10.143574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:10.143574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:10.143574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:10.143574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:10.143574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:10.143574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:10.143574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:10.144507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:10.144507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:10.144507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:10.144507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:10.144507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:10.144507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:10.144507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:10.144507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:10.144507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:10.144507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:10.144507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:10.144507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:10.144507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:10.144507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:10.144507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:10.144507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:10.144507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:10.150299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:10.150299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:10.150299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:10.150299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:10.150299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 375/752] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:10.150299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f939767-9948-4396-99ef-7fa7ae91fa45 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:10.150299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f939767-9948-4396-99ef-7fa7ae91fa45 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:10.150299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f939767-9948-4396-99ef-7fa7ae91fa45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:10.158434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b299f1-b291-410a-8999-c320f8fc50e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:10.159248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b299f1-b291-410a-8999-c320f8fc50e9 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:10.159558 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b299f1-b291-410a-8999-c320f8fc50e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:10.159808 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b299f1-b291-410a-8999-c320f8fc50e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:10.167910 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8f939767-9948-4396-99ef-7fa7ae91fa45 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:10.168901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8f939767-9948-4396-99ef-7fa7ae91fa45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:10.172393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b299f1-b291-410a-8999-c320f8fc50e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:10.173860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b299f1-b291-410a-8999-c320f8fc50e9 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:10.182827 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:10.192453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-c8b299f1-b291-410a-8999-c320f8fc50e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:10.192453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:10.192453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:10.192453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:10.192453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:10.192453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:10.192453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:10.192453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:10.192453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:10.192453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:10.192453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:10.192453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:10.192453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:10.192453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:10.192453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:10.197059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:10.197059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:10.197059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:10.197059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:10.197059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:10.197059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:10.197059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:10.197059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:10.197059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:10.197059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:10.197059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:10.197059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:10.197059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:10.197059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:10.197059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:10.197059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:10.197059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:10.198682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:10.198682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:10.198682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:10.198682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:10.198682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 378/753] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:10.198682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b299f1-b291-410a-8999-c320f8fc50e9 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:10.235249 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:10.246283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 376/754] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:10.252068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f939767-9948-4396-99ef-7fa7ae91fa45 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:10.313020 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b299f1-b291-410a-8999-c320f8fc50e9 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:10.346207 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c777550-22b0-4240-ba82-de99cc2774c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:10.347096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c777550-22b0-4240-ba82-de99cc2774c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:10.347382 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c777550-22b0-4240-ba82-de99cc2774c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:10.347659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c777550-22b0-4240-ba82-de99cc2774c7 None admin] PATH_INFO: `/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/6f51aae36f0b42868567840fa957ffe9/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:10.349621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c777550-22b0-4240-ba82-de99cc2774c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f6f840feba049ee9eeaf7bf0b300730, user_id=6f51aae36f0b42868567840fa957ffe9, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:10.351088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c777550-22b0-4240-ba82-de99cc2774c7 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:10.366793 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f939767-9948-4396-99ef-7fa7ae91fa45 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:10.400930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805a87e-773a-45c8-8501-5b721b4c2fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:10.401635 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805a87e-773a-45c8-8501-5b721b4c2fbd None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:10.401956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805a87e-773a-45c8-8501-5b721b4c2fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:10.402238 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805a87e-773a-45c8-8501-5b721b4c2fbd None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:10.402960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805a87e-773a-45c8-8501-5b721b4c2fbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:10.403268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805a87e-773a-45c8-8501-5b721b4c2fbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:10.404701 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805a87e-773a-45c8-8501-5b721b4c2fbd None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:10.416102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 377/755] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:10.417412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805a87e-773a-45c8-8501-5b721b4c2fbd None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:10.449731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 379/756] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:17:10 2022] PUT /identity/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/6f51aae36f0b42868567840fa957ffe9/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:17:10.449731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c777550-22b0-4240-ba82-de99cc2774c7 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:10.484518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:10.524103 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:10.548352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805a87e-773a-45c8-8501-5b721b4c2fbd None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:10.581128 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c777550-22b0-4240-ba82-de99cc2774c7 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:10.589808 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f4ac4-b5db-430e-b180-309fba4f76db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:10.590503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f4ac4-b5db-430e-b180-309fba4f76db None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:10.590791 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f4ac4-b5db-430e-b180-309fba4f76db None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:10.591074 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801f4ac4-b5db-430e-b180-309fba4f76db None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:10.591812 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f4ac4-b5db-430e-b180-309fba4f76db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:10.592121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f4ac4-b5db-430e-b180-309fba4f76db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:10.593566 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801f4ac4-b5db-430e-b180-309fba4f76db None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:10.607935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 378/757] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:10.608877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f4ac4-b5db-430e-b180-309fba4f76db None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:10.633563 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7328b4-6d85-4160-83d4-037aca91e172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:10.634573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7328b4-6d85-4160-83d4-037aca91e172 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:10.634852 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7328b4-6d85-4160-83d4-037aca91e172 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:10.635127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7328b4-6d85-4160-83d4-037aca91e172 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:10.636386 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7328b4-6d85-4160-83d4-037aca91e172 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:10.637813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7328b4-6d85-4160-83d4-037aca91e172 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:10.655229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-cf7328b4-6d85-4160-83d4-037aca91e172 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 02:17:10.655229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:10.655229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:17:10.655229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:17:10.655229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:17:10.655229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:17:10.655229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:17:10.655229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:10.655229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 02:17:10.655229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:10.655229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:10.655229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:10.655229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:10.655229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:10.655229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:10.655229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:10.656203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:10.656203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:10.656203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:10.656203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:10.656203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:10.656203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:10.656203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:10.656203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:17:10.656203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:17:10.656203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:17:10.656203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:17:10.656203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:10.656203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:10.656203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:10.656203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:10.656203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:10.657024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:10.657024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:10.657024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:10.657024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:10.657024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:10.657024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:10.657024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:10.657024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:10.657024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:10.657024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:10.657024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:10.657024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:17:10.657024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:10.657024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 02:17:10.657024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:10.657024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 380/758] 10.222.0.64 () {56 vars in 1129 bytes} [Mon Jul 18 02:17:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:10.658513 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7328b4-6d85-4160-83d4-037aca91e172 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:10.743904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801f4ac4-b5db-430e-b180-309fba4f76db None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:10.758823 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:10.787449 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb1079-6d26-4f61-84f8-9b6c63df0a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:10.789179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb1079-6d26-4f61-84f8-9b6c63df0a8b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:10.789675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb1079-6d26-4f61-84f8-9b6c63df0a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:10.790333 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb1079-6d26-4f61-84f8-9b6c63df0a8b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:10.795252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7328b4-6d85-4160-83d4-037aca91e172 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:10.801145 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb1079-6d26-4f61-84f8-9b6c63df0a8b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:10.802902 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb1079-6d26-4f61-84f8-9b6c63df0a8b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:10.822694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-2bbb1079-6d26-4f61-84f8-9b6c63df0a8b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 02:17:10.822694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:10.822694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:10.822694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:10.822694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:10.822694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:10.822694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:10.822694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:10.822694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:10.822694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:10.822694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:10.822694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:10.822694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:17:10.822694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:17:10.822694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:17:10.822694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:17:10.823696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:10.823696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:10.823696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:17:10.823696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:10.823696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:17:10.823696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:10.823696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:10.823696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:10.823696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:10.823696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:10.823696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:10.823696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:10.823696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:10.823696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:10.823696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:10.823696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:10.823696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:10.823696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:10.824643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:10.824643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:10.824643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:17:10.824643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:17:10.824643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:17:10.824643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:17:10.824643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:17:10.824643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:17:10.824643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 02:17:10.824643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:10.827381 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 379/759] 10.222.0.64 () {56 vars in 1117 bytes} [Mon Jul 18 02:17:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:10.828172 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:10.828595 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb1079-6d26-4f61-84f8-9b6c63df0a8b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:10.844271 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30f2f9-23e1-42a0-9aeb-9b5f806e6954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:10.845350 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30f2f9-23e1-42a0-9aeb-9b5f806e6954 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:10.845765 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30f2f9-23e1-42a0-9aeb-9b5f806e6954 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:10.846153 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30f2f9-23e1-42a0-9aeb-9b5f806e6954 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:10.853888 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30f2f9-23e1-42a0-9aeb-9b5f806e6954 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:10.856174 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30f2f9-23e1-42a0-9aeb-9b5f806e6954 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:10.873182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-8d30f2f9-23e1-42a0-9aeb-9b5f806e6954 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:10.873182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:10.873182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:10.873182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:10.873182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:10.873182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:10.873182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:10.873182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:10.873182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:10.873182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:10.873182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:10.873182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:10.873182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:17:10.873182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:17:10.873182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:17:10.874311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:17:10.874311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:10.874311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:10.874311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:10.874311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:10.874311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:10.874311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:10.874311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:10.874311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:10.874311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:10.874311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:10.874311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:10.874311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:10.874311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:10.874311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:10.874311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:10.874311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:10.875417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:17:10.875417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:17:10.875417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:17:10.875417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:17:10.875417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:17:10.875417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:17:10.875417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:10.875417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:10.878002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 381/760] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:10.878959 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30f2f9-23e1-42a0-9aeb-9b5f806e6954 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:10.956335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb1079-6d26-4f61-84f8-9b6c63df0a8b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:10.990607 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30f2f9-23e1-42a0-9aeb-9b5f806e6954 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:10.997308 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a0c47-a481-4563-bae2-1359f71bc303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:10.998018 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a0c47-a481-4563-bae2-1359f71bc303 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:10.998308 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a0c47-a481-4563-bae2-1359f71bc303 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:10.998581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a0c47-a481-4563-bae2-1359f71bc303 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:10.999290 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a0c47-a481-4563-bae2-1359f71bc303 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:10.999598 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a0c47-a481-4563-bae2-1359f71bc303 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:11.000962 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a0c47-a481-4563-bae2-1359f71bc303 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:11.005944 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 380/761] 10.222.0.64 () {56 vars in 1124 bytes} [Mon Jul 18 02:17:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:11.006577 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a0c47-a481-4563-bae2-1359f71bc303 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:11.029755 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa22f7a-8953-450b-ba82-0e59e9b90d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:11.030721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa22f7a-8953-450b-ba82-0e59e9b90d0c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:11.031016 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa22f7a-8953-450b-ba82-0e59e9b90d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:11.031508 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa22f7a-8953-450b-ba82-0e59e9b90d0c None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:11.032851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa22f7a-8953-450b-ba82-0e59e9b90d0c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:11.033038 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa22f7a-8953-450b-ba82-0e59e9b90d0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:11.034507 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa22f7a-8953-450b-ba82-0e59e9b90d0c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:11.041995 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:11.059000 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 382/762] 10.222.0.64 () {56 vars in 1149 bytes} [Mon Jul 18 02:17:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:11.059000 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b77d1-031c-4b57-a421-856b9711f355 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:11.059000 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b77d1-031c-4b57-a421-856b9711f355 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:11.059000 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b77d1-031c-4b57-a421-856b9711f355 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:11.059000 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 383/763] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:11.059000 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b77d1-031c-4b57-a421-856b9711f355 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:11.119935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a0c47-a481-4563-bae2-1359f71bc303 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:11.135027 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:11.160178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ae54f-4302-4184-b8e1-1a6d69cd9535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:11.160849 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ae54f-4302-4184-b8e1-1a6d69cd9535 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:11.161139 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ae54f-4302-4184-b8e1-1a6d69cd9535 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:11.161421 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ae54f-4302-4184-b8e1-1a6d69cd9535 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:11.162258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ae54f-4302-4184-b8e1-1a6d69cd9535 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:11.162577 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ae54f-4302-4184-b8e1-1a6d69cd9535 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:11.164010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ae54f-4302-4184-b8e1-1a6d69cd9535 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:11.182345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 381/764] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:17:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:11.182345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ae54f-4302-4184-b8e1-1a6d69cd9535 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:11.205964 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b77d1-031c-4b57-a421-856b9711f355 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:11.242990 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edda5155-b171-4696-a0b4-de78f2a5a7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:11.243663 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda5155-b171-4696-a0b4-de78f2a5a7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:11.243950 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda5155-b171-4696-a0b4-de78f2a5a7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:11.244230 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edda5155-b171-4696-a0b4-de78f2a5a7a4 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:11.244971 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda5155-b171-4696-a0b4-de78f2a5a7a4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:11.245279 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda5155-b171-4696-a0b4-de78f2a5a7a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:11.246685 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edda5155-b171-4696-a0b4-de78f2a5a7a4 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:11.252662 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 384/765] 10.222.0.64 () {56 vars in 1124 bytes} [Mon Jul 18 02:17:11 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:11.253850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a002a47-7c4c-4e52-9153-3210fa579077 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:11.254144 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a002a47-7c4c-4e52-9153-3210fa579077 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:11.254413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a002a47-7c4c-4e52-9153-3210fa579077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:11.270981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0a002a47-7c4c-4e52-9153-3210fa579077 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:11.272180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0a002a47-7c4c-4e52-9153-3210fa579077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:11.283842 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:11.291203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ae54f-4302-4184-b8e1-1a6d69cd9535 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:11.330246 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d191b-b502-484f-988e-13282fbd85bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:11.330929 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d191b-b502-484f-988e-13282fbd85bb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:11.331211 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d191b-b502-484f-988e-13282fbd85bb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:11.331577 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d191b-b502-484f-988e-13282fbd85bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:11.349900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 385/766] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:11.349900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a002a47-7c4c-4e52-9153-3210fa579077 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:11.406351 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:11.410433 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d191b-b502-484f-988e-13282fbd85bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:11.411926 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d191b-b502-484f-988e-13282fbd85bb None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:11.474823 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a002a47-7c4c-4e52-9153-3210fa579077 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:11.509284 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:11.512561 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a2698-a4e7-4a23-9400-b69fdb4f1466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:11.513219 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a2698-a4e7-4a23-9400-b69fdb4f1466 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:11.513738 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a2698-a4e7-4a23-9400-b69fdb4f1466 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:11.513848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a2698-a4e7-4a23-9400-b69fdb4f1466 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:11.514626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a2698-a4e7-4a23-9400-b69fdb4f1466 None admin] RBAC: Adding query filter params (role.id=5dfa34e7a4594751aed7c0495c9a2383, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=6a4e51f478874d99a7fc4ee2dea77caf) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:11.514937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a2698-a4e7-4a23-9400-b69fdb4f1466 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:11.516351 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a2698-a4e7-4a23-9400-b69fdb4f1466 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:11.517062 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 382/767] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:17:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 02:17:11.518848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d191b-b502-484f-988e-13282fbd85bb None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:11.525653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 386/768] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:17:11 2022] GET /identity/v3/role_assignments?user.id=6a4e51f478874d99a7fc4ee2dea77caf&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=5dfa34e7a4594751aed7c0495c9a2383 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:11.530337 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a2698-a4e7-4a23-9400-b69fdb4f1466 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:11.653038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d191b-b502-484f-988e-13282fbd85bb None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:11.684347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a2698-a4e7-4a23-9400-b69fdb4f1466 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:11.688766 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:11.691273 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abc420-0f94-48cc-9750-48ea35493506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:11.691941 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abc420-0f94-48cc-9750-48ea35493506 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:11.692221 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abc420-0f94-48cc-9750-48ea35493506 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:11.692493 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abc420-0f94-48cc-9750-48ea35493506 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:11.693284 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abc420-0f94-48cc-9750-48ea35493506 None admin] RBAC: Adding query filter params (interface=public, service_id=2984db6e6de64acd90dc42e4ad6e5991, region_id=RegionOne) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:11.693589 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abc420-0f94-48cc-9750-48ea35493506 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:11.694978 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4abc420-0f94-48cc-9750-48ea35493506 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:11.708207 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 383/769] 10.222.0.64 () {56 vars in 1251 bytes} [Mon Jul 18 02:17:11 2022] GET /identity/v3/endpoints?service_id=2984db6e6de64acd90dc42e4ad6e5991&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:11.709107 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abc420-0f94-48cc-9750-48ea35493506 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:11.726928 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727b38c-5ade-4126-8c40-70a585d5a03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:11.728265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727b38c-5ade-4126-8c40-70a585d5a03c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:11.728833 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727b38c-5ade-4126-8c40-70a585d5a03c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:11.729320 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727b38c-5ade-4126-8c40-70a585d5a03c None admin] PATH_INFO: `/v3/services/network` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:11.731083 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727b38c-5ade-4126-8c40-70a585d5a03c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:11.732454 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727b38c-5ade-4126-8c40-70a585d5a03c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:11.748788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-f727b38c-5ade-4126-8c40-70a585d5a03c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 02:17:11.748788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:11.748788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:17:11.748788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:17:11.748788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:17:11.748788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:17:11.748788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:17:11.748788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:11.748788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 02:17:11.748788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:11.748788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:11.748788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:11.748788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:11.748788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:11.748788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:11.748788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:11.748788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:11.749839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:11.749839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:11.749839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:11.749839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:11.749839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:11.749839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:11.749839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:17:11.749839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:17:11.749839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:17:11.749839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:17:11.749839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:11.749839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:11.749839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:11.749839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:11.749839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:11.749839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:11.750686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:11.750686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:11.750686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:11.750686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:11.750686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:11.750686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:11.750686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:11.750686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:11.750686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:11.750686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:11.750686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:17:11.750686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:11.750686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 02:17:11.750686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:11.752288 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 387/770] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:11 2022] GET /identity/v3/services/network => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:11.752288 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727b38c-5ade-4126-8c40-70a585d5a03c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:11.782099 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:11.820940 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abc420-0f94-48cc-9750-48ea35493506 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:11.857622 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c7602-6aa3-40ce-86bf-b0e80c91db67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:11.858447 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c7602-6aa3-40ce-86bf-b0e80c91db67 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:11.858802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c7602-6aa3-40ce-86bf-b0e80c91db67 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:11.858992 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c7602-6aa3-40ce-86bf-b0e80c91db67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:11.872128 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c7602-6aa3-40ce-86bf-b0e80c91db67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:11.873680 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489c7602-6aa3-40ce-86bf-b0e80c91db67 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:11.883219 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727b38c-5ade-4126-8c40-70a585d5a03c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:11.895182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-489c7602-6aa3-40ce-86bf-b0e80c91db67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:11.895182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:11.895182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:11.895182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:11.895182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:11.895182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:11.895182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:11.895182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:11.895182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:11.895182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:11.895182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:11.895182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:11.895182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:11.895182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:11.895182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:11.896071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:11.896071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:11.896071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:11.896071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:11.896071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:11.896071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:11.896071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:11.896071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:11.896071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:11.896071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:11.896071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:11.896071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:11.896071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:11.896071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:11.896071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:11.896071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:11.896071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:11.896944 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:11.896944 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:11.896944 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:11.896944 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:11.901154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 384/771] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:11.902229 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c7602-6aa3-40ce-86bf-b0e80c91db67 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:11.926530 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0063d6-cf7f-4ef5-9333-72c2c3f8d633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:11.927814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0063d6-cf7f-4ef5-9333-72c2c3f8d633 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:11.928304 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0063d6-cf7f-4ef5-9333-72c2c3f8d633 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:11.928938 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0063d6-cf7f-4ef5-9333-72c2c3f8d633 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:11.930321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0063d6-cf7f-4ef5-9333-72c2c3f8d633 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:11.933136 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0063d6-cf7f-4ef5-9333-72c2c3f8d633 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:11.946029 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 388/772] 10.222.0.64 () {56 vars in 1087 bytes} [Mon Jul 18 02:17:11 2022] GET /identity/v3/services => generated 772 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:11.947007 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0063d6-cf7f-4ef5-9333-72c2c3f8d633 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:12.020232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489c7602-6aa3-40ce-86bf-b0e80c91db67 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:12.024844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:12.034182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:12.066586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b881ad-eba6-48e5-8bf5-c07005ceb0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:12.068440 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b881ad-eba6-48e5-8bf5-c07005ceb0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:12.069124 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b881ad-eba6-48e5-8bf5-c07005ceb0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:12.069799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b881ad-eba6-48e5-8bf5-c07005ceb0e9 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:12.072334 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b881ad-eba6-48e5-8bf5-c07005ceb0e9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:12.073178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b881ad-eba6-48e5-8bf5-c07005ceb0e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:12.076307 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b881ad-eba6-48e5-8bf5-c07005ceb0e9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:12.086594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 385/773] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jul 18 02:17:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:12.093079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b881ad-eba6-48e5-8bf5-c07005ceb0e9 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:12.153839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0063d6-cf7f-4ef5-9333-72c2c3f8d633 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:12.192307 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f7804-59d6-4993-b3d2-2c24a0f1c000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:12.192924 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f7804-59d6-4993-b3d2-2c24a0f1c000 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:12.193205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f7804-59d6-4993-b3d2-2c24a0f1c000 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:12.193479 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f7804-59d6-4993-b3d2-2c24a0f1c000 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:12.194284 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f7804-59d6-4993-b3d2-2c24a0f1c000 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:12.194720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f7804-59d6-4993-b3d2-2c24a0f1c000 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:12.196090 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f7804-59d6-4993-b3d2-2c24a0f1c000 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:12.208706 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 389/774] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:12.214613 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f7804-59d6-4993-b3d2-2c24a0f1c000 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:12.260132 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b881ad-eba6-48e5-8bf5-c07005ceb0e9 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:12.319046 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ed4a6-c1be-4973-852b-36ad03953a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:12.319818 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ed4a6-c1be-4973-852b-36ad03953a40 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:12.320041 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ed4a6-c1be-4973-852b-36ad03953a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:12.320317 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8ed4a6-c1be-4973-852b-36ad03953a40 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:12.321026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ed4a6-c1be-4973-852b-36ad03953a40 None admin] RBAC: Adding query filter params (type=network) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:12.321328 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ed4a6-c1be-4973-852b-36ad03953a40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:12.322789 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8ed4a6-c1be-4973-852b-36ad03953a40 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:12.325202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:12.338144 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f7804-59d6-4993-b3d2-2c24a0f1c000 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:12.340676 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 386/775] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jul 18 02:17:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:12.346241 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ed4a6-c1be-4973-852b-36ad03953a40 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:12.382338 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21900a-a1da-424a-862c-472453ed1ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:12.383462 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21900a-a1da-424a-862c-472453ed1ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:12.384028 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21900a-a1da-424a-862c-472453ed1ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:12.384488 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21900a-a1da-424a-862c-472453ed1ef6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:12.392930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21900a-a1da-424a-862c-472453ed1ef6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:12.394967 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af21900a-a1da-424a-862c-472453ed1ef6 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:12.414646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-af21900a-a1da-424a-862c-472453ed1ef6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:12.414646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:12.414646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:12.414646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:12.414646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:12.414646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:12.414646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:12.414646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:12.414646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:12.414646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:12.414646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:12.414646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:12.414646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:17:12.414646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:17:12.414646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:17:12.415617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:17:12.415617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:12.415617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:12.415617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:12.415617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:12.415617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:12.415617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:12.415617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:12.415617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:12.415617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:12.415617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:12.415617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:12.415617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:12.415617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:12.415617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:12.415617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:12.415617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:12.416573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:17:12.416573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:17:12.416573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:17:12.416573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:17:12.416573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:17:12.416573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:17:12.416573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:12.416573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:12.419061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 390/776] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:12.425056 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21900a-a1da-424a-862c-472453ed1ef6 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:12.442747 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:12.521795 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8ed4a6-c1be-4973-852b-36ad03953a40 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:12.596926 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1dfdd-a0db-4779-9e46-39cb74b17183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:12.597598 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1dfdd-a0db-4779-9e46-39cb74b17183 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:12.597904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1dfdd-a0db-4779-9e46-39cb74b17183 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:12.598180 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1dfdd-a0db-4779-9e46-39cb74b17183 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:12.598976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1dfdd-a0db-4779-9e46-39cb74b17183 None admin] RBAC: Adding query filter params (interface=public, service_id=659da0d5b7ab4047b640982de418d305, region_id=RegionOne) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:12.599268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1dfdd-a0db-4779-9e46-39cb74b17183 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:12.600622 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1dfdd-a0db-4779-9e46-39cb74b17183 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:12.607436 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21900a-a1da-424a-862c-472453ed1ef6 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:12.619402 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 387/777] 10.222.0.64 () {56 vars in 1251 bytes} [Mon Jul 18 02:17:12 2022] GET /identity/v3/endpoints?service_id=659da0d5b7ab4047b640982de418d305&interface=public®ion_id=RegionOne => generated 194 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:12.620768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298ab2d-66b2-4831-85af-172d144ac69e None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:12.621053 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298ab2d-66b2-4831-85af-172d144ac69e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:12.621330 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298ab2d-66b2-4831-85af-172d144ac69e None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:12.622798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 388/778] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:12.628205 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cae51-5624-4294-9663-ae7de07b862a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:12.628493 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cae51-5624-4294-9663-ae7de07b862a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:12.628767 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cae51-5624-4294-9663-ae7de07b862a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:12.645894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f09cae51-5624-4294-9663-ae7de07b862a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:12.647174 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f09cae51-5624-4294-9663-ae7de07b862a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:12.653110 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e60b1b-794e-43dc-ba45-774a3bc33f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:12.654104 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e60b1b-794e-43dc-ba45-774a3bc33f52 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:12.654617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e60b1b-794e-43dc-ba45-774a3bc33f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:12.655092 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e60b1b-794e-43dc-ba45-774a3bc33f52 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:12.656211 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e60b1b-794e-43dc-ba45-774a3bc33f52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:12.656731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e60b1b-794e-43dc-ba45-774a3bc33f52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:12.658524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e60b1b-794e-43dc-ba45-774a3bc33f52 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:12.673284 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 391/779] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:17:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:12.674432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e60b1b-794e-43dc-ba45-774a3bc33f52 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:12.686047 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:12.728233 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 389/780] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 02:17:12.729043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cae51-5624-4294-9663-ae7de07b862a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:12.766416 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:12.787838 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e60b1b-794e-43dc-ba45-774a3bc33f52 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:12.824198 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c69d1-bb75-4e3d-bd4f-1def3abe17ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:12.824871 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c69d1-bb75-4e3d-bd4f-1def3abe17ec None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:12.825157 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c69d1-bb75-4e3d-bd4f-1def3abe17ec None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:12.825431 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90c69d1-bb75-4e3d-bd4f-1def3abe17ec None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:12.826153 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c69d1-bb75-4e3d-bd4f-1def3abe17ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:12.827537 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90c69d1-bb75-4e3d-bd4f-1def3abe17ec None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:12.833106 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 392/781] 10.222.0.64 () {56 vars in 1087 bytes} [Mon Jul 18 02:17:12 2022] GET /identity/v3/services => generated 772 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:12.833921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c69d1-bb75-4e3d-bd4f-1def3abe17ec None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:12.846424 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cae51-5624-4294-9663-ae7de07b862a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:12.908437 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:12.914168 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d028baf-28a9-4eb3-b329-01ea64544be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:12.914905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d028baf-28a9-4eb3-b329-01ea64544be1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:12.915189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d028baf-28a9-4eb3-b329-01ea64544be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:12.915460 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d028baf-28a9-4eb3-b329-01ea64544be1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:12.916302 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d028baf-28a9-4eb3-b329-01ea64544be1 None admin] RBAC: Adding query filter params (role.id=1f864eb92c9545bfb36cb24aff0401e4, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=01113a3f8cbf46b09fb5fcf4315a219b) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:12.919630 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d028baf-28a9-4eb3-b329-01ea64544be1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:12.919630 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d028baf-28a9-4eb3-b329-01ea64544be1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:12.930726 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 390/782] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:17:12 2022] GET /identity/v3/role_assignments?user.id=01113a3f8cbf46b09fb5fcf4315a219b&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=1f864eb92c9545bfb36cb24aff0401e4 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:12.940608 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90c69d1-bb75-4e3d-bd4f-1def3abe17ec None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:12.981645 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395100e9-a062-45c6-a664-86bc032b5054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:12.982428 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395100e9-a062-45c6-a664-86bc032b5054 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:12.982715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395100e9-a062-45c6-a664-86bc032b5054 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:12.982995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395100e9-a062-45c6-a664-86bc032b5054 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:12.996380 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395100e9-a062-45c6-a664-86bc032b5054 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:17:13.004365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-395100e9-a062-45c6-a664-86bc032b5054 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:17:13.004365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:13.004365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:13.004365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:13.004365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:13.004365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:13.004365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:13.004365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:13.004365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:13.004365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:13.004365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:13.004365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:13.004365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:17:13.004365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:17:13.004365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:17:13.004365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:17:13.005381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:17:13.005381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:17:13.005381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:17:13.005381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:17:13.005381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:13.005381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:13.005381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:13.005381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:13.005381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:13.005381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:13.005381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:13.005381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:13.005381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:13.005381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:13.005381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:13.005381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:13.006257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:13.006257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:13.006257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:13.006257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:13.006257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:17:13.006257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:17:13.006257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:17:13.006257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:17:13.006257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:17:13.006257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:17:13.006257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:17:13.006257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:13.006257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 393/783] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:17:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:13.014258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d028baf-28a9-4eb3-b329-01ea64544be1 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:13.162998 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d028baf-28a9-4eb3-b329-01ea64544be1 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:13.166061 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:13.199033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39230ae8-acbb-4e6f-97c4-a1ad7a06934e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:13.199719 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39230ae8-acbb-4e6f-97c4-a1ad7a06934e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:13.200217 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39230ae8-acbb-4e6f-97c4-a1ad7a06934e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:13.200501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39230ae8-acbb-4e6f-97c4-a1ad7a06934e None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:13.201249 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39230ae8-acbb-4e6f-97c4-a1ad7a06934e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:13.201553 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39230ae8-acbb-4e6f-97c4-a1ad7a06934e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:13.203284 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39230ae8-acbb-4e6f-97c4-a1ad7a06934e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:13.211870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 391/784] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:17:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:13.220447 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395100e9-a062-45c6-a664-86bc032b5054 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:13.350142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395100e9-a062-45c6-a664-86bc032b5054 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:13.387601 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:13.398818 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0a9f8-07ac-4160-a2dd-aa0e4d45abcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:13.399635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0a9f8-07ac-4160-a2dd-aa0e4d45abcb None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:13.399914 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0a9f8-07ac-4160-a2dd-aa0e4d45abcb None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:13.400212 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a0a9f8-07ac-4160-a2dd-aa0e4d45abcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:13.415297 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0a9f8-07ac-4160-a2dd-aa0e4d45abcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:13.416837 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a0a9f8-07ac-4160-a2dd-aa0e4d45abcb None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:13.439205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-52a0a9f8-07ac-4160-a2dd-aa0e4d45abcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:13.439205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:13.439205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:13.439205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:13.439205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:13.439205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:13.439205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:13.439205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:13.439205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:13.439205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:13.439205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:13.439205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:13.439205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:13.439205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:13.439205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:13.440149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:13.440149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:13.440149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:13.440149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:13.440149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:13.440149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:13.440149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:13.440149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:13.440149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:13.440149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:13.440149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:13.440149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:13.440149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:13.440149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:13.440149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:13.440149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:13.440149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:13.441089 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:13.441089 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:13.441089 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:13.441089 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:13.441089 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 394/785] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:13.446373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39230ae8-acbb-4e6f-97c4-a1ad7a06934e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:13.576751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39230ae8-acbb-4e6f-97c4-a1ad7a06934e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:13.628706 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96972445-411e-4794-85ba-9fb49fd8db96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:13.629379 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96972445-411e-4794-85ba-9fb49fd8db96 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:13.629860 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96972445-411e-4794-85ba-9fb49fd8db96 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:13.630136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96972445-411e-4794-85ba-9fb49fd8db96 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:13.630859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96972445-411e-4794-85ba-9fb49fd8db96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:13.631160 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96972445-411e-4794-85ba-9fb49fd8db96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:13.632511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96972445-411e-4794-85ba-9fb49fd8db96 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:13.648445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 392/786] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:13.654451 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0a9f8-07ac-4160-a2dd-aa0e4d45abcb None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:13.762464 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf8536-9030-4bf4-8302-e6e886fcf1f1 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:13.762789 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf8536-9030-4bf4-8302-e6e886fcf1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:13.763012 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf8536-9030-4bf4-8302-e6e886fcf1f1 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:13.764389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 393/787] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:13.769523 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5067ab-957c-4d9f-9bd8-744fd4970722 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:13.769951 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5067ab-957c-4d9f-9bd8-744fd4970722 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:13.770352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5067ab-957c-4d9f-9bd8-744fd4970722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:13.799252 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2e5067ab-957c-4d9f-9bd8-744fd4970722 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:13.801100 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2e5067ab-957c-4d9f-9bd8-744fd4970722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:13.808547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a0a9f8-07ac-4160-a2dd-aa0e4d45abcb None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:13.832157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:13.855322 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf99a74-7523-42f7-a97a-8f43a52efa77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:13.856173 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf99a74-7523-42f7-a97a-8f43a52efa77 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:13.856461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf99a74-7523-42f7-a97a-8f43a52efa77 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:13.856734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf99a74-7523-42f7-a97a-8f43a52efa77 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:13.864398 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf99a74-7523-42f7-a97a-8f43a52efa77 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:13.866050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf99a74-7523-42f7-a97a-8f43a52efa77 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:13.880718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-4cf99a74-7523-42f7-a97a-8f43a52efa77 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 02:17:13.880718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:13.880718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:13.880718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:13.880718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:13.880718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:13.880718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:13.880718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:13.880718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:13.880718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:13.880718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:13.880718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:13.880718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:17:13.880718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:17:13.880718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:17:13.880718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:17:13.881640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:13.881640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:13.881640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:17:13.881640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:13.881640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:17:13.881640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:13.881640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:13.881640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:13.881640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:13.881640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:13.881640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:13.881640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:13.881640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:13.881640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:13.881640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:13.881640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:13.881640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:13.881640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:13.882609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:13.882609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:13.882609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:17:13.882609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:17:13.882609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:17:13.882609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:17:13.882609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:17:13.882609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:17:13.882609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 02:17:13.882609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:13.882609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 395/788] 10.222.0.64 () {56 vars in 1093 bytes} [Mon Jul 18 02:17:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:13.888066 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf99a74-7523-42f7-a97a-8f43a52efa77 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:13.948206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 394/789] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 02:17:13.966051 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:13.979953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5067ab-957c-4d9f-9bd8-744fd4970722 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:14.016181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf99a74-7523-42f7-a97a-8f43a52efa77 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:14.082955 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234fac7-b3b6-4180-ace9-fbf0db526474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:14.083636 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234fac7-b3b6-4180-ace9-fbf0db526474 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:14.083919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234fac7-b3b6-4180-ace9-fbf0db526474 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:14.084190 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2234fac7-b3b6-4180-ace9-fbf0db526474 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:14.085024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234fac7-b3b6-4180-ace9-fbf0db526474 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:14.085327 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234fac7-b3b6-4180-ace9-fbf0db526474 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:14.086796 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2234fac7-b3b6-4180-ace9-fbf0db526474 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:14.127241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 396/790] 10.222.0.64 () {56 vars in 1133 bytes} [Mon Jul 18 02:17:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:14.132932 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234fac7-b3b6-4180-ace9-fbf0db526474 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:14.155621 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5067ab-957c-4d9f-9bd8-744fd4970722 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:14.225504 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc82531-8440-4f9a-b2d6-fc4c848f6152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:14.226699 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc82531-8440-4f9a-b2d6-fc4c848f6152 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:14.227212 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc82531-8440-4f9a-b2d6-fc4c848f6152 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:14.227688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc82531-8440-4f9a-b2d6-fc4c848f6152 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:14.244888 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc82531-8440-4f9a-b2d6-fc4c848f6152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:17:14.253887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-abc82531-8440-4f9a-b2d6-fc4c848f6152 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:17:14.253887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:14.253887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:14.253887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:14.253887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:14.253887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:14.253887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:14.253887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:14.253887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:14.253887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:14.253887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:14.253887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:14.253887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:17:14.253887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:17:14.253887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:17:14.253887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:17:14.254803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:17:14.254803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:17:14.254803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:17:14.254803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:17:14.254803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:14.254803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:14.254803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:14.254803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:14.254803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:14.254803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:14.254803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:14.254803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:14.254803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:14.254803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:14.254803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:14.254803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:14.255623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:14.255623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:14.255623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:14.255623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:14.255623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:17:14.255623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:17:14.255623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:17:14.255623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:17:14.255623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:17:14.255623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:17:14.255623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:17:14.255623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:14.263136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 395/791] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:17:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:14.270548 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc82531-8440-4f9a-b2d6-fc4c848f6152 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:14.294219 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:14.327959 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2234fac7-b3b6-4180-ace9-fbf0db526474 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:14.331363 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:14.391277 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f178ca-478b-4a14-8442-237b83d838e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:14.391853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f178ca-478b-4a14-8442-237b83d838e3 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:14.392136 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f178ca-478b-4a14-8442-237b83d838e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:14.392412 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f178ca-478b-4a14-8442-237b83d838e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:14.448907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc82531-8440-4f9a-b2d6-fc4c848f6152 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:14.507381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f178ca-478b-4a14-8442-237b83d838e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:14.508845 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f178ca-478b-4a14-8442-237b83d838e3 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:14.518163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ceb24-98d7-4e78-b132-1cbcc7b590bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:14.518851 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ceb24-98d7-4e78-b132-1cbcc7b590bc None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:14.519132 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ceb24-98d7-4e78-b132-1cbcc7b590bc None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:14.519407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ceb24-98d7-4e78-b132-1cbcc7b590bc None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:14.520161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ceb24-98d7-4e78-b132-1cbcc7b590bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:14.520466 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ceb24-98d7-4e78-b132-1cbcc7b590bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:14.521850 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ceb24-98d7-4e78-b132-1cbcc7b590bc None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:14.535730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 396/792] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:17:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:14.541949 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ceb24-98d7-4e78-b132-1cbcc7b590bc None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:14.644918 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 397/793] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:17:14 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 02:17:14.646697 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b94f7e-7d8d-4959-80b4-91674b0d0227 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:14.646995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b94f7e-7d8d-4959-80b4-91674b0d0227 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:14.647276 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b94f7e-7d8d-4959-80b4-91674b0d0227 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:14.648829 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 398/794] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:14.650213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b94f7e-7d8d-4959-80b4-91674b0d0227 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:14.653831 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:14.670738 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:14.711256 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ceb24-98d7-4e78-b132-1cbcc7b590bc None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:14.757617 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cbac6-d956-4b46-99ba-251e3a320db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:14.759183 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cbac6-d956-4b46-99ba-251e3a320db5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:14.759689 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cbac6-d956-4b46-99ba-251e3a320db5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:14.760225 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cbac6-d956-4b46-99ba-251e3a320db5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:14.774963 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b94f7e-7d8d-4959-80b4-91674b0d0227 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:14.775115 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4cbac6-d956-4b46-99ba-251e3a320db5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:14.777605 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4cbac6-d956-4b46-99ba-251e3a320db5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:14.804794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-ad4cbac6-d956-4b46-99ba-251e3a320db5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:14.804794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:14.804794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:14.804794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:14.804794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:14.804794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:14.804794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:14.804794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:14.804794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:14.804794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:14.804794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:14.804794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:14.804794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:14.804794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:14.804794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:14.805897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:14.805897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:14.805897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:14.805897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:14.805897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:14.805897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:14.805897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:14.805897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:14.805897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:14.805897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:14.805897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:14.805897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:14.805897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:14.805897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:14.805897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:14.805897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:14.805897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:14.807535 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:14.807535 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:14.807535 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:14.807535 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:14.810257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 397/795] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:14.811662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18641c-4d03-4ff7-b72c-b53bceaf6e6c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:14.812096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18641c-4d03-4ff7-b72c-b53bceaf6e6c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:14.812500 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18641c-4d03-4ff7-b72c-b53bceaf6e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:14.819333 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690620a-38d4-4c73-8231-80528c65ef22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:14.819669 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690620a-38d4-4c73-8231-80528c65ef22 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:14.820067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690620a-38d4-4c73-8231-80528c65ef22 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:14.820446 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690620a-38d4-4c73-8231-80528c65ef22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:14.832200 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8e18641c-4d03-4ff7-b72c-b53bceaf6e6c None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:14.832359 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690620a-38d4-4c73-8231-80528c65ef22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:14.833668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8e18641c-4d03-4ff7-b72c-b53bceaf6e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:14.833987 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5690620a-38d4-4c73-8231-80528c65ef22 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:14.853493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-5690620a-38d4-4c73-8231-80528c65ef22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:14.853493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:14.853493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:14.853493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:14.853493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:14.853493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:14.853493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:14.853493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:14.853493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:14.853493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:14.853493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:14.853493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:14.853493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:14.853493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:14.853493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:14.854675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:14.854675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:14.854675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:14.854675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:14.854675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:14.854675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:14.854675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:14.854675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:14.854675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:14.854675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:14.854675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:14.854675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:14.854675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:14.854675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:14.854675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:14.854675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:14.854675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:14.855773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:14.855773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:14.855773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:14.855773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:14.861716 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 399/796] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:14.861716 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690620a-38d4-4c73-8231-80528c65ef22 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:14.920246 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:14.937735 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 398/797] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:14.937735 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18641c-4d03-4ff7-b72c-b53bceaf6e6c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:14.989694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690620a-38d4-4c73-8231-80528c65ef22 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:15.004206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:15.037852 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa0b23-306d-4e97-ba34-aa8110f2c9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:15.039181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa0b23-306d-4e97-ba34-aa8110f2c9dd None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:15.039997 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa0b23-306d-4e97-ba34-aa8110f2c9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:15.040474 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa0b23-306d-4e97-ba34-aa8110f2c9dd None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:15.041453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa0b23-306d-4e97-ba34-aa8110f2c9dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:15.041988 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa0b23-306d-4e97-ba34-aa8110f2c9dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:15.044427 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa0b23-306d-4e97-ba34-aa8110f2c9dd None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:15.055758 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18641c-4d03-4ff7-b72c-b53bceaf6e6c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:15.062185 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 400/798] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:15.063288 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa0b23-306d-4e97-ba34-aa8110f2c9dd None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:15.098294 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48880d-69bf-4004-b332-36cb270a9bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:15.098998 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48880d-69bf-4004-b332-36cb270a9bbd None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:15.099283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48880d-69bf-4004-b332-36cb270a9bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:15.099561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48880d-69bf-4004-b332-36cb270a9bbd None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:15.100289 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48880d-69bf-4004-b332-36cb270a9bbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:15.100595 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48880d-69bf-4004-b332-36cb270a9bbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:15.102051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48880d-69bf-4004-b332-36cb270a9bbd None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:15.118776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 399/799] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:15.118776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48880d-69bf-4004-b332-36cb270a9bbd None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:15.202771 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa0b23-306d-4e97-ba34-aa8110f2c9dd None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:15.221884 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:15.236999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48880d-69bf-4004-b332-36cb270a9bbd None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:15.245264 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18709a-03ea-4878-8fd0-9834d458644d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:15.246099 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18709a-03ea-4878-8fd0-9834d458644d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:15.246374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18709a-03ea-4878-8fd0-9834d458644d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:15.246641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18709a-03ea-4878-8fd0-9834d458644d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:15.247289 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18709a-03ea-4878-8fd0-9834d458644d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:15.248653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18709a-03ea-4878-8fd0-9834d458644d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:15.252502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:15.262844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-6f18709a-03ea-4878-8fd0-9834d458644d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 02:17:15.262844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:15.262844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:17:15.262844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:17:15.262844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:17:15.262844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:17:15.262844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:17:15.262844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:15.262844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 02:17:15.262844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:15.262844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:15.262844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:15.262844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:15.262844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:15.262844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:15.262844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:15.267490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:15.267490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:15.267490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:15.267490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:15.267490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:15.267490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:15.267490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:15.267490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:17:15.267490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:17:15.267490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:17:15.267490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:17:15.267490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:15.267490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:15.267490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:15.267490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:15.267490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:15.268344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:15.268344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:15.268344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:15.268344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:15.268344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:15.268344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:15.268344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:15.268344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:15.268344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:15.268344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:15.268344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:15.268344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:17:15.268344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:15.268344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 02:17:15.268344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:15.268344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 401/800] 10.222.0.64 () {56 vars in 1129 bytes} [Mon Jul 18 02:17:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:15.269594 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18709a-03ea-4878-8fd0-9834d458644d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:15.281190 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8771632-5bf6-4d4a-9676-f899520264bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:15.282055 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8771632-5bf6-4d4a-9676-f899520264bf None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:15.282611 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8771632-5bf6-4d4a-9676-f899520264bf None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:15.282910 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8771632-5bf6-4d4a-9676-f899520264bf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:15.291805 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8771632-5bf6-4d4a-9676-f899520264bf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:15.293299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8771632-5bf6-4d4a-9676-f899520264bf None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:15.309496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-d8771632-5bf6-4d4a-9676-f899520264bf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 02:17:15.309496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:15.309496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:15.309496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:15.309496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:15.309496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:15.309496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:15.309496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:15.309496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:15.309496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:15.309496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:15.309496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:15.309496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:17:15.309496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:17:15.309496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:17:15.309496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:17:15.310522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:15.310522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:15.310522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:17:15.310522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:15.310522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:17:15.310522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:15.310522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:15.310522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:15.310522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:15.310522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:15.310522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:15.310522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:15.310522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:15.310522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:15.310522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:15.310522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:15.310522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:15.310522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:15.311471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:15.311471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:15.311471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:17:15.311471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:17:15.311471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:17:15.311471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:17:15.311471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:17:15.311471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:17:15.311471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 02:17:15.311471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:15.314036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 400/801] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:17:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:15.315923 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199094af-3a9d-4d5b-8900-011fe79a8d2c None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:15.316641 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199094af-3a9d-4d5b-8900-011fe79a8d2c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:15.317031 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199094af-3a9d-4d5b-8900-011fe79a8d2c None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:15.318374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 401/802] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:15.318976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199094af-3a9d-4d5b-8900-011fe79a8d2c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:15.380341 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18709a-03ea-4878-8fd0-9834d458644d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:15.416648 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbbe1d-f920-486d-aceb-5fda03021ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:15.417455 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbbe1d-f920-486d-aceb-5fda03021ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:15.417779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbbe1d-f920-486d-aceb-5fda03021ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:15.418059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbbe1d-f920-486d-aceb-5fda03021ae6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:15.425187 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bbbe1d-f920-486d-aceb-5fda03021ae6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:15.426637 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bbbe1d-f920-486d-aceb-5fda03021ae6 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:15.436140 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199094af-3a9d-4d5b-8900-011fe79a8d2c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:15.442641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-c8bbbe1d-f920-486d-aceb-5fda03021ae6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:15.442641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:15.442641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:15.442641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:15.442641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:15.442641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:15.442641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:15.442641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:15.442641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:15.442641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:15.442641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:15.442641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:15.442641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:17:15.442641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:17:15.442641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:17:15.443548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:17:15.443548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:15.443548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:15.443548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:15.443548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:15.443548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:15.443548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:15.443548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:15.443548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:15.443548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:15.443548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:15.443548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:15.443548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:15.443548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:15.443548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:15.443548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:15.443548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:15.444434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:17:15.444434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:17:15.444434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:17:15.444434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:17:15.444434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:17:15.444434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:17:15.444434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:15.444434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:15.445789 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 402/803] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:15.446536 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbbe1d-f920-486d-aceb-5fda03021ae6 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:15.481063 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18030bf-6dcc-47a3-9e0f-a02b7718e811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:15.481749 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18030bf-6dcc-47a3-9e0f-a02b7718e811 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:15.481948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18030bf-6dcc-47a3-9e0f-a02b7718e811 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:15.482227 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18030bf-6dcc-47a3-9e0f-a02b7718e811 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:15.482928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18030bf-6dcc-47a3-9e0f-a02b7718e811 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:15.483251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18030bf-6dcc-47a3-9e0f-a02b7718e811 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:15.484598 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18030bf-6dcc-47a3-9e0f-a02b7718e811 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:15.489472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 402/804] 10.222.0.64 () {56 vars in 1124 bytes} [Mon Jul 18 02:17:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:15.490675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd44ef-eb29-440c-8c02-2468afd11b04 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:15.490962 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd44ef-eb29-440c-8c02-2468afd11b04 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:15.491232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cd44ef-eb29-440c-8c02-2468afd11b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:15.502296 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:15.508939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e1cd44ef-eb29-440c-8c02-2468afd11b04 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:15.510213 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e1cd44ef-eb29-440c-8c02-2468afd11b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:15.540414 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:15.565034 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbbe1d-f920-486d-aceb-5fda03021ae6 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:15.580320 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 403/805] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:15.581157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd44ef-eb29-440c-8c02-2468afd11b04 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:15.601857 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19b905-cbc1-41a5-b5ef-474d81874a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:15.602797 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19b905-cbc1-41a5-b5ef-474d81874a12 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:15.603090 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19b905-cbc1-41a5-b5ef-474d81874a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:15.603368 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19b905-cbc1-41a5-b5ef-474d81874a12 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:15.604795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19b905-cbc1-41a5-b5ef-474d81874a12 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:15.605109 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19b905-cbc1-41a5-b5ef-474d81874a12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:15.606576 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19b905-cbc1-41a5-b5ef-474d81874a12 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:15.624677 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 403/806] 10.222.0.64 () {56 vars in 1135 bytes} [Mon Jul 18 02:17:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:15.625468 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19b905-cbc1-41a5-b5ef-474d81874a12 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:15.680569 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cd44ef-eb29-440c-8c02-2468afd11b04 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:15.714530 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edcc51e-bc4f-432f-b940-117beb3bdcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:15.715191 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcc51e-bc4f-432f-b940-117beb3bdcbc None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:15.715476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcc51e-bc4f-432f-b940-117beb3bdcbc None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:15.715754 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edcc51e-bc4f-432f-b940-117beb3bdcbc None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:15.716535 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edcc51e-bc4f-432f-b940-117beb3bdcbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:15.716846 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edcc51e-bc4f-432f-b940-117beb3bdcbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:15.717611 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:15.718305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edcc51e-bc4f-432f-b940-117beb3bdcbc None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:15.723317 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19b905-cbc1-41a5-b5ef-474d81874a12 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:15.729717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 404/807] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:17:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:15.730982 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e24d04-c947-4315-9676-7ff74eca3dab None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:15.731328 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e24d04-c947-4315-9676-7ff74eca3dab None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:15.731567 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e24d04-c947-4315-9676-7ff74eca3dab None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:15.732979 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 405/808] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:15.734644 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e24d04-c947-4315-9676-7ff74eca3dab None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:15.757686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7162f55-a9c2-4547-a49f-9d7265d9a5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:15.758381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7162f55-a9c2-4547-a49f-9d7265d9a5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:15.758664 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7162f55-a9c2-4547-a49f-9d7265d9a5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:15.758943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7162f55-a9c2-4547-a49f-9d7265d9a5d6 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:15.759653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7162f55-a9c2-4547-a49f-9d7265d9a5d6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:15.760472 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7162f55-a9c2-4547-a49f-9d7265d9a5d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:15.761733 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:15.761853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7162f55-a9c2-4547-a49f-9d7265d9a5d6 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:15.766653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 404/809] 10.222.0.64 () {56 vars in 1124 bytes} [Mon Jul 18 02:17:15 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:15.767412 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7162f55-a9c2-4547-a49f-9d7265d9a5d6 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:15.835250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e24d04-c947-4315-9676-7ff74eca3dab None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:15.863247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7162f55-a9c2-4547-a49f-9d7265d9a5d6 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:15.868485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54dcc51-e4e8-400e-bd18-0c0888446c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:15.869359 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54dcc51-e4e8-400e-bd18-0c0888446c9c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:15.869655 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54dcc51-e4e8-400e-bd18-0c0888446c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:15.869987 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54dcc51-e4e8-400e-bd18-0c0888446c9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:15.880009 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54dcc51-e4e8-400e-bd18-0c0888446c9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:17:15.888224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-b54dcc51-e4e8-400e-bd18-0c0888446c9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:17:15.888224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:15.888224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:15.888224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:15.888224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:15.888224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:15.888224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:15.888224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:15.888224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:15.888224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:15.888224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:15.888224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:15.888224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:17:15.888224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:17:15.888224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:17:15.888224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:17:15.889345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:17:15.889345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:17:15.889345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:17:15.889345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:17:15.889345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:15.889345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:15.889345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:15.889345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:15.889345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:15.889345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:15.889345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:15.889345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:15.889345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:15.889345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:15.889345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:15.889345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:15.895561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:15.895561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:15.895561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:15.895561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:15.895561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:17:15.895561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:17:15.895561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:17:15.895561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:17:15.895561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:17:15.895561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:17:15.895561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:17:15.895561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:15.895561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 406/810] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:17:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:15.895561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54dcc51-e4e8-400e-bd18-0c0888446c9c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:15.904345 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fb286-1019-4775-bffa-02247250c1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:15.905145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fb286-1019-4775-bffa-02247250c1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:15.905430 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fb286-1019-4775-bffa-02247250c1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:15.905743 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fb286-1019-4775-bffa-02247250c1e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:15.915666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fb286-1019-4775-bffa-02247250c1e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:15.917615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fb286-1019-4775-bffa-02247250c1e8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:15.935417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-697fb286-1019-4775-bffa-02247250c1e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:15.935417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:15.935417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:15.935417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:15.935417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:15.935417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:15.935417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:15.935417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:15.935417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:15.935417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:15.935417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:15.935417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:15.935417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:15.935417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:15.935417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:15.936467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:15.936467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:15.936467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:15.936467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:15.936467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:15.936467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:15.936467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:15.936467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:15.936467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:15.936467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:15.936467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:15.936467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:15.936467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:15.936467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:15.936467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:15.936467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:15.936467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:15.937597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:15.937597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:15.937597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:15.937597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:15.937597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 405/811] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:15.937967 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e65735-d78d-424e-b622-bbde4c9e69b2 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:15.938068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e65735-d78d-424e-b622-bbde4c9e69b2 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:15.938320 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e65735-d78d-424e-b622-bbde4c9e69b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:15.955923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-70e65735-d78d-424e-b622-bbde4c9e69b2 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:15.957117 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-70e65735-d78d-424e-b622-bbde4c9e69b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:15.964282 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:15.975419 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:15.990087 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54dcc51-e4e8-400e-bd18-0c0888446c9c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:16.022373 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 406/812] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:16.023223 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e65735-d78d-424e-b622-bbde4c9e69b2 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:16.027946 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7231eeb-21e9-49ef-929d-daf64df0079f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:16.028604 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7231eeb-21e9-49ef-929d-daf64df0079f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:16.028886 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7231eeb-21e9-49ef-929d-daf64df0079f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:16.029158 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7231eeb-21e9-49ef-929d-daf64df0079f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:16.030040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7231eeb-21e9-49ef-929d-daf64df0079f None admin] RBAC: Adding query filter params (role.id=5dfa34e7a4594751aed7c0495c9a2383, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=6f51aae36f0b42868567840fa957ffe9) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:16.030343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7231eeb-21e9-49ef-929d-daf64df0079f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:16.033267 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7231eeb-21e9-49ef-929d-daf64df0079f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:16.038275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 407/813] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:17:15 2022] GET /identity/v3/role_assignments?user.id=6f51aae36f0b42868567840fa957ffe9&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=5dfa34e7a4594751aed7c0495c9a2383 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:16.039132 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7231eeb-21e9-49ef-929d-daf64df0079f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:16.143448 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e65735-d78d-424e-b622-bbde4c9e69b2 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:16.163246 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7231eeb-21e9-49ef-929d-daf64df0079f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:16.182600 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95597ab-1f44-42d0-b34c-b720a14beeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:16.183286 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95597ab-1f44-42d0-b34c-b720a14beeaf None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:16.183572 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95597ab-1f44-42d0-b34c-b720a14beeaf None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:16.183848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95597ab-1f44-42d0-b34c-b720a14beeaf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:16.184582 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95597ab-1f44-42d0-b34c-b720a14beeaf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:16.185986 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95597ab-1f44-42d0-b34c-b720a14beeaf None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:16.204019 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a5188-c058-474c-bc97-154069ba74ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:16.204706 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a5188-c058-474c-bc97-154069ba74ce None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:16.204993 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a5188-c058-474c-bc97-154069ba74ce None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:16.205276 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4a5188-c058-474c-bc97-154069ba74ce None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:16.206061 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a5188-c058-474c-bc97-154069ba74ce None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:16.206376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a5188-c058-474c-bc97-154069ba74ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:16.207740 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4a5188-c058-474c-bc97-154069ba74ce None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:16.221979 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 408/814] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jul 18 02:17:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:16.221979 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a5188-c058-474c-bc97-154069ba74ce None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:16.234983 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:16.304005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:16.310396 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 407/815] 10.222.0.64 () {60 vars in 1144 bytes} [Mon Jul 18 02:17:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:17:16.320380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4a5188-c058-474c-bc97-154069ba74ce None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:16.322764 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95597ab-1f44-42d0-b34c-b720a14beeaf None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:16.382808 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14444776-5f4a-4802-af62-801c7bbb2c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:16.383999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14444776-5f4a-4802-af62-801c7bbb2c5f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:16.385471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14444776-5f4a-4802-af62-801c7bbb2c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:16.385978 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14444776-5f4a-4802-af62-801c7bbb2c5f None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:16.387260 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14444776-5f4a-4802-af62-801c7bbb2c5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:16.387812 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14444776-5f4a-4802-af62-801c7bbb2c5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:16.389930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14444776-5f4a-4802-af62-801c7bbb2c5f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:16.404448 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 409/816] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:16.405676 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14444776-5f4a-4802-af62-801c7bbb2c5f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:16.448971 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95597ab-1f44-42d0-b34c-b720a14beeaf None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:16.483056 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:16.488791 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a84c6-e0e4-43ce-bc9f-63a858a5a791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:16.489605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a84c6-e0e4-43ce-bc9f-63a858a5a791 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:16.490035 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a84c6-e0e4-43ce-bc9f-63a858a5a791 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:16.490319 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a84c6-e0e4-43ce-bc9f-63a858a5a791 None admin] PATH_INFO: `/v3/services/network` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:16.494868 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a84c6-e0e4-43ce-bc9f-63a858a5a791 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:16.494868 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a84c6-e0e4-43ce-bc9f-63a858a5a791 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:16.507676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-552a84c6-e0e4-43ce-bc9f-63a858a5a791 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 02:17:16.507676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:16.507676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:17:16.507676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:17:16.507676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:17:16.507676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:17:16.507676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:17:16.507676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:16.507676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 02:17:16.507676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:16.507676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:16.507676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:16.507676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:16.507676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:16.507676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:16.507676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:16.507676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:16.508718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:16.508718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:16.508718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:16.508718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:16.508718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:16.508718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:16.508718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:17:16.508718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:17:16.508718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:17:16.508718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:17:16.508718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:16.508718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:16.508718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:16.508718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:16.508718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:16.508718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:16.509560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:16.509560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:16.509560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:16.509560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:16.509560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:16.509560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:16.509560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:16.509560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:16.509560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:16.509560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:16.509560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:17:16.509560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:16.509560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 02:17:16.509560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:16.509560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 408/817] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:16 2022] GET /identity/v3/services/network => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:16.510458 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a84c6-e0e4-43ce-bc9f-63a858a5a791 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:16.528595 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14444776-5f4a-4802-af62-801c7bbb2c5f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:16.570147 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa1a25-f03e-4346-99d3-342383571ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:16.570877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa1a25-f03e-4346-99d3-342383571ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:16.571165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa1a25-f03e-4346-99d3-342383571ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:16.571442 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa1a25-f03e-4346-99d3-342383571ec8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:16.582527 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa1a25-f03e-4346-99d3-342383571ec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:16.583975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa1a25-f03e-4346-99d3-342383571ec8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:16.587681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:16.601476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-dcaa1a25-f03e-4346-99d3-342383571ec8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:16.601476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:16.601476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:16.601476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:16.601476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:16.601476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:16.601476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:16.601476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:16.601476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:16.601476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:16.601476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:16.601476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:16.601476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:16.601476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:16.601476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:16.602456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:16.602456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:16.602456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:16.602456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:16.602456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:16.602456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:16.602456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:16.602456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:16.602456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:16.602456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:16.602456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:16.602456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:16.602456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:16.602456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:16.602456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:16.602456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:16.602456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:16.603356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:16.603356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:16.603356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:16.603356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:16.603356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 410/818] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:16.604176 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa1a25-f03e-4346-99d3-342383571ec8 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:16.638797 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a84c6-e0e4-43ce-bc9f-63a858a5a791 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:16.678561 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec27a38-0932-4118-90fb-5054e21715d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:16.679378 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec27a38-0932-4118-90fb-5054e21715d2 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:16.679668 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec27a38-0932-4118-90fb-5054e21715d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:16.679960 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec27a38-0932-4118-90fb-5054e21715d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:16.688133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec27a38-0932-4118-90fb-5054e21715d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:16.689795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec27a38-0932-4118-90fb-5054e21715d2 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:16.705688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-5ec27a38-0932-4118-90fb-5054e21715d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:16.705688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:16.705688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:16.705688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:16.705688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:16.705688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:16.705688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:16.705688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:16.705688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:16.705688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:16.705688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:16.705688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:16.705688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:17:16.705688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:17:16.705688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:17:16.706612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:17:16.706612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:16.706612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:16.706612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:16.706612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:16.706612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:16.706612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:16.706612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:16.706612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:16.706612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:16.706612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:16.706612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:16.706612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:16.706612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:16.706612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:16.706612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:16.706612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:16.707555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:17:16.707555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:17:16.707555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:17:16.707555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:17:16.707555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:17:16.707555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:17:16.707555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:16.707555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:16.707555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 409/819] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:16.708482 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec27a38-0932-4118-90fb-5054e21715d2 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:16.731742 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa1a25-f03e-4346-99d3-342383571ec8 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:16.757013 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:16.775002 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11112d-5e92-466c-a5ea-7bb5b93ef62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:16.776447 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11112d-5e92-466c-a5ea-7bb5b93ef62f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:16.777218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11112d-5e92-466c-a5ea-7bb5b93ef62f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:16.777880 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11112d-5e92-466c-a5ea-7bb5b93ef62f None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:16.778701 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11112d-5e92-466c-a5ea-7bb5b93ef62f None admin] RBAC: Adding query filter params (name=network) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:16.779116 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11112d-5e92-466c-a5ea-7bb5b93ef62f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:16.780845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f11112d-5e92-466c-a5ea-7bb5b93ef62f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:16.793575 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 411/820] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jul 18 02:17:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:16.794598 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11112d-5e92-466c-a5ea-7bb5b93ef62f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:16.821559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec27a38-0932-4118-90fb-5054e21715d2 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:16.847111 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:16.859986 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411cb56-3fb8-4315-bc5e-c5bc25348f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:16.860938 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411cb56-3fb8-4315-bc5e-c5bc25348f35 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:16.861368 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411cb56-3fb8-4315-bc5e-c5bc25348f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:16.861847 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411cb56-3fb8-4315-bc5e-c5bc25348f35 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:16.862706 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411cb56-3fb8-4315-bc5e-c5bc25348f35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:16.863157 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411cb56-3fb8-4315-bc5e-c5bc25348f35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:16.864739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411cb56-3fb8-4315-bc5e-c5bc25348f35 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:16.877688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 410/821] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:16.878900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411cb56-3fb8-4315-bc5e-c5bc25348f35 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:16.919110 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11112d-5e92-466c-a5ea-7bb5b93ef62f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:16.960627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550ba40-0e13-492d-a197-02dfe6886f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:16.961770 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550ba40-0e13-492d-a197-02dfe6886f3e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:16.962334 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550ba40-0e13-492d-a197-02dfe6886f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:16.962770 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550ba40-0e13-492d-a197-02dfe6886f3e None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:16.964170 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550ba40-0e13-492d-a197-02dfe6886f3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:16.964553 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550ba40-0e13-492d-a197-02dfe6886f3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:16.966629 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550ba40-0e13-492d-a197-02dfe6886f3e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:16.985820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 412/822] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:17:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:16.986911 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550ba40-0e13-492d-a197-02dfe6886f3e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:16.988610 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411cb56-3fb8-4315-bc5e-c5bc25348f35 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:17.031345 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3e075-8250-4890-9dc5-369a4e8b0d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:17.032126 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3e075-8250-4890-9dc5-369a4e8b0d63 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:17.032638 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3e075-8250-4890-9dc5-369a4e8b0d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:17.033088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3e075-8250-4890-9dc5-369a4e8b0d63 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:17.033982 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3e075-8250-4890-9dc5-369a4e8b0d63 None admin] RBAC: Adding query filter params (type=network) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:17.034365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3e075-8250-4890-9dc5-369a4e8b0d63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:17.036364 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3e075-8250-4890-9dc5-369a4e8b0d63 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:17.039525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:17.045853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 411/823] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jul 18 02:17:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:17.046919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3e075-8250-4890-9dc5-369a4e8b0d63 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:17.100184 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:17.111414 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550ba40-0e13-492d-a197-02dfe6886f3e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:17.165836 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562a505-c1f7-475f-903d-e471ed51dd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:17.166858 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562a505-c1f7-475f-903d-e471ed51dd89 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:17.167300 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562a505-c1f7-475f-903d-e471ed51dd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:17.167698 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562a505-c1f7-475f-903d-e471ed51dd89 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:17.167884 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3e075-8250-4890-9dc5-369a4e8b0d63 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:17.178367 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562a505-c1f7-475f-903d-e471ed51dd89 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:17.180619 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562a505-c1f7-475f-903d-e471ed51dd89 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:17.200305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-3562a505-c1f7-475f-903d-e471ed51dd89 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 02:17:17.200305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:17.200305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:17.200305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:17.200305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:17.200305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:17.200305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:17.200305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:17.200305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:17.200305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:17.200305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:17.200305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:17.200305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:17:17.200305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:17:17.200305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:17:17.200305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:17:17.201253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:17.201253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:17.201253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:17:17.201253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:17.201253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:17:17.201253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:17.201253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:17.201253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:17.201253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:17.201253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:17.201253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:17.201253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:17.201253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:17.201253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:17.201253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:17.201253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:17.201253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:17.201253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:17.202389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:17.202389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:17.202389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:17:17.202389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:17:17.202389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:17:17.202389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:17:17.202389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:17:17.202389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:17:17.202389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 02:17:17.202389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:17.202389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 413/824] 10.222.0.64 () {56 vars in 1117 bytes} [Mon Jul 18 02:17:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:17.203308 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562a505-c1f7-475f-903d-e471ed51dd89 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:17.209621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68146b-7de4-4a3e-a659-072f7aa7d10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:17.210800 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68146b-7de4-4a3e-a659-072f7aa7d10c None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:17.211295 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68146b-7de4-4a3e-a659-072f7aa7d10c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:17.211781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68146b-7de4-4a3e-a659-072f7aa7d10c None admin] PATH_INFO: `/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/6a4e51f478874d99a7fc4ee2dea77caf/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:17.214909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68146b-7de4-4a3e-a659-072f7aa7d10c None admin] RBAC: Authorizing `identity:create_grant(project_id=1f6f840feba049ee9eeaf7bf0b300730, user_id=6a4e51f478874d99a7fc4ee2dea77caf, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:17.216700 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c68146b-7de4-4a3e-a659-072f7aa7d10c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:17.301800 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 412/825] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:17:17 2022] PUT /identity/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/6a4e51f478874d99a7fc4ee2dea77caf/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:17:17.303788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68146b-7de4-4a3e-a659-072f7aa7d10c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:17.343259 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562a505-c1f7-475f-903d-e471ed51dd89 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:17.346840 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:17.417727 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa04e23-125f-4cf2-a8a3-a5bfee2ea303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:17.417727 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa04e23-125f-4cf2-a8a3-a5bfee2ea303 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:17.417727 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa04e23-125f-4cf2-a8a3-a5bfee2ea303 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:17.417727 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa04e23-125f-4cf2-a8a3-a5bfee2ea303 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:17.418124 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa04e23-125f-4cf2-a8a3-a5bfee2ea303 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:17.418974 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa04e23-125f-4cf2-a8a3-a5bfee2ea303 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:17.482331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68146b-7de4-4a3e-a659-072f7aa7d10c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:17.490215 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:17.507469 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 414/826] 10.222.0.64 () {60 vars in 1144 bytes} [Mon Jul 18 02:17:17 2022] POST /identity/v3/endpoints => generated 327 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:17:17.533836 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d7fac-86a6-489c-9362-9b7fd6cb5966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:17.534608 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d7fac-86a6-489c-9362-9b7fd6cb5966 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:17.534944 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d7fac-86a6-489c-9362-9b7fd6cb5966 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:17.535231 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d7fac-86a6-489c-9362-9b7fd6cb5966 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:17.536092 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d7fac-86a6-489c-9362-9b7fd6cb5966 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:17.536407 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d7fac-86a6-489c-9362-9b7fd6cb5966 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:17.537963 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d7fac-86a6-489c-9362-9b7fd6cb5966 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:17.560239 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 413/827] 10.222.0.64 () {56 vars in 1149 bytes} [Mon Jul 18 02:17:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:17.565941 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa04e23-125f-4cf2-a8a3-a5bfee2ea303 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:17.700051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa04e23-125f-4cf2-a8a3-a5bfee2ea303 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:17.739712 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958e2cc-7c99-4216-a308-8fa0dde2b0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:17.740533 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958e2cc-7c99-4216-a308-8fa0dde2b0da None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:17.740821 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958e2cc-7c99-4216-a308-8fa0dde2b0da None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:17.741103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958e2cc-7c99-4216-a308-8fa0dde2b0da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:17.756765 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958e2cc-7c99-4216-a308-8fa0dde2b0da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:17.758405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958e2cc-7c99-4216-a308-8fa0dde2b0da None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:17.783069 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-6958e2cc-7c99-4216-a308-8fa0dde2b0da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:17.783069 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:17.783069 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:17.783069 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:17.783069 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:17.783069 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:17.783069 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:17.783069 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:17.783069 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:17.783069 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:17.783069 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:17.783069 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:17.783069 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:17.783069 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:17.783069 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:17.784285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:17.784285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:17.784285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:17.784285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:17.784285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:17.784285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:17.784285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:17.784285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:17.784285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:17.784285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:17.784285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:17.784285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:17.784285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:17.784285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:17.784285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:17.784285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:17.784285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:17.785781 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:17.785781 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:17.785781 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:17.785781 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:17.785781 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 415/828] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:17.789925 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d7fac-86a6-489c-9362-9b7fd6cb5966 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:17.911373 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d7fac-86a6-489c-9362-9b7fd6cb5966 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:17.958013 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78feec43-2291-488f-850a-064edbe815c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:17.958632 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78feec43-2291-488f-850a-064edbe815c4 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:17.959021 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78feec43-2291-488f-850a-064edbe815c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:17.959305 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78feec43-2291-488f-850a-064edbe815c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:17.960042 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78feec43-2291-488f-850a-064edbe815c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:17.960356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78feec43-2291-488f-850a-064edbe815c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:17.961818 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78feec43-2291-488f-850a-064edbe815c4 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:17.976033 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 414/829] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:17.982148 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958e2cc-7c99-4216-a308-8fa0dde2b0da None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:17.999229 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:18.100116 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958e2cc-7c99-4216-a308-8fa0dde2b0da None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:18.146116 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5f783-0f0a-47c1-834f-e3413db97fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:18.147928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5f783-0f0a-47c1-834f-e3413db97fbb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:18.148407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5f783-0f0a-47c1-834f-e3413db97fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:18.148902 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5f783-0f0a-47c1-834f-e3413db97fbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:18.156802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5f783-0f0a-47c1-834f-e3413db97fbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:18.158497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5f783-0f0a-47c1-834f-e3413db97fbb None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:18.172640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-f9f5f783-0f0a-47c1-834f-e3413db97fbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:18.172640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:18.172640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:18.172640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:18.172640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:18.172640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:18.172640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:18.172640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:18.172640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:18.172640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:18.172640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:18.172640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:18.172640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:17:18.172640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:17:18.172640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:17:18.173636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:17:18.173636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:18.173636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:18.173636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:18.173636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:18.173636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:18.173636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:18.173636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:18.173636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:18.173636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:18.173636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:18.173636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:18.173636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:18.173636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:18.173636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:18.173636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:18.173636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:18.174977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:17:18.174977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:17:18.174977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:17:18.174977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:17:18.174977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:17:18.174977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:17:18.174977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:18.174977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:18.177467 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 416/830] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:18.182860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78feec43-2291-488f-850a-064edbe815c4 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:18.207076 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:18.236606 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aea408-8089-47b3-85f0-810dac47c0d7 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:18.237210 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aea408-8089-47b3-85f0-810dac47c0d7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:18.237689 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aea408-8089-47b3-85f0-810dac47c0d7 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:18.240234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 417/831] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:18.245424 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708876e-aeae-4531-9aac-28a4fd3b4076 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:18.245792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708876e-aeae-4531-9aac-28a4fd3b4076 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:18.246137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708876e-aeae-4531-9aac-28a4fd3b4076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:18.266603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6708876e-aeae-4531-9aac-28a4fd3b4076 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:18.268436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6708876e-aeae-4531-9aac-28a4fd3b4076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:18.293295 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78feec43-2291-488f-850a-064edbe815c4 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:18.333114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e242ce7-f775-421b-ba9d-780ac2b3f73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:18.334098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e242ce7-f775-421b-ba9d-780ac2b3f73b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:18.334570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e242ce7-f775-421b-ba9d-780ac2b3f73b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:18.335029 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e242ce7-f775-421b-ba9d-780ac2b3f73b None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:18.336029 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e242ce7-f775-421b-ba9d-780ac2b3f73b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:18.336536 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e242ce7-f775-421b-ba9d-780ac2b3f73b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:18.338916 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e242ce7-f775-421b-ba9d-780ac2b3f73b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:18.355491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 415/832] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:17:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:18.360832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e242ce7-f775-421b-ba9d-780ac2b3f73b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:18.364034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 418/833] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:18.385441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708876e-aeae-4531-9aac-28a4fd3b4076 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:18.387722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:18.470070 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:18.475925 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e242ce7-f775-421b-ba9d-780ac2b3f73b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:18.489413 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708876e-aeae-4531-9aac-28a4fd3b4076 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:18.512380 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f8a45-a5a5-4704-bfe0-81f7573506b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:18.514168 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f8a45-a5a5-4704-bfe0-81f7573506b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:18.514749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f8a45-a5a5-4704-bfe0-81f7573506b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:18.515237 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f8a45-a5a5-4704-bfe0-81f7573506b1 None admin] PATH_INFO: `/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/01113a3f8cbf46b09fb5fcf4315a219b/roles/1f864eb92c9545bfb36cb24aff0401e4` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:18.526031 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99caf01-ae71-441f-a1f3-2e053f92f578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:18.526858 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99caf01-ae71-441f-a1f3-2e053f92f578 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:18.527145 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99caf01-ae71-441f-a1f3-2e053f92f578 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:18.527420 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99caf01-ae71-441f-a1f3-2e053f92f578 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:18.528078 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99caf01-ae71-441f-a1f3-2e053f92f578 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:18.529474 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99caf01-ae71-441f-a1f3-2e053f92f578 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:18.542892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-a99caf01-ae71-441f-a1f3-2e053f92f578 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 02:17:18.542892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:18.542892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:17:18.542892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:17:18.542892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:17:18.542892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:17:18.542892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:17:18.542892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:18.542892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 02:17:18.542892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:18.542892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:18.542892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:18.542892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:18.542892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:18.542892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:18.542892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:18.543866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:18.543866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:18.543866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:18.543866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:18.543866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:18.543866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:18.543866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:18.543866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:17:18.543866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:17:18.543866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:17:18.543866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:17:18.543866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:18.543866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:18.543866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:18.543866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:18.543866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:18.545261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:18.545261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:18.545261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:18.545261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:18.545261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:18.545261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:18.545261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:18.545261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:18.545261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:18.545261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:18.545261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:18.545261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:17:18.545261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:18.545261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 02:17:18.545261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:18.549725 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 419/834] 10.222.0.64 () {56 vars in 1132 bytes} [Mon Jul 18 02:17:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:18.550709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99caf01-ae71-441f-a1f3-2e053f92f578 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:18.624630 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:18.655211 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f8a45-a5a5-4704-bfe0-81f7573506b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f6f840feba049ee9eeaf7bf0b300730, user_id=01113a3f8cbf46b09fb5fcf4315a219b, role_id=1f864eb92c9545bfb36cb24aff0401e4)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:18.656694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f8a45-a5a5-4704-bfe0-81f7573506b1 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:18.663068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99caf01-ae71-441f-a1f3-2e053f92f578 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:18.698619 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df0db99-a07e-49f4-9ee7-a1eb946bf177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:18.699323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0db99-a07e-49f4-9ee7-a1eb946bf177 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:18.699613 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0db99-a07e-49f4-9ee7-a1eb946bf177 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:18.699899 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df0db99-a07e-49f4-9ee7-a1eb946bf177 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:18.700603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0db99-a07e-49f4-9ee7-a1eb946bf177 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:18.700913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0db99-a07e-49f4-9ee7-a1eb946bf177 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:18.702319 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df0db99-a07e-49f4-9ee7-a1eb946bf177 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:18.707026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 420/835] 10.222.0.64 () {56 vars in 1126 bytes} [Mon Jul 18 02:17:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:18.708217 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e0936-9822-402b-9436-50c1c2dc3f28 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:18.708506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e0936-9822-402b-9436-50c1c2dc3f28 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:18.708785 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e0936-9822-402b-9436-50c1c2dc3f28 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:18.710342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 421/836] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:18.712448 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e0936-9822-402b-9436-50c1c2dc3f28 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:18.729252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 416/837] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:17:18 2022] PUT /identity/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/01113a3f8cbf46b09fb5fcf4315a219b/roles/1f864eb92c9545bfb36cb24aff0401e4 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:17:18.730739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef274e7-ebb9-42d4-9cf9-d68f603e3caa None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:18.731097 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef274e7-ebb9-42d4-9cf9-d68f603e3caa None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:18.731470 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef274e7-ebb9-42d4-9cf9-d68f603e3caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:18.757246 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-5ef274e7-ebb9-42d4-9cf9-d68f603e3caa None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:18.758537 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5ef274e7-ebb9-42d4-9cf9-d68f603e3caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:18.839257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e0936-9822-402b-9436-50c1c2dc3f28 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:18.852191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 417/838] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:18 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:18.874554 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef274e7-ebb9-42d4-9cf9-d68f603e3caa None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:18.876248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:18.882832 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a89d86-fd06-4d65-9c10-c2e6a2e41895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:18.883715 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a89d86-fd06-4d65-9c10-c2e6a2e41895 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:18.884003 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a89d86-fd06-4d65-9c10-c2e6a2e41895 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:18.891820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a89d86-fd06-4d65-9c10-c2e6a2e41895 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:18.891820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a89d86-fd06-4d65-9c10-c2e6a2e41895 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:18.891820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a89d86-fd06-4d65-9c10-c2e6a2e41895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:18.891820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a89d86-fd06-4d65-9c10-c2e6a2e41895 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:18.893423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 422/839] 10.222.0.64 () {56 vars in 1126 bytes} [Mon Jul 18 02:17:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:18.946108 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:18.996015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef274e7-ebb9-42d4-9cf9-d68f603e3caa None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:19.035582 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efda79-529a-4b83-8c62-ebe8d5a9dd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:19.036334 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efda79-529a-4b83-8c62-ebe8d5a9dd05 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:19.036618 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efda79-529a-4b83-8c62-ebe8d5a9dd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:19.036895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efda79-529a-4b83-8c62-ebe8d5a9dd05 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:19.037567 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5efda79-529a-4b83-8c62-ebe8d5a9dd05 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:19.039082 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5efda79-529a-4b83-8c62-ebe8d5a9dd05 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:19.052903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-b5efda79-529a-4b83-8c62-ebe8d5a9dd05 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 02:17:19.052903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:19.052903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:17:19.052903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:17:19.052903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:17:19.052903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:17:19.052903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:17:19.052903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:19.052903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 02:17:19.052903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:19.052903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:19.052903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:19.052903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:19.052903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:19.052903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:19.052903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:19.052903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:19.053981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:19.053981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:19.053981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:19.053981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:19.053981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:19.053981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:19.053981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:17:19.053981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:17:19.053981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:17:19.053981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:17:19.053981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:19.053981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:19.053981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:19.053981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:19.053981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:19.053981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:19.055224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:19.055224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:19.055224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:19.055224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:19.055224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:19.055224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:19.055224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:19.055224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:19.055224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:19.055224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:19.055224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:17:19.055224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:19.055224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 02:17:19.055224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:19.055224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 418/840] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jul 18 02:17:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:19.060915 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a89d86-fd06-4d65-9c10-c2e6a2e41895 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:19.174948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a89d86-fd06-4d65-9c10-c2e6a2e41895 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:19.214222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576de70-8716-407e-9895-28f300618866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:19.214894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576de70-8716-407e-9895-28f300618866 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:19.215180 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576de70-8716-407e-9895-28f300618866 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:19.215458 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576de70-8716-407e-9895-28f300618866 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:19.216177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576de70-8716-407e-9895-28f300618866 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:19.216480 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576de70-8716-407e-9895-28f300618866 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:19.217865 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576de70-8716-407e-9895-28f300618866 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:19.222976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 423/841] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jul 18 02:17:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:19.228201 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efda79-529a-4b83-8c62-ebe8d5a9dd05 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:19.333723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efda79-529a-4b83-8c62-ebe8d5a9dd05 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:19.357917 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:19.369272 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804d3d62-ed70-448a-8e6f-b8ec0691a635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:19.370080 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d3d62-ed70-448a-8e6f-b8ec0691a635 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:19.370382 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d3d62-ed70-448a-8e6f-b8ec0691a635 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:19.375534 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804d3d62-ed70-448a-8e6f-b8ec0691a635 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:19.375534 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d3d62-ed70-448a-8e6f-b8ec0691a635 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:19.375534 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d3d62-ed70-448a-8e6f-b8ec0691a635 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:19.375534 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804d3d62-ed70-448a-8e6f-b8ec0691a635 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:19.378224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 419/842] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jul 18 02:17:19 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:19.565966 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816abf1b-3225-45f6-931a-2c5bebefcbc3 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:19.566959 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816abf1b-3225-45f6-931a-2c5bebefcbc3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:19.567475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816abf1b-3225-45f6-931a-2c5bebefcbc3 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:19.569324 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 424/843] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:19.575071 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7f1de-7a75-462b-bbb1-0373342acdbc None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:19.575945 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7f1de-7a75-462b-bbb1-0373342acdbc None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:19.576427 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7f1de-7a75-462b-bbb1-0373342acdbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:19.593524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-bca7f1de-7a75-462b-bbb1-0373342acdbc None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:19.595054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-bca7f1de-7a75-462b-bbb1-0373342acdbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:19.662959 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 420/844] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:19.686965 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816abf1b-3225-45f6-931a-2c5bebefcbc3 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:19.750149 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:19.793217 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816abf1b-3225-45f6-931a-2c5bebefcbc3 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:19.828502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee7b3b-8d6d-4d31-a070-a7a9edb45769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:19.829400 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee7b3b-8d6d-4d31-a070-a7a9edb45769 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:19.829685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee7b3b-8d6d-4d31-a070-a7a9edb45769 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:19.829992 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee7b3b-8d6d-4d31-a070-a7a9edb45769 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:19.841866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee7b3b-8d6d-4d31-a070-a7a9edb45769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:17:19.849723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-a9ee7b3b-8d6d-4d31-a070-a7a9edb45769 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:17:19.849723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:19.849723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:19.849723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:19.849723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:19.849723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:19.849723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:19.849723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:19.849723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:19.849723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:19.849723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:19.849723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:19.849723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:17:19.849723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:17:19.849723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:17:19.849723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:17:19.850657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:17:19.850657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:17:19.850657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:17:19.850657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:17:19.850657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:19.850657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:19.850657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:19.850657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:19.850657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:19.850657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:19.850657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:19.850657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:19.850657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:19.850657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:19.850657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:19.850657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:19.851508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:19.851508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:19.851508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:19.851508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:19.851508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:17:19.851508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:17:19.851508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:17:19.851508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:17:19.851508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:17:19.851508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:17:19.851508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:17:19.851508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:19.851508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 425/845] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:17:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:19.856937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7f1de-7a75-462b-bbb1-0373342acdbc None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:19.955489 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7f1de-7a75-462b-bbb1-0373342acdbc None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:19.973094 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:19.989559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63add4ad-a6b5-49be-9347-580ab9f56d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:19.990278 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63add4ad-a6b5-49be-9347-580ab9f56d24 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:19.990563 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63add4ad-a6b5-49be-9347-580ab9f56d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:19.990839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63add4ad-a6b5-49be-9347-580ab9f56d24 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:19.991588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63add4ad-a6b5-49be-9347-580ab9f56d24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:19.991892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63add4ad-a6b5-49be-9347-580ab9f56d24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:19.993285 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63add4ad-a6b5-49be-9347-580ab9f56d24 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:20.002489 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 421/846] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:17:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:20.007839 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee7b3b-8d6d-4d31-a070-a7a9edb45769 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:20.120875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee7b3b-8d6d-4d31-a070-a7a9edb45769 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:20.142183 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:20.163000 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfd987-a724-4106-be8a-e4f195b4cde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:20.164128 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfd987-a724-4106-be8a-e4f195b4cde6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:20.164691 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfd987-a724-4106-be8a-e4f195b4cde6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:20.165173 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfd987-a724-4106-be8a-e4f195b4cde6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:20.178288 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfd987-a724-4106-be8a-e4f195b4cde6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:20.179979 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddfd987-a724-4106-be8a-e4f195b4cde6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:20.198096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-3ddfd987-a724-4106-be8a-e4f195b4cde6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:20.198096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:20.198096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:20.198096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:20.198096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:20.198096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:20.198096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:20.198096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:20.198096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:20.198096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:20.198096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:20.198096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:20.198096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:20.198096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:20.198096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:20.198960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:20.198960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:20.198960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:20.198960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:20.198960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:20.198960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:20.198960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:20.198960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:20.198960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:20.198960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:20.198960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:20.198960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:20.198960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:20.198960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:20.198960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:20.198960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:20.198960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:20.199841 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:20.199841 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:20.199841 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:20.199841 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:20.202023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 426/847] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:20.209744 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63add4ad-a6b5-49be-9347-580ab9f56d24 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:20.309157 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63add4ad-a6b5-49be-9347-580ab9f56d24 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:20.342250 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b9414-51e0-4ff5-9ca3-307f90aa9f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:20.343186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b9414-51e0-4ff5-9ca3-307f90aa9f62 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:20.343676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b9414-51e0-4ff5-9ca3-307f90aa9f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:20.344144 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88b9414-51e0-4ff5-9ca3-307f90aa9f62 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:20.345063 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b9414-51e0-4ff5-9ca3-307f90aa9f62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:20.345575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b9414-51e0-4ff5-9ca3-307f90aa9f62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:20.347283 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88b9414-51e0-4ff5-9ca3-307f90aa9f62 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:20.359917 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 422/848] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:20.369729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfd987-a724-4106-be8a-e4f195b4cde6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:20.467681 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfd987-a724-4106-be8a-e4f195b4cde6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:20.502820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd9377-3f02-43eb-a578-fa0854b36bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:20.503632 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd9377-3f02-43eb-a578-fa0854b36bdc None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:20.503918 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd9377-3f02-43eb-a578-fa0854b36bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:20.504197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbd9377-3f02-43eb-a578-fa0854b36bdc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:20.512430 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd9377-3f02-43eb-a578-fa0854b36bdc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:20.513914 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbd9377-3f02-43eb-a578-fa0854b36bdc None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:20.529985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-dbbd9377-3f02-43eb-a578-fa0854b36bdc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 02:17:20.529985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:20.529985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:20.529985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:20.529985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:20.529985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:20.529985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:20.529985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:20.529985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:20.529985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:20.529985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:20.529985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:20.529985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:17:20.529985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:17:20.529985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:17:20.529985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:17:20.530976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:20.530976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:20.530976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:17:20.530976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:20.530976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:17:20.530976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:20.530976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:20.530976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:20.530976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:20.530976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:20.530976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:20.530976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:20.530976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:20.530976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:20.530976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:20.530976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:20.530976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:20.530976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:20.532346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:20.532346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:20.532346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:17:20.532346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:17:20.532346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:17:20.532346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:17:20.532346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:17:20.532346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:17:20.532346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 02:17:20.532346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:20.532346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 427/849] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:17:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:20.537240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b9414-51e0-4ff5-9ca3-307f90aa9f62 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:20.590147 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:20.643035 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88b9414-51e0-4ff5-9ca3-307f90aa9f62 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:20.678547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a051f2-eb99-47fb-b78d-2e28498804c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:20.679574 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a051f2-eb99-47fb-b78d-2e28498804c4 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:20.680075 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a051f2-eb99-47fb-b78d-2e28498804c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:20.680560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a051f2-eb99-47fb-b78d-2e28498804c4 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:20.682218 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a051f2-eb99-47fb-b78d-2e28498804c4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:20.682727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a051f2-eb99-47fb-b78d-2e28498804c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:20.684325 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a051f2-eb99-47fb-b78d-2e28498804c4 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:20.703125 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 423/850] 10.222.0.64 () {56 vars in 1135 bytes} [Mon Jul 18 02:17:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:20.713722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd9377-3f02-43eb-a578-fa0854b36bdc None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:20.741232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:20.813191 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbd9377-3f02-43eb-a578-fa0854b36bdc None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:20.848867 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e0db6-f097-48da-9d7e-acdca843226c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:20.849524 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e0db6-f097-48da-9d7e-acdca843226c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:20.849840 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e0db6-f097-48da-9d7e-acdca843226c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:20.850120 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e0db6-f097-48da-9d7e-acdca843226c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:20.920082 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e0db6-f097-48da-9d7e-acdca843226c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:20.921540 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e0db6-f097-48da-9d7e-acdca843226c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:20.951767 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:21.023221 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 428/851] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:17:20 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 02:17:21.029306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e0db6-f097-48da-9d7e-acdca843226c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:21.029460 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5adc0-829c-499f-bc2f-8f7571c02c2f None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:21.029881 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5adc0-829c-499f-bc2f-8f7571c02c2f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:21.030169 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae5adc0-829c-499f-bc2f-8f7571c02c2f None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:21.031924 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 424/852] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:21.036911 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db1f02-e50b-4085-b719-38fc304af8fc None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:21.037202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db1f02-e50b-4085-b719-38fc304af8fc None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:21.037489 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db1f02-e50b-4085-b719-38fc304af8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:21.055679 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-70db1f02-e50b-4085-b719-38fc304af8fc None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:21.057164 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-70db1f02-e50b-4085-b719-38fc304af8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:21.140836 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e0db6-f097-48da-9d7e-acdca843226c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:21.143730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 425/853] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 02:17:21.145069 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ee219-fa5e-4be2-afc5-0d26cda7dbfc None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:21.145361 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ee219-fa5e-4be2-afc5-0d26cda7dbfc None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:21.145638 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ee219-fa5e-4be2-afc5-0d26cda7dbfc None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:21.147061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 426/854] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:21.152124 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e27450-cff2-49be-8f51-32d3168b6119 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:21.152377 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e27450-cff2-49be-8f51-32d3168b6119 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:21.152659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e27450-cff2-49be-8f51-32d3168b6119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:21.169492 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-73e27450-cff2-49be-8f51-32d3168b6119 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:21.170805 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-73e27450-cff2-49be-8f51-32d3168b6119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:21.186084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:21.191804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96429a-049e-4c3b-b77d-25870101b427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:21.198383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96429a-049e-4c3b-b77d-25870101b427 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:21.198383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96429a-049e-4c3b-b77d-25870101b427 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:21.198383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b96429a-049e-4c3b-b77d-25870101b427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:21.198631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:21.204139 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96429a-049e-4c3b-b77d-25870101b427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:21.205818 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b96429a-049e-4c3b-b77d-25870101b427 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:21.224864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-3b96429a-049e-4c3b-b77d-25870101b427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:21.224864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:21.224864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:21.224864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:21.224864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:21.224864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:21.224864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:21.224864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:21.224864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:21.224864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:21.224864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:21.224864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:21.224864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:21.224864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:21.224864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:21.225909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:21.225909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:21.225909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:21.225909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:21.225909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:21.225909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:21.225909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:21.225909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:21.225909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:21.225909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:21.225909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:21.225909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:21.225909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:21.225909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:21.225909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:21.225909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:21.225909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:21.226790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:21.226790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:21.226790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:21.226790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:21.226790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 429/855] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:21.227508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96429a-049e-4c3b-b77d-25870101b427 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:21.249848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 427/856] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 02:17:21.251086 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e27450-cff2-49be-8f51-32d3168b6119 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:21.343117 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b96429a-049e-4c3b-b77d-25870101b427 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:21.356510 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e27450-cff2-49be-8f51-32d3168b6119 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:21.378896 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69e1fd-49a0-44b8-91d4-cd31b0f66b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:21.379705 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69e1fd-49a0-44b8-91d4-cd31b0f66b02 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:21.379992 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69e1fd-49a0-44b8-91d4-cd31b0f66b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:21.380278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69e1fd-49a0-44b8-91d4-cd31b0f66b02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:21.391027 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69e1fd-49a0-44b8-91d4-cd31b0f66b02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:17:21.393370 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a947f-4b97-44b7-98b1-306b93565e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:21.394081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a947f-4b97-44b7-98b1-306b93565e18 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:21.394370 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a947f-4b97-44b7-98b1-306b93565e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:21.394651 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298a947f-4b97-44b7-98b1-306b93565e18 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:21.395376 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a947f-4b97-44b7-98b1-306b93565e18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:21.395675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a947f-4b97-44b7-98b1-306b93565e18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:21.397048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298a947f-4b97-44b7-98b1-306b93565e18 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:21.398807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-3a69e1fd-49a0-44b8-91d4-cd31b0f66b02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:17:21.398807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:21.398807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:21.398807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:21.398807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:21.398807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:21.398807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:21.398807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:21.398807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:21.398807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:21.398807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:21.398807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:21.398807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:17:21.398807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:17:21.398807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:17:21.398807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:17:21.399709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:17:21.399709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:17:21.399709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:17:21.399709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:17:21.399709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:21.399709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:21.399709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:21.399709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:21.399709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:21.399709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:21.399709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:21.399709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:21.399709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:21.399709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:21.399709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:21.399709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:21.401101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:21.401101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:21.401101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:21.401101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:21.401101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:17:21.401101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:17:21.401101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:17:21.401101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:17:21.401101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:17:21.401101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:17:21.401101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:17:21.401101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:21.401101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 430/857] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:17:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:21.403014 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69e1fd-49a0-44b8-91d4-cd31b0f66b02 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:21.415863 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 428/858] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:21.417425 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a947f-4b97-44b7-98b1-306b93565e18 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:21.441037 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:21.453438 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:21.511107 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69e1fd-49a0-44b8-91d4-cd31b0f66b02 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:21.523262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298a947f-4b97-44b7-98b1-306b93565e18 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:21.550973 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424a94c-dec9-4858-878c-b4393dd0a1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:21.551639 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424a94c-dec9-4858-878c-b4393dd0a1b4 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:21.551922 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424a94c-dec9-4858-878c-b4393dd0a1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:21.552198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424a94c-dec9-4858-878c-b4393dd0a1b4 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:21.552907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424a94c-dec9-4858-878c-b4393dd0a1b4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:21.554300 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424a94c-dec9-4858-878c-b4393dd0a1b4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:21.558875 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ace57c-e7c3-4a16-8d16-cad07a2a8044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:21.559540 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ace57c-e7c3-4a16-8d16-cad07a2a8044 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:21.559823 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ace57c-e7c3-4a16-8d16-cad07a2a8044 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:21.560098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ace57c-e7c3-4a16-8d16-cad07a2a8044 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:21.560840 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ace57c-e7c3-4a16-8d16-cad07a2a8044 None admin] RBAC: Adding query filter params (name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:21.561146 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ace57c-e7c3-4a16-8d16-cad07a2a8044 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:21.562532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ace57c-e7c3-4a16-8d16-cad07a2a8044 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:21.570442 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 429/859] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jul 18 02:17:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:21.571285 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ace57c-e7c3-4a16-8d16-cad07a2a8044 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:21.648415 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:21.651834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 431/860] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jul 18 02:17:21 2022] POST /identity/v3/services => generated 269 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:17:21.653126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a85588-d6f4-4ed5-8821-58511c4d2260 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:21.653420 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a85588-d6f4-4ed5-8821-58511c4d2260 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:21.653718 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a85588-d6f4-4ed5-8821-58511c4d2260 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:21.654987 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 432/861] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:21.655701 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a85588-d6f4-4ed5-8821-58511c4d2260 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:21.686909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ace57c-e7c3-4a16-8d16-cad07a2a8044 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:21.733965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943da9f-fa85-4596-ae56-4247f8b2c4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:21.734793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943da9f-fa85-4596-ae56-4247f8b2c4ca None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:21.735074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943da9f-fa85-4596-ae56-4247f8b2c4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:21.735346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943da9f-fa85-4596-ae56-4247f8b2c4ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:21.743330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943da9f-fa85-4596-ae56-4247f8b2c4ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:21.745563 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943da9f-fa85-4596-ae56-4247f8b2c4ca None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:21.761343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-4943da9f-fa85-4596-ae56-4247f8b2c4ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:21.761343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:21.761343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:21.761343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:21.761343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:21.761343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:21.761343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:21.761343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:21.761343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:21.761343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:21.761343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:21.761343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:21.761343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:17:21.761343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:17:21.761343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:17:21.762354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:17:21.762354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:21.762354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:21.762354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:21.762354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:21.762354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:21.762354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:21.762354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:21.762354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:21.762354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:21.762354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:21.762354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:21.762354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:21.762354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:21.762354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:21.762354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:21.762354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:21.763247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:17:21.763247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:17:21.763247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:17:21.763247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:17:21.763247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:17:21.763247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:17:21.763247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:21.763247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:21.763247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 430/862] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:21.764299 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c77490-74a0-47cb-aa8b-89e625d672eb None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:21.764299 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c77490-74a0-47cb-aa8b-89e625d672eb None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:21.764513 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c77490-74a0-47cb-aa8b-89e625d672eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:21.782915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-73c77490-74a0-47cb-aa8b-89e625d672eb None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:21.784220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-73c77490-74a0-47cb-aa8b-89e625d672eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:21.785182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a85588-d6f4-4ed5-8821-58511c4d2260 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:21.786957 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:21.830769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed64bfe-9346-452e-a6b8-4d7c12fa3543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:21.832375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed64bfe-9346-452e-a6b8-4d7c12fa3543 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:21.832661 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed64bfe-9346-452e-a6b8-4d7c12fa3543 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:21.832942 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed64bfe-9346-452e-a6b8-4d7c12fa3543 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:21.844059 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed64bfe-9346-452e-a6b8-4d7c12fa3543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:21.845272 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed64bfe-9346-452e-a6b8-4d7c12fa3543 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:21.864894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-4ed64bfe-9346-452e-a6b8-4d7c12fa3543 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:21.864894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:21.864894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:21.864894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:21.864894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:21.864894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:21.864894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:21.864894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:21.864894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:21.864894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:21.864894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:21.864894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:21.864894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:21.864894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:21.864894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:21.865882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:21.865882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:21.865882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:21.865882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:21.865882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:21.865882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:21.865882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:21.865882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:21.865882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:21.865882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:21.865882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:21.865882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:21.865882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:21.865882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:21.865882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:21.865882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:21.865882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:21.866861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:21.866861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:21.866861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:21.866861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:21.866861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 433/864] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:21.867131 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 431/864] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:21 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:21.867203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed64bfe-9346-452e-a6b8-4d7c12fa3543 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:21.872420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c77490-74a0-47cb-aa8b-89e625d672eb None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:21.941545 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:21.977795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c77490-74a0-47cb-aa8b-89e625d672eb None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:21.984075 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed64bfe-9346-452e-a6b8-4d7c12fa3543 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:22.014142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0614f-afc0-4e0e-bba5-204237c51320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:22.014813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0614f-afc0-4e0e-bba5-204237c51320 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:22.015093 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0614f-afc0-4e0e-bba5-204237c51320 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:22.015418 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0614f-afc0-4e0e-bba5-204237c51320 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:22.016357 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0614f-afc0-4e0e-bba5-204237c51320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:22.016667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0614f-afc0-4e0e-bba5-204237c51320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:22.018103 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c0614f-afc0-4e0e-bba5-204237c51320 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:22.020043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401a7c9-a9ea-4169-9499-8ae59f481f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:22.020722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401a7c9-a9ea-4169-9499-8ae59f481f76 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:22.021010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401a7c9-a9ea-4169-9499-8ae59f481f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:22.021293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4401a7c9-a9ea-4169-9499-8ae59f481f76 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:22.022124 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401a7c9-a9ea-4169-9499-8ae59f481f76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:22.022439 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401a7c9-a9ea-4169-9499-8ae59f481f76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:22.023957 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4401a7c9-a9ea-4169-9499-8ae59f481f76 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:22.031682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 432/865] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:22.032674 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0614f-afc0-4e0e-bba5-204237c51320 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:22.041839 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 434/866] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:17:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:22.042690 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401a7c9-a9ea-4169-9499-8ae59f481f76 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:22.062288 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:22.143708 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0614f-afc0-4e0e-bba5-204237c51320 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:22.169623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4401a7c9-a9ea-4169-9499-8ae59f481f76 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:22.172541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:22.183644 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee782af5-9ef2-457e-8467-f0c71bebb900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:22.184415 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee782af5-9ef2-457e-8467-f0c71bebb900 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:22.184811 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee782af5-9ef2-457e-8467-f0c71bebb900 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:22.185123 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee782af5-9ef2-457e-8467-f0c71bebb900 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:22.185928 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee782af5-9ef2-457e-8467-f0c71bebb900 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:22.187360 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee782af5-9ef2-457e-8467-f0c71bebb900 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:22.206847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689a806-46aa-44cd-bb3c-5d19b03449ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:22.207581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689a806-46aa-44cd-bb3c-5d19b03449ae None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:22.207865 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689a806-46aa-44cd-bb3c-5d19b03449ae None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:22.208138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6689a806-46aa-44cd-bb3c-5d19b03449ae None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:22.215972 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689a806-46aa-44cd-bb3c-5d19b03449ae None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:22.217416 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6689a806-46aa-44cd-bb3c-5d19b03449ae None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:22.232412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-6689a806-46aa-44cd-bb3c-5d19b03449ae None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 02:17:22.232412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:22.232412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:22.232412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:22.232412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:22.232412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:22.232412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:22.232412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:22.232412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:22.232412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:22.232412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:22.232412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:22.232412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:17:22.232412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:17:22.232412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:17:22.232412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:17:22.233459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:22.233459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:22.233459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:17:22.233459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:22.233459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:17:22.233459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:22.233459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:22.233459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:22.233459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:22.233459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:22.233459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:22.233459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:22.233459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:22.233459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:22.233459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:22.233459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:22.233459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:22.233459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:22.235652 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:22.235652 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:22.235652 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:17:22.235652 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:17:22.235652 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:17:22.235652 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:17:22.235652 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:17:22.235652 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:17:22.235652 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 02:17:22.235652 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:22.235652 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 435/867] 10.222.0.64 () {56 vars in 1117 bytes} [Mon Jul 18 02:17:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:22.235652 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689a806-46aa-44cd-bb3c-5d19b03449ae None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:22.303778 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 433/868] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jul 18 02:17:22 2022] POST /identity/v3/services => generated 251 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:17:22.314184 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:22.314850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee782af5-9ef2-457e-8467-f0c71bebb900 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:22.346789 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6689a806-46aa-44cd-bb3c-5d19b03449ae None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:22.407038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcc230-2d92-4655-904f-aea4535d95ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:22.407722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcc230-2d92-4655-904f-aea4535d95ff None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:22.408014 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcc230-2d92-4655-904f-aea4535d95ff None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:22.408301 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcc230-2d92-4655-904f-aea4535d95ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:22.409583 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcc230-2d92-4655-904f-aea4535d95ff None admin] RBAC: Adding query filter params (role.id=5dfa34e7a4594751aed7c0495c9a2383, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=6a4e51f478874d99a7fc4ee2dea77caf) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:22.410146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcc230-2d92-4655-904f-aea4535d95ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:22.411957 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bcc230-2d92-4655-904f-aea4535d95ff None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:22.426982 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 436/869] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:17:22 2022] GET /identity/v3/role_assignments?user.id=6a4e51f478874d99a7fc4ee2dea77caf&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=5dfa34e7a4594751aed7c0495c9a2383 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:22.462925 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee782af5-9ef2-457e-8467-f0c71bebb900 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:22.502232 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3813d9-aab5-4b6e-8ece-b0b4eb10009a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:22.502927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3813d9-aab5-4b6e-8ece-b0b4eb10009a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:22.503214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3813d9-aab5-4b6e-8ece-b0b4eb10009a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:22.503494 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3813d9-aab5-4b6e-8ece-b0b4eb10009a None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:22.504345 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3813d9-aab5-4b6e-8ece-b0b4eb10009a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:22.504664 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3813d9-aab5-4b6e-8ece-b0b4eb10009a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:22.506167 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3813d9-aab5-4b6e-8ece-b0b4eb10009a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:22.537613 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 434/870] 10.222.0.64 () {56 vars in 1149 bytes} [Mon Jul 18 02:17:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:22.539091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcc230-2d92-4655-904f-aea4535d95ff None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:22.655516 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcc230-2d92-4655-904f-aea4535d95ff None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:22.691278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7665c-e7de-4054-8da0-88d2e0a0838f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:22.692295 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7665c-e7de-4054-8da0-88d2e0a0838f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:22.692796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7665c-e7de-4054-8da0-88d2e0a0838f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:22.693264 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad7665c-e7de-4054-8da0-88d2e0a0838f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:22.696242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:22.765683 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7665c-e7de-4054-8da0-88d2e0a0838f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:22.767131 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad7665c-e7de-4054-8da0-88d2e0a0838f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:22.881165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 437/871] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:17:22 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 02:17:22.883315 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3813d9-aab5-4b6e-8ece-b0b4eb10009a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:22.932323 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:22.991114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3813d9-aab5-4b6e-8ece-b0b4eb10009a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:23.034156 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c67a50-378a-44fa-b08c-8539c13b7f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:23.034156 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c67a50-378a-44fa-b08c-8539c13b7f36 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:23.034156 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c67a50-378a-44fa-b08c-8539c13b7f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:23.034156 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c67a50-378a-44fa-b08c-8539c13b7f36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:23.038565 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c67a50-378a-44fa-b08c-8539c13b7f36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:23.040005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c67a50-378a-44fa-b08c-8539c13b7f36 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:23.058240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-03c67a50-378a-44fa-b08c-8539c13b7f36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:23.058240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:23.058240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:23.058240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:23.058240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:23.058240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:23.058240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:23.058240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:23.058240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:23.058240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:23.058240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:23.058240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:23.058240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:23.058240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:23.058240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:23.059342 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:23.059342 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:23.059342 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:23.059342 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:23.059342 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:23.059342 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:23.059342 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:23.059342 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:23.059342 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:23.059342 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:23.059342 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:23.059342 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:23.059342 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:23.059342 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:23.059342 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:23.059342 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:23.059342 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:23.060276 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:23.060276 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:23.060276 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:23.060276 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:23.060276 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 435/872] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:23.065274 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7665c-e7de-4054-8da0-88d2e0a0838f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:23.101097 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:23.171062 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad7665c-e7de-4054-8da0-88d2e0a0838f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:23.207757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5c7d7-1a43-46ec-8d26-de285b2bdc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:23.208430 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5c7d7-1a43-46ec-8d26-de285b2bdc1f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:23.208722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5c7d7-1a43-46ec-8d26-de285b2bdc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:23.209001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5c7d7-1a43-46ec-8d26-de285b2bdc1f None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:23.209748 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5c7d7-1a43-46ec-8d26-de285b2bdc1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:23.210058 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5c7d7-1a43-46ec-8d26-de285b2bdc1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:23.211492 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a5c7d7-1a43-46ec-8d26-de285b2bdc1f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:23.228471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 438/873] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:23.229874 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c67a50-378a-44fa-b08c-8539c13b7f36 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:23.327928 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:23.334246 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c67a50-378a-44fa-b08c-8539c13b7f36 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:23.370899 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5102c-bb9d-4c63-8301-bfa41dfc1cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:23.371709 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5102c-bb9d-4c63-8301-bfa41dfc1cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:23.371989 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5102c-bb9d-4c63-8301-bfa41dfc1cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:23.372261 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de5102c-bb9d-4c63-8301-bfa41dfc1cf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:23.379245 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5102c-bb9d-4c63-8301-bfa41dfc1cf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:23.380726 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de5102c-bb9d-4c63-8301-bfa41dfc1cf6 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:23.394720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-5de5102c-bb9d-4c63-8301-bfa41dfc1cf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:23.394720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:23.394720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:23.394720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:23.394720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:23.394720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:23.394720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:23.394720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:23.394720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:23.394720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:23.394720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:23.394720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:23.394720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:17:23.394720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:17:23.394720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:17:23.395603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:17:23.395603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:23.395603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:23.395603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:23.395603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:23.395603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:23.395603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:23.395603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:23.395603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:23.395603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:23.395603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:23.395603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:23.395603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:23.395603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:23.395603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:23.395603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:23.395603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:23.396581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:17:23.396581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:17:23.396581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:17:23.396581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:17:23.396581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:17:23.396581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:17:23.396581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:23.396581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:23.396581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 436/874] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:23.401765 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5c7d7-1a43-46ec-8d26-de285b2bdc1f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:23.506698 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:23.514325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5c7d7-1a43-46ec-8d26-de285b2bdc1f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:23.550763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e624b602-7cd8-4a69-afe9-3099f67766e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:23.551441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624b602-7cd8-4a69-afe9-3099f67766e6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:23.551731 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624b602-7cd8-4a69-afe9-3099f67766e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:23.552014 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e624b602-7cd8-4a69-afe9-3099f67766e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:23.552809 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e624b602-7cd8-4a69-afe9-3099f67766e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:23.553125 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e624b602-7cd8-4a69-afe9-3099f67766e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:23.555283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e624b602-7cd8-4a69-afe9-3099f67766e6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:23.576703 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 439/875] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:17:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:23.579236 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5102c-bb9d-4c63-8301-bfa41dfc1cf6 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:23.685866 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de5102c-bb9d-4c63-8301-bfa41dfc1cf6 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:23.721255 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165e2b6-cde4-4826-bb49-d23b3ae4add4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:23.721956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165e2b6-cde4-4826-bb49-d23b3ae4add4 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:23.722244 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165e2b6-cde4-4826-bb49-d23b3ae4add4 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:23.722525 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165e2b6-cde4-4826-bb49-d23b3ae4add4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:23.723361 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165e2b6-cde4-4826-bb49-d23b3ae4add4 None admin] RBAC: Adding query filter params (role.id=1f864eb92c9545bfb36cb24aff0401e4, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=01113a3f8cbf46b09fb5fcf4315a219b) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:23.723677 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165e2b6-cde4-4826-bb49-d23b3ae4add4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:23.725116 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165e2b6-cde4-4826-bb49-d23b3ae4add4 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:23.732010 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 437/876] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:17:23 2022] GET /identity/v3/role_assignments?user.id=01113a3f8cbf46b09fb5fcf4315a219b&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=1f864eb92c9545bfb36cb24aff0401e4 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:23.748452 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c436ba2-fa77-4a89-b80e-08af7f3a4145 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:23.749123 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c436ba2-fa77-4a89-b80e-08af7f3a4145 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:23.749619 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c436ba2-fa77-4a89-b80e-08af7f3a4145 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:23.751750 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 440/877] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:23.757902 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408ab9e-dd5c-4591-85e6-a2e2c748bbec None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:23.758213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408ab9e-dd5c-4591-85e6-a2e2c748bbec None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:23.758468 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408ab9e-dd5c-4591-85e6-a2e2c748bbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:23.777163 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a408ab9e-dd5c-4591-85e6-a2e2c748bbec None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:23.778460 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a408ab9e-dd5c-4591-85e6-a2e2c748bbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:23.795571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:23.876022 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 438/878] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:23 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:23.900810 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c436ba2-fa77-4a89-b80e-08af7f3a4145 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:24.015507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c436ba2-fa77-4a89-b80e-08af7f3a4145 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:24.052676 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d8b47-df64-4973-8087-4231412d3f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:24.053505 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d8b47-df64-4973-8087-4231412d3f2d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:24.053833 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d8b47-df64-4973-8087-4231412d3f2d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:24.054113 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d8b47-df64-4973-8087-4231412d3f2d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:24.054774 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d8b47-df64-4973-8087-4231412d3f2d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:24.056272 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d8b47-df64-4973-8087-4231412d3f2d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:24.069743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-2a8d8b47-df64-4973-8087-4231412d3f2d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 02:17:24.069743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:24.069743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:17:24.069743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:17:24.069743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:17:24.069743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:17:24.069743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:17:24.069743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:24.069743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 02:17:24.069743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:24.069743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:24.069743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:24.069743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:24.069743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:24.069743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:24.069743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:24.070707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:24.070707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:24.070707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:24.070707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:24.070707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:24.070707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:24.070707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:24.070707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:17:24.070707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:17:24.070707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:17:24.070707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:17:24.070707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:24.070707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:24.070707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:24.070707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:24.070707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:24.072161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:24.072161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:24.072161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:24.072161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:24.072161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:24.072161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:24.072161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:24.072161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:24.072161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:24.072161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:24.072161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:24.072161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:17:24.072161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:24.072161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 02:17:24.072161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:24.076957 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 441/879] 10.222.0.64 () {56 vars in 1132 bytes} [Mon Jul 18 02:17:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:24.078441 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408ab9e-dd5c-4591-85e6-a2e2c748bbec None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:24.195879 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408ab9e-dd5c-4591-85e6-a2e2c748bbec None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:24.233460 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75d6b4-ebe8-4ace-9f4a-08d273fba197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:24.234537 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75d6b4-ebe8-4ace-9f4a-08d273fba197 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:24.235042 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75d6b4-ebe8-4ace-9f4a-08d273fba197 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:24.235523 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75d6b4-ebe8-4ace-9f4a-08d273fba197 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:24.236465 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75d6b4-ebe8-4ace-9f4a-08d273fba197 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:24.236990 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75d6b4-ebe8-4ace-9f4a-08d273fba197 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:24.238577 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75d6b4-ebe8-4ace-9f4a-08d273fba197 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:24.244643 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 439/880] 10.222.0.64 () {56 vars in 1126 bytes} [Mon Jul 18 02:17:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:24.250218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d8b47-df64-4973-8087-4231412d3f2d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:24.272408 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:24.358327 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d8b47-df64-4973-8087-4231412d3f2d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:24.392688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f55d2c-3821-40c3-92d9-a4e9b5c50c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:24.393336 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f55d2c-3821-40c3-92d9-a4e9b5c50c30 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:24.393617 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f55d2c-3821-40c3-92d9-a4e9b5c50c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:24.393919 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f55d2c-3821-40c3-92d9-a4e9b5c50c30 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:24.394026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea2e04-f61a-482a-8d72-dcb07d1c77ba None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:24.394316 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea2e04-f61a-482a-8d72-dcb07d1c77ba None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:24.394594 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea2e04-f61a-482a-8d72-dcb07d1c77ba None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:24.394719 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f55d2c-3821-40c3-92d9-a4e9b5c50c30 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:24.394913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f55d2c-3821-40c3-92d9-a4e9b5c50c30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:24.396170 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 440/881] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:24.396278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f55d2c-3821-40c3-92d9-a4e9b5c50c30 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:24.401768 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39647dec-45de-400d-bc9d-b4c2d562ba2c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:24.402015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39647dec-45de-400d-bc9d-b4c2d562ba2c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:24.402252 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 442/882] 10.222.0.64 () {56 vars in 1126 bytes} [Mon Jul 18 02:17:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:24.402357 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39647dec-45de-400d-bc9d-b4c2d562ba2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:24.407865 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f55d2c-3821-40c3-92d9-a4e9b5c50c30 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:24.420984 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-39647dec-45de-400d-bc9d-b4c2d562ba2c None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:24.422531 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-39647dec-45de-400d-bc9d-b4c2d562ba2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:24.454035 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:24.501127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 441/883] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 02:17:24.506378 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:24.523406 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39647dec-45de-400d-bc9d-b4c2d562ba2c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:24.529903 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f55d2c-3821-40c3-92d9-a4e9b5c50c30 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:24.568100 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af563200-a39a-43c8-929c-f90bfe3b5eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:24.568768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af563200-a39a-43c8-929c-f90bfe3b5eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:24.569050 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af563200-a39a-43c8-929c-f90bfe3b5eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:24.569323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af563200-a39a-43c8-929c-f90bfe3b5eb3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:24.570145 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af563200-a39a-43c8-929c-f90bfe3b5eb3 None admin] RBAC: Adding query filter params (interface=public, service_id=0fade61c391743fc9b37d3a90f6ab1a6, region_id=RegionOne) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:24.570453 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af563200-a39a-43c8-929c-f90bfe3b5eb3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:24.572462 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af563200-a39a-43c8-929c-f90bfe3b5eb3 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:24.578191 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 443/884] 10.222.0.64 () {56 vars in 1251 bytes} [Mon Jul 18 02:17:24 2022] GET /identity/v3/endpoints?service_id=0fade61c391743fc9b37d3a90f6ab1a6&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:24.583409 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af563200-a39a-43c8-929c-f90bfe3b5eb3 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:24.649477 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39647dec-45de-400d-bc9d-b4c2d562ba2c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:24.698740 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518693d3-9d19-480b-bb02-77214f794718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:24.699888 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518693d3-9d19-480b-bb02-77214f794718 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:24.700163 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518693d3-9d19-480b-bb02-77214f794718 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:24.700439 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518693d3-9d19-480b-bb02-77214f794718 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:24.701415 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518693d3-9d19-480b-bb02-77214f794718 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:24.703097 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518693d3-9d19-480b-bb02-77214f794718 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:24.706369 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af563200-a39a-43c8-929c-f90bfe3b5eb3 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:24.716549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-518693d3-9d19-480b-bb02-77214f794718 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 02:17:24.716549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:24.716549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:17:24.716549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:17:24.716549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:17:24.716549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:17:24.716549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:17:24.716549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:24.716549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 02:17:24.716549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:24.716549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:24.716549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:24.716549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:24.716549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:24.716549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:24.716549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:24.716549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:24.717687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:24.717687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:24.717687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:24.717687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:24.717687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:24.717687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:24.717687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:17:24.717687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:17:24.717687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:17:24.717687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:17:24.717687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:24.717687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:24.717687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:24.717687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:24.717687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:24.717687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:24.718915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:24.718915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:24.718915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:24.718915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:24.718915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:24.718915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:24.718915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:24.718915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:24.718915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:24.718915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:24.718915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:17:24.718915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:24.718915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 02:17:24.718915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:24.718915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 442/885] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jul 18 02:17:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:24.719887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefd886-af58-41a9-89ec-e79da4c0bdc0 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:24.719887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefd886-af58-41a9-89ec-e79da4c0bdc0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:24.719887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eefd886-af58-41a9-89ec-e79da4c0bdc0 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:24.721078 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 443/886] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:24.723873 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefd886-af58-41a9-89ec-e79da4c0bdc0 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:24.737994 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:24.748723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4150053-eb5f-4519-897f-ebd47fde38c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:24.749684 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4150053-eb5f-4519-897f-ebd47fde38c4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:24.749684 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4150053-eb5f-4519-897f-ebd47fde38c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:24.751273 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4150053-eb5f-4519-897f-ebd47fde38c4 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:24.751273 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4150053-eb5f-4519-897f-ebd47fde38c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:24.752056 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4150053-eb5f-4519-897f-ebd47fde38c4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:24.761814 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 444/887] 10.222.0.64 () {56 vars in 1087 bytes} [Mon Jul 18 02:17:24 2022] GET /identity/v3/services => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:17:24.761814 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0633f83-cda2-44b9-a1ce-60fa7f2f51e7 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:24.761814 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0633f83-cda2-44b9-a1ce-60fa7f2f51e7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:24.761814 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0633f83-cda2-44b9-a1ce-60fa7f2f51e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:24.786535 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c0633f83-cda2-44b9-a1ce-60fa7f2f51e7 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:24.787796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c0633f83-cda2-44b9-a1ce-60fa7f2f51e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:24.792754 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:24.879267 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eefd886-af58-41a9-89ec-e79da4c0bdc0 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:24.889737 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 445/888] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:24 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:24.907700 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0633f83-cda2-44b9-a1ce-60fa7f2f51e7 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:24.919370 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428a790-8a7e-4636-82e7-63549d87bbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:24.920184 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428a790-8a7e-4636-82e7-63549d87bbdb None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:24.920367 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428a790-8a7e-4636-82e7-63549d87bbdb None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:24.920603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428a790-8a7e-4636-82e7-63549d87bbdb None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:24.921322 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7428a790-8a7e-4636-82e7-63549d87bbdb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:24.921634 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7428a790-8a7e-4636-82e7-63549d87bbdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:24.923066 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7428a790-8a7e-4636-82e7-63549d87bbdb None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:24.928762 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 444/889] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jul 18 02:17:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:24.934472 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428a790-8a7e-4636-82e7-63549d87bbdb None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:25.010234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:25.022936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0633f83-cda2-44b9-a1ce-60fa7f2f51e7 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:25.044815 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428a790-8a7e-4636-82e7-63549d87bbdb None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:25.065058 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68124aa-cac6-426c-8abd-d20e89d48dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:25.065914 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68124aa-cac6-426c-8abd-d20e89d48dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:25.066205 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68124aa-cac6-426c-8abd-d20e89d48dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:25.066489 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68124aa-cac6-426c-8abd-d20e89d48dd6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:25.067156 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68124aa-cac6-426c-8abd-d20e89d48dd6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:25.068533 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68124aa-cac6-426c-8abd-d20e89d48dd6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:25.081151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907914c-3e4e-4cd4-b0e2-cf29625c6578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:25.081852 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907914c-3e4e-4cd4-b0e2-cf29625c6578 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:25.082139 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907914c-3e4e-4cd4-b0e2-cf29625c6578 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:25.082418 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907914c-3e4e-4cd4-b0e2-cf29625c6578 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:25.083124 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907914c-3e4e-4cd4-b0e2-cf29625c6578 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:25.083434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907914c-3e4e-4cd4-b0e2-cf29625c6578 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:25.083704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-d68124aa-cac6-426c-8abd-d20e89d48dd6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 02:17:25.083704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:25.083704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:17:25.083704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:17:25.083704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:17:25.083704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:17:25.083704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:17:25.083704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:25.083704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 02:17:25.083704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:25.083704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:25.083704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:25.083704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:25.083704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:25.083704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:25.083704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:25.083704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:25.084675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:25.084675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:25.084675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:25.084675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:25.084675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:25.084675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:25.084675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:17:25.084675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:17:25.084675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:17:25.084675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:17:25.084675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:25.084675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:25.084675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:25.084675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:25.084675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:25.084675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:25.085501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:25.085501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:25.085501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:25.085501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:25.085501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:25.085501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:25.085501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:25.085501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:25.085501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:25.085501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:25.085501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:17:25.085501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:25.085501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 02:17:25.085501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:25.086316 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907914c-3e4e-4cd4-b0e2-cf29625c6578 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:25.086423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 446/890] 10.222.0.64 () {56 vars in 1126 bytes} [Mon Jul 18 02:17:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:25.092827 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68124aa-cac6-426c-8abd-d20e89d48dd6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:25.099724 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:25.137050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 445/891] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jul 18 02:17:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:25.142699 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907914c-3e4e-4cd4-b0e2-cf29625c6578 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:25.215122 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68124aa-cac6-426c-8abd-d20e89d48dd6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:25.258989 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb133f2-0647-4990-9655-5a9ff77ebde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:25.259773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb133f2-0647-4990-9655-5a9ff77ebde6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:25.260162 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb133f2-0647-4990-9655-5a9ff77ebde6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:25.260601 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb133f2-0647-4990-9655-5a9ff77ebde6 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:25.261381 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb133f2-0647-4990-9655-5a9ff77ebde6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:25.261838 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb133f2-0647-4990-9655-5a9ff77ebde6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:25.263297 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb133f2-0647-4990-9655-5a9ff77ebde6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:25.265965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907914c-3e4e-4cd4-b0e2-cf29625c6578 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:25.273120 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 447/892] 10.222.0.64 () {56 vars in 1122 bytes} [Mon Jul 18 02:17:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:25.274223 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb133f2-0647-4990-9655-5a9ff77ebde6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:25.308520 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3661468-6236-430f-bb2d-7ae940f5c68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:25.309186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3661468-6236-430f-bb2d-7ae940f5c68b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:25.309557 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3661468-6236-430f-bb2d-7ae940f5c68b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:25.309797 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3661468-6236-430f-bb2d-7ae940f5c68b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:25.310558 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3661468-6236-430f-bb2d-7ae940f5c68b None admin] RBAC: Adding query filter params (interface=public, service_id=3927fab459c84ea09c62d9cbb281bd66, region_id=RegionOne) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:25.311108 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3661468-6236-430f-bb2d-7ae940f5c68b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:25.312243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3661468-6236-430f-bb2d-7ae940f5c68b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:25.317286 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:25.325365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 446/893] 10.222.0.64 () {56 vars in 1251 bytes} [Mon Jul 18 02:17:25 2022] GET /identity/v3/endpoints?service_id=3927fab459c84ea09c62d9cbb281bd66&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:25.326480 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3661468-6236-430f-bb2d-7ae940f5c68b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:25.370173 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:25.408660 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb133f2-0647-4990-9655-5a9ff77ebde6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:25.440758 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3661468-6236-430f-bb2d-7ae940f5c68b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:25.447233 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adda1afb-7fc2-4e4d-88eb-1a382b861883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:25.448033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda1afb-7fc2-4e4d-88eb-1a382b861883 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:25.448458 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda1afb-7fc2-4e4d-88eb-1a382b861883 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:25.448845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adda1afb-7fc2-4e4d-88eb-1a382b861883 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:25.449675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda1afb-7fc2-4e4d-88eb-1a382b861883 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:25.450124 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda1afb-7fc2-4e4d-88eb-1a382b861883 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:25.451611 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adda1afb-7fc2-4e4d-88eb-1a382b861883 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:25.456668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 448/894] 10.222.0.64 () {56 vars in 1122 bytes} [Mon Jul 18 02:17:25 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:25.502730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61381e85-625c-4680-b98c-9724897bacb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:25.503414 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61381e85-625c-4680-b98c-9724897bacb9 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:25.503692 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61381e85-625c-4680-b98c-9724897bacb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:25.503966 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61381e85-625c-4680-b98c-9724897bacb9 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:25.504657 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61381e85-625c-4680-b98c-9724897bacb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:25.506070 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61381e85-625c-4680-b98c-9724897bacb9 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:25.512986 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 447/895] 10.222.0.64 () {56 vars in 1087 bytes} [Mon Jul 18 02:17:25 2022] GET /identity/v3/services => generated 1268 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:17:25.906347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cb33e-663d-4e3a-8275-a1d0fc41fb53 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:25.906747 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cb33e-663d-4e3a-8275-a1d0fc41fb53 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:25.906952 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cb33e-663d-4e3a-8275-a1d0fc41fb53 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:25.908559 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 449/896] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:25.913791 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96b812-ccb7-424c-bd97-eae3a8f0bf43 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:25.914084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96b812-ccb7-424c-bd97-eae3a8f0bf43 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:25.914363 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96b812-ccb7-424c-bd97-eae3a8f0bf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:25.931889 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-4a96b812-ccb7-424c-bd97-eae3a8f0bf43 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:25.933077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4a96b812-ccb7-424c-bd97-eae3a8f0bf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:25.998214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:26.007504 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 448/897] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:25 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:26.030397 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cb33e-663d-4e3a-8275-a1d0fc41fb53 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:26.132796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cb33e-663d-4e3a-8275-a1d0fc41fb53 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:26.164297 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:26.169153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f0163-3dda-4010-994c-f28ddf5007da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:26.170011 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f0163-3dda-4010-994c-f28ddf5007da None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:26.170296 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f0163-3dda-4010-994c-f28ddf5007da None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:26.170573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91f0163-3dda-4010-994c-f28ddf5007da None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:26.183329 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91f0163-3dda-4010-994c-f28ddf5007da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:17:26.191905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-f91f0163-3dda-4010-994c-f28ddf5007da None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 02:17:26.191905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:26.191905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:26.191905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:26.191905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:26.191905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:26.191905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:26.191905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:26.191905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:26.191905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:26.191905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:26.191905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:26.191905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:17:26.191905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:17:26.191905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:17:26.191905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:17:26.192854 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:17:26.192854 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:17:26.192854 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:17:26.192854 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:17:26.192854 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:26.192854 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:26.192854 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:26.192854 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:26.192854 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:26.192854 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:26.192854 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:26.192854 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:26.192854 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:26.192854 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:26.192854 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:26.192854 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:26.193866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:26.193866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:26.193866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:26.193866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:26.193866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:17:26.193866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:17:26.193866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:17:26.193866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:17:26.193866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:17:26.193866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:17:26.193866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 02:17:26.193866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:26.193866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 450/898] 10.222.0.64 () {56 vars in 1120 bytes} [Mon Jul 18 02:17:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:26.199617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96b812-ccb7-424c-bd97-eae3a8f0bf43 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:26.303752 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96b812-ccb7-424c-bd97-eae3a8f0bf43 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:26.338946 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d5fe6-819b-4a8b-9c56-3a70d4150dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:26.339940 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d5fe6-819b-4a8b-9c56-3a70d4150dcc None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:26.340459 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d5fe6-819b-4a8b-9c56-3a70d4150dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:26.340941 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647d5fe6-819b-4a8b-9c56-3a70d4150dcc None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:26.341923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d5fe6-819b-4a8b-9c56-3a70d4150dcc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:26.342436 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d5fe6-819b-4a8b-9c56-3a70d4150dcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:26.343996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647d5fe6-819b-4a8b-9c56-3a70d4150dcc None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:26.353468 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 449/899] 10.222.0.64 () {56 vars in 1115 bytes} [Mon Jul 18 02:17:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:26.358881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f0163-3dda-4010-994c-f28ddf5007da None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:26.465645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91f0163-3dda-4010-994c-f28ddf5007da None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:26.500532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a029d0-bbb1-41ee-ad3c-8032b4d6f8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:26.501331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a029d0-bbb1-41ee-ad3c-8032b4d6f8ae None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:26.501611 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a029d0-bbb1-41ee-ad3c-8032b4d6f8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:26.501912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a029d0-bbb1-41ee-ad3c-8032b4d6f8ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:26.512733 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a029d0-bbb1-41ee-ad3c-8032b4d6f8ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:26.514269 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a029d0-bbb1-41ee-ad3c-8032b4d6f8ae None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:26.532771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-61a029d0-bbb1-41ee-ad3c-8032b4d6f8ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:26.532771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:26.532771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:26.532771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:26.532771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:26.532771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:26.532771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:26.532771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:26.532771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:26.532771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:26.532771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:26.532771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:26.532771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:26.532771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:26.532771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:26.533803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:26.533803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:26.533803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:26.533803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:26.533803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:26.533803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:26.533803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:26.533803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:26.533803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:26.533803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:26.533803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:26.533803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:26.533803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:26.533803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:26.533803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:26.533803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:26.533803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:26.534873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:26.534873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:26.534873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:26.534873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:26.534873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 451/900] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:26.539773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d5fe6-819b-4a8b-9c56-3a70d4150dcc None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:26.599322 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:26.649361 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647d5fe6-819b-4a8b-9c56-3a70d4150dcc None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:26.688580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9eae2-7b14-47a7-9a0a-3c6d1e625509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:26.689250 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9eae2-7b14-47a7-9a0a-3c6d1e625509 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:26.689533 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9eae2-7b14-47a7-9a0a-3c6d1e625509 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:26.689843 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9eae2-7b14-47a7-9a0a-3c6d1e625509 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:26.690565 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9eae2-7b14-47a7-9a0a-3c6d1e625509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:26.690872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9eae2-7b14-47a7-9a0a-3c6d1e625509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:26.692244 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9eae2-7b14-47a7-9a0a-3c6d1e625509 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:26.705600 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 450/901] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:26.711253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a029d0-bbb1-41ee-ad3c-8032b4d6f8ae None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:26.757833 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:26.814429 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a029d0-bbb1-41ee-ad3c-8032b4d6f8ae None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:26.848981 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fe6be-03a2-4302-938d-efcb10139418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:26.849831 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fe6be-03a2-4302-938d-efcb10139418 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:26.850117 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fe6be-03a2-4302-938d-efcb10139418 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:26.850395 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fe6be-03a2-4302-938d-efcb10139418 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:26.858114 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fe6be-03a2-4302-938d-efcb10139418 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:26.859585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fe6be-03a2-4302-938d-efcb10139418 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:26.878323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-0d0fe6be-03a2-4302-938d-efcb10139418 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 02:17:26.878323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:26.878323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:26.878323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:26.878323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:26.878323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:26.878323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:26.878323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:26.878323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:26.878323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:26.878323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:26.878323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:26.878323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:17:26.878323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:17:26.878323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:17:26.878323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:17:26.879283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:26.879283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:26.879283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:17:26.879283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:26.879283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:17:26.879283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:26.879283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:26.879283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:26.879283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:26.879283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:26.879283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:26.879283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:26.879283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:26.879283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:26.879283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:26.879283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:26.879283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:26.879283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:26.880859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:26.880859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:26.880859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:17:26.880859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:17:26.880859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:17:26.880859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:17:26.880859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:17:26.880859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:17:26.880859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 02:17:26.880859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:26.880859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 452/902] 10.222.0.64 () {56 vars in 1117 bytes} [Mon Jul 18 02:17:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:26.885768 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9eae2-7b14-47a7-9a0a-3c6d1e625509 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:26.976859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef2c4c-4144-47a4-b5e6-f6466f3bb905 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:26.977380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef2c4c-4144-47a4-b5e6-f6466f3bb905 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:26.977380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef2c4c-4144-47a4-b5e6-f6466f3bb905 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:26.979556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 453/903] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:17:26.984368 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef20936-e37a-4893-9077-32ac59d801df None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:26.984659 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef20936-e37a-4893-9077-32ac59d801df None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:26.984937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef20936-e37a-4893-9077-32ac59d801df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:26.988799 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9eae2-7b14-47a7-9a0a-3c6d1e625509 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:27.002828 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-bef20936-e37a-4893-9077-32ac59d801df None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:27.004309 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bef20936-e37a-4893-9077-32ac59d801df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:27.018145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:27.030323 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6c656-7b00-427c-a6e6-5124cd08e17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:27.033082 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6c656-7b00-427c-a6e6-5124cd08e17a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:27.033082 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6c656-7b00-427c-a6e6-5124cd08e17a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:27.033082 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba6c656-7b00-427c-a6e6-5124cd08e17a None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:27.033082 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6c656-7b00-427c-a6e6-5124cd08e17a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:27.033497 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6c656-7b00-427c-a6e6-5124cd08e17a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:27.035110 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba6c656-7b00-427c-a6e6-5124cd08e17a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:27.055036 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 451/904] 10.222.0.64 () {56 vars in 1149 bytes} [Mon Jul 18 02:17:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:27.060802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6c656-7b00-427c-a6e6-5124cd08e17a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:27.082012 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 454/905] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 02:17:27.100872 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef20936-e37a-4893-9077-32ac59d801df None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:27.136230 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:27.169782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba6c656-7b00-427c-a6e6-5124cd08e17a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:27.209131 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c599af-f33d-4345-b0dd-b09e63f4e9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:27.209792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef20936-e37a-4893-9077-32ac59d801df None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:27.210652 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c599af-f33d-4345-b0dd-b09e63f4e9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:27.211223 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c599af-f33d-4345-b0dd-b09e63f4e9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:27.211777 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c599af-f33d-4345-b0dd-b09e63f4e9f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:27.246036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72dd0f-dd8d-4896-a757-0aa7c40f5294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:27.247007 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72dd0f-dd8d-4896-a757-0aa7c40f5294 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:27.247120 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72dd0f-dd8d-4896-a757-0aa7c40f5294 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:27.247382 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72dd0f-dd8d-4896-a757-0aa7c40f5294 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:27.248109 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72dd0f-dd8d-4896-a757-0aa7c40f5294 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:27.249389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b72dd0f-dd8d-4896-a757-0aa7c40f5294 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:27.262010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-7b72dd0f-dd8d-4896-a757-0aa7c40f5294 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 02:17:27.262010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:27.262010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:17:27.262010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:17:27.262010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:17:27.262010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:17:27.262010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:17:27.262010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:27.262010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 02:17:27.262010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:27.262010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:27.262010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:27.262010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:27.262010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:27.262010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:27.262010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:27.263040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:27.263040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:27.263040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:27.263040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:27.263040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:27.263040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:27.263040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:27.263040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:17:27.263040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:17:27.263040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:17:27.263040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:17:27.263040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:27.263040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:27.263040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:27.263040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:27.263040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:27.263862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:27.263862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:27.263862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:27.263862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:27.263862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:27.263862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:27.263862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:27.263862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:27.263862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:27.263862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:27.263862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:27.263862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:17:27.263862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:27.263862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 02:17:27.263862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:27.268426 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:27.268632 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 455/906] 10.222.0.64 () {56 vars in 1132 bytes} [Mon Jul 18 02:17:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:27.269465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72dd0f-dd8d-4896-a757-0aa7c40f5294 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:27.292117 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c599af-f33d-4345-b0dd-b09e63f4e9f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:27.294096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c599af-f33d-4345-b0dd-b09e63f4e9f2 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:27.370633 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:27.374276 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b72dd0f-dd8d-4896-a757-0aa7c40f5294 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:27.405964 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 452/907] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:17:27 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 02:17:27.407369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c599af-f33d-4345-b0dd-b09e63f4e9f2 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:27.409634 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79385f7-e353-4b77-baef-3db0d9b88ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:27.410404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79385f7-e353-4b77-baef-3db0d9b88ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:27.410771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79385f7-e353-4b77-baef-3db0d9b88ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:27.411718 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79385f7-e353-4b77-baef-3db0d9b88ff6 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:27.411999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79385f7-e353-4b77-baef-3db0d9b88ff6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:27.412788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79385f7-e353-4b77-baef-3db0d9b88ff6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:27.414733 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79385f7-e353-4b77-baef-3db0d9b88ff6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:27.425510 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 456/908] 10.222.0.64 () {56 vars in 1126 bytes} [Mon Jul 18 02:17:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:27.426540 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79385f7-e353-4b77-baef-3db0d9b88ff6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:27.494669 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:27.517504 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c599af-f33d-4345-b0dd-b09e63f4e9f2 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:27.538667 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79385f7-e353-4b77-baef-3db0d9b88ff6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:27.556512 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8e1d0-dc9a-4a89-85bb-84dd09e112d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:27.557806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8e1d0-dc9a-4a89-85bb-84dd09e112d6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:27.558271 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8e1d0-dc9a-4a89-85bb-84dd09e112d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:27.558724 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8e1d0-dc9a-4a89-85bb-84dd09e112d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:27.570058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8e1d0-dc9a-4a89-85bb-84dd09e112d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:27.572436 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8e1d0-dc9a-4a89-85bb-84dd09e112d6 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:27.576661 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97961e7a-be53-4fba-aee0-dfe87140c02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:27.577421 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97961e7a-be53-4fba-aee0-dfe87140c02c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:27.577802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97961e7a-be53-4fba-aee0-dfe87140c02c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:27.578159 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97961e7a-be53-4fba-aee0-dfe87140c02c None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:27.578881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97961e7a-be53-4fba-aee0-dfe87140c02c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:27.579193 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97961e7a-be53-4fba-aee0-dfe87140c02c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:27.580567 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97961e7a-be53-4fba-aee0-dfe87140c02c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:27.585959 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 457/909] 10.222.0.64 () {56 vars in 1126 bytes} [Mon Jul 18 02:17:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:27.587198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687ba8c-e122-4ba3-872e-a190c0d0f9eb None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:27.587493 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687ba8c-e122-4ba3-872e-a190c0d0f9eb None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:27.587777 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687ba8c-e122-4ba3-872e-a190c0d0f9eb None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:27.589266 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 458/910] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:27.593241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-c0e8e1d0-dc9a-4a89-85bb-84dd09e112d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:27.593241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:27.593241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:27.593241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:27.593241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:27.593241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:27.593241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:27.593241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:27.593241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:27.593241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:27.593241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:27.593241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:27.593241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:27.593241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:27.593241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:27.594257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:27.594257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:27.594257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:27.594257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:27.594257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:27.594257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:27.594257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:27.594257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:27.594257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:27.594257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:27.594257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:27.594257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:27.594257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:27.594257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:27.594257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:27.594257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:27.594257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:27.595151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:27.595151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:27.595151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:27.595151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:27.596265 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687ba8c-e122-4ba3-872e-a190c0d0f9eb None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:27.598002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 453/911] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:27.599832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aaebbb-f905-4b5b-9806-e220e7d5afaf None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:27.600131 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aaebbb-f905-4b5b-9806-e220e7d5afaf None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:27.600410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aaebbb-f905-4b5b-9806-e220e7d5afaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:27.622139 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-35aaebbb-f905-4b5b-9806-e220e7d5afaf None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:27.623343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-35aaebbb-f905-4b5b-9806-e220e7d5afaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:27.627533 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:27.702087 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687ba8c-e122-4ba3-872e-a190c0d0f9eb None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:27.716812 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 454/912] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:27.718053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aaebbb-f905-4b5b-9806-e220e7d5afaf None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:27.737263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d63cb17-7a92-4427-8bc8-35cd57edb5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:27.737965 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63cb17-7a92-4427-8bc8-35cd57edb5ac None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:27.738247 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63cb17-7a92-4427-8bc8-35cd57edb5ac None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:27.738524 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d63cb17-7a92-4427-8bc8-35cd57edb5ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:27.739345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63cb17-7a92-4427-8bc8-35cd57edb5ac None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:27.740712 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d63cb17-7a92-4427-8bc8-35cd57edb5ac None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:27.788254 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:27.832804 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aaebbb-f905-4b5b-9806-e220e7d5afaf None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:27.840120 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 459/913] 10.222.0.64 () {60 vars in 1144 bytes} [Mon Jul 18 02:17:27 2022] POST /identity/v3/endpoints => generated 347 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:17:27.841423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83743a89-4d34-45c6-8a07-ea3b92c67031 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:27.841731 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83743a89-4d34-45c6-8a07-ea3b92c67031 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:27.842020 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83743a89-4d34-45c6-8a07-ea3b92c67031 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:27.845751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 460/914] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:27.845751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83743a89-4d34-45c6-8a07-ea3b92c67031 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:27.887780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a2b32-5932-4c7d-98c5-cdd40937c131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:27.888469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a2b32-5932-4c7d-98c5-cdd40937c131 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:27.888752 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a2b32-5932-4c7d-98c5-cdd40937c131 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:27.889030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a2b32-5932-4c7d-98c5-cdd40937c131 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:27.889823 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a2b32-5932-4c7d-98c5-cdd40937c131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:27.890138 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a2b32-5932-4c7d-98c5-cdd40937c131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:27.891588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a2b32-5932-4c7d-98c5-cdd40937c131 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:27.921970 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 455/915] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:27.921970 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d14b46-286a-414a-8a02-60812cd4d48d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:27.921970 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d14b46-286a-414a-8a02-60812cd4d48d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:27.921970 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d14b46-286a-414a-8a02-60812cd4d48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:27.945461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-60d14b46-286a-414a-8a02-60812cd4d48d None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:27.947275 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-60d14b46-286a-414a-8a02-60812cd4d48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:27.976009 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:27.998559 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83743a89-4d34-45c6-8a07-ea3b92c67031 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:28.037766 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 456/916] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:28.038463 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d14b46-286a-414a-8a02-60812cd4d48d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:28.039678 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da0fe0-187c-4360-b3b7-81f1716a2ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:28.041104 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da0fe0-187c-4360-b3b7-81f1716a2ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:28.041389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da0fe0-187c-4360-b3b7-81f1716a2ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:28.041663 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da0fe0-187c-4360-b3b7-81f1716a2ce5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:28.042350 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da0fe0-187c-4360-b3b7-81f1716a2ce5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:28.043731 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da0fe0-187c-4360-b3b7-81f1716a2ce5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:28.058743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-c4da0fe0-187c-4360-b3b7-81f1716a2ce5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 02:17:28.058743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:28.058743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:17:28.058743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:17:28.058743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:17:28.058743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:17:28.058743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:17:28.058743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:28.058743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 02:17:28.058743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:28.058743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:28.058743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:28.058743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:28.058743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:28.058743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:28.058743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:28.058743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:28.059799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:28.059799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:28.059799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:28.059799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:28.059799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:28.059799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:28.059799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:17:28.059799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:17:28.059799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:17:28.059799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:17:28.059799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:28.059799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:28.059799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:28.059799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:28.059799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:28.059799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:28.060638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:28.060638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:28.060638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:28.060638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:28.060638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:28.060638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:28.060638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:28.060638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:28.060638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:28.060638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:28.060638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:17:28.060638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:28.060638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 02:17:28.060638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:28.060638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 461/917] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jul 18 02:17:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:28.062825 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da0fe0-187c-4360-b3b7-81f1716a2ce5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:28.094000 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:28.171449 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d14b46-286a-414a-8a02-60812cd4d48d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:28.196068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da0fe0-187c-4360-b3b7-81f1716a2ce5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:28.224448 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec428a-d3f5-42f5-9e6b-a6458edf4bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:28.225892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec428a-d3f5-42f5-9e6b-a6458edf4bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:28.226415 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec428a-d3f5-42f5-9e6b-a6458edf4bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:28.226930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec428a-d3f5-42f5-9e6b-a6458edf4bc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:28.235147 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec428a-d3f5-42f5-9e6b-a6458edf4bc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:28.237658 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec428a-d3f5-42f5-9e6b-a6458edf4bc8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:28.241548 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98242d-391c-43eb-98f9-40823c848e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:28.242742 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98242d-391c-43eb-98f9-40823c848e2a None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:28.243212 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98242d-391c-43eb-98f9-40823c848e2a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:28.243666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98242d-391c-43eb-98f9-40823c848e2a None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:28.244562 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98242d-391c-43eb-98f9-40823c848e2a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:28.246102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98242d-391c-43eb-98f9-40823c848e2a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:28.262901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-a8ec428a-d3f5-42f5-9e6b-a6458edf4bc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:28.262901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:28.262901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:28.262901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:28.262901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:28.262901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:28.262901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:28.262901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:28.262901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:28.262901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:28.262901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:28.262901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:28.262901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:17:28.262901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:17:28.262901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:17:28.264387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:17:28.264387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:28.264387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:28.264387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:28.264387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:28.264387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:28.264387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:28.264387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:28.264387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:28.264387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:28.264387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:28.264387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:28.264387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:28.264387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:28.264387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:28.264387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:28.264387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:28.265511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:17:28.265511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:17:28.265511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:17:28.265511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:17:28.265511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:17:28.265511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:17:28.265511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:28.265511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:28.266137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 457/918] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:28.269751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec428a-d3f5-42f5-9e6b-a6458edf4bc8 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:28.317824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 462/919] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jul 18 02:17:28 2022] POST /identity/v3/services => generated 241 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:17:28.319163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98242d-391c-43eb-98f9-40823c848e2a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:28.336566 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:28.407900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec428a-d3f5-42f5-9e6b-a6458edf4bc8 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:28.410004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:28.455138 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c0a95-bbd9-4802-98f6-45ebaf065f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:28.455817 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c0a95-bbd9-4802-98f6-45ebaf065f08 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:28.456100 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c0a95-bbd9-4802-98f6-45ebaf065f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:28.456372 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c0a95-bbd9-4802-98f6-45ebaf065f08 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:28.457082 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c0a95-bbd9-4802-98f6-45ebaf065f08 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:28.457394 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c0a95-bbd9-4802-98f6-45ebaf065f08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:28.458938 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c0a95-bbd9-4802-98f6-45ebaf065f08 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:28.465131 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 458/920] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jul 18 02:17:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:28.471165 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c0a95-bbd9-4802-98f6-45ebaf065f08 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:28.475325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98242d-391c-43eb-98f9-40823c848e2a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:28.518388 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd25da5-1310-46cf-badd-f04e64abeb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:28.519251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd25da5-1310-46cf-badd-f04e64abeb29 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:28.519638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd25da5-1310-46cf-badd-f04e64abeb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:28.520407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd25da5-1310-46cf-badd-f04e64abeb29 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:28.521012 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd25da5-1310-46cf-badd-f04e64abeb29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:28.521429 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd25da5-1310-46cf-badd-f04e64abeb29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:28.523111 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd25da5-1310-46cf-badd-f04e64abeb29 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:28.537521 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 463/921] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:17:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:28.543522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd25da5-1310-46cf-badd-f04e64abeb29 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:28.588239 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c0a95-bbd9-4802-98f6-45ebaf065f08 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:28.619183 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:28.625928 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b60c5a-08fe-45d4-86e7-eca658fdead0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:28.632181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b60c5a-08fe-45d4-86e7-eca658fdead0 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:28.632181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b60c5a-08fe-45d4-86e7-eca658fdead0 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:28.632181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b60c5a-08fe-45d4-86e7-eca658fdead0 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:28.632181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b60c5a-08fe-45d4-86e7-eca658fdead0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:28.632181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b60c5a-08fe-45d4-86e7-eca658fdead0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:28.632181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b60c5a-08fe-45d4-86e7-eca658fdead0 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:28.636399 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 459/922] 10.222.0.64 () {56 vars in 1114 bytes} [Mon Jul 18 02:17:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:28.643486 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b60c5a-08fe-45d4-86e7-eca658fdead0 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:28.657804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd25da5-1310-46cf-badd-f04e64abeb29 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:28.670970 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:28.702090 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a030422-82ea-4986-84e5-5cf1f04aea93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:28.703241 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a030422-82ea-4986-84e5-5cf1f04aea93 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:28.703748 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a030422-82ea-4986-84e5-5cf1f04aea93 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:28.704249 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a030422-82ea-4986-84e5-5cf1f04aea93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:28.705940 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a030422-82ea-4986-84e5-5cf1f04aea93 None admin] RBAC: Adding query filter params (role.id=77405dcb2b214a28a22b24a17ed1f66e, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=01113a3f8cbf46b09fb5fcf4315a219b) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:28.706514 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a030422-82ea-4986-84e5-5cf1f04aea93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:28.709216 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a030422-82ea-4986-84e5-5cf1f04aea93 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:28.717373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 464/923] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:17:28 2022] GET /identity/v3/role_assignments?user.id=01113a3f8cbf46b09fb5fcf4315a219b&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=77405dcb2b214a28a22b24a17ed1f66e => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:28.761666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b60c5a-08fe-45d4-86e7-eca658fdead0 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:28.800296 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9049940-d24f-4094-969c-0fc50afe2d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:28.800978 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9049940-d24f-4094-969c-0fc50afe2d03 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:28.801260 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9049940-d24f-4094-969c-0fc50afe2d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:28.801531 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9049940-d24f-4094-969c-0fc50afe2d03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:28.802318 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9049940-d24f-4094-969c-0fc50afe2d03 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:28.803715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9049940-d24f-4094-969c-0fc50afe2d03 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:28.912277 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 460/924] 10.222.0.64 () {60 vars in 1144 bytes} [Mon Jul 18 02:17:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:17:30.151033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b43470-e1d5-4af3-a601-2f38fab1c83b None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:30.151511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b43470-e1d5-4af3-a601-2f38fab1c83b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:30.151618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b43470-e1d5-4af3-a601-2f38fab1c83b None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:30.153201 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 465/925] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:30.158698 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63364ed6-397f-4884-b5d3-743167f7d0a1 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:30.159144 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63364ed6-397f-4884-b5d3-743167f7d0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:30.159271 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63364ed6-397f-4884-b5d3-743167f7d0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:30.177506 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-63364ed6-397f-4884-b5d3-743167f7d0a1 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:30.178759 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-63364ed6-397f-4884-b5d3-743167f7d0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:30.259097 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 461/926] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 02:17:30.280865 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b43470-e1d5-4af3-a601-2f38fab1c83b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:30.395168 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b43470-e1d5-4af3-a601-2f38fab1c83b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:30.428553 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:30.435155 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d335246-5d00-4a1a-9c81-a13437b68919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:30.435957 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d335246-5d00-4a1a-9c81-a13437b68919 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:30.436243 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d335246-5d00-4a1a-9c81-a13437b68919 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:30.436521 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d335246-5d00-4a1a-9c81-a13437b68919 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:30.437171 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d335246-5d00-4a1a-9c81-a13437b68919 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:30.438571 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d335246-5d00-4a1a-9c81-a13437b68919 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:30.451032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-2d335246-5d00-4a1a-9c81-a13437b68919 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 02:17:30.451032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:30.451032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:17:30.451032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:17:30.451032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:17:30.451032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:17:30.451032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:17:30.451032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:30.451032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 02:17:30.451032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:30.451032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:30.451032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:30.451032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:30.451032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:30.451032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:30.451032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:30.451032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:30.452138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:30.452138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:30.452138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:30.452138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:30.452138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:30.452138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:30.452138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:17:30.452138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:17:30.452138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:17:30.452138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:17:30.452138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:30.452138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:30.452138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:30.452138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:30.452138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:30.452138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:30.453045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:30.453045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:30.453045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:30.453045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:30.453045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:30.453045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:30.453045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:30.453045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:30.453045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:30.453045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:30.453045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:17:30.453045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:30.453045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 02:17:30.453045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:30.453045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 466/927] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:30.458186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63364ed6-397f-4884-b5d3-743167f7d0a1 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:30.470054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:30.561898 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63364ed6-397f-4884-b5d3-743167f7d0a1 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:30.569768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa7c3b-adae-4a8e-acad-ea4e7ee4acc2 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:30.570069 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa7c3b-adae-4a8e-acad-ea4e7ee4acc2 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:30.570353 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa7c3b-adae-4a8e-acad-ea4e7ee4acc2 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:30.576231 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 467/928] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:17:30.577717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59514f6f-df01-42f1-a371-e46509d1a05a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:30.578013 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59514f6f-df01-42f1-a371-e46509d1a05a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:30.578290 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59514f6f-df01-42f1-a371-e46509d1a05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:30.596011 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-59514f6f-df01-42f1-a371-e46509d1a05a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:30.597198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-59514f6f-df01-42f1-a371-e46509d1a05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:30.598632 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626b752-f7da-4b89-b119-0e9428d3e698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:30.599488 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626b752-f7da-4b89-b119-0e9428d3e698 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:30.599920 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626b752-f7da-4b89-b119-0e9428d3e698 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:30.600335 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626b752-f7da-4b89-b119-0e9428d3e698 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:30.601186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626b752-f7da-4b89-b119-0e9428d3e698 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:30.601650 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626b752-f7da-4b89-b119-0e9428d3e698 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:30.603742 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626b752-f7da-4b89-b119-0e9428d3e698 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:30.609174 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 462/929] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jul 18 02:17:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:30.617065 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626b752-f7da-4b89-b119-0e9428d3e698 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:30.685914 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 468/930] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 02:17:30.692423 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:30.700947 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59514f6f-df01-42f1-a371-e46509d1a05a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:30.733728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626b752-f7da-4b89-b119-0e9428d3e698 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:30.766747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720a865-6534-4e35-923b-cf7de3c16aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:30.767497 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720a865-6534-4e35-923b-cf7de3c16aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:30.767781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720a865-6534-4e35-923b-cf7de3c16aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:30.768057 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f720a865-6534-4e35-923b-cf7de3c16aa2 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:30.768761 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720a865-6534-4e35-923b-cf7de3c16aa2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:30.769067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720a865-6534-4e35-923b-cf7de3c16aa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:30.770492 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f720a865-6534-4e35-923b-cf7de3c16aa2 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:30.775723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 463/931] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jul 18 02:17:30 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:30.811864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59514f6f-df01-42f1-a371-e46509d1a05a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:30.840475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:30.852016 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f0d7f-f73c-48f1-b316-73d4630d0d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:30.853398 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f0d7f-f73c-48f1-b316-73d4630d0d90 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:30.853681 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f0d7f-f73c-48f1-b316-73d4630d0d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:30.853988 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f0d7f-f73c-48f1-b316-73d4630d0d90 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:30.854657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f0d7f-f73c-48f1-b316-73d4630d0d90 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:30.856057 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f0d7f-f73c-48f1-b316-73d4630d0d90 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:30.869383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-d16f0d7f-f73c-48f1-b316-73d4630d0d90 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 02:17:30.869383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:30.869383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:17:30.869383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:17:30.869383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:17:30.869383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:17:30.869383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:17:30.869383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:30.869383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 02:17:30.869383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:30.869383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:30.869383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:30.869383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:30.869383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:30.869383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:30.869383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:30.869383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:30.871486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:30.871486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:30.871486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:30.871486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:30.871486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:30.871486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:30.871486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:17:30.871486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:17:30.871486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:17:30.871486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:17:30.871486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:30.871486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:30.871486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:30.871486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:30.871486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:30.871486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:30.872347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:30.872347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:30.872347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:30.872347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:30.872347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:30.872347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:30.872347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:30.872347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:30.872347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:30.872347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:30.872347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:17:30.872347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:30.872347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 02:17:30.872347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:30.875699 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 469/932] 10.222.0.64 () {56 vars in 1126 bytes} [Mon Jul 18 02:17:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:30.878579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720a865-6534-4e35-923b-cf7de3c16aa2 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:30.992110 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f720a865-6534-4e35-923b-cf7de3c16aa2 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:31.029779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e74bbd-ac54-4d27-ba77-d1c84cefa3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:31.035040 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e74bbd-ac54-4d27-ba77-d1c84cefa3b3 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:31.035040 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e74bbd-ac54-4d27-ba77-d1c84cefa3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:31.035040 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e74bbd-ac54-4d27-ba77-d1c84cefa3b3 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:31.035040 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e74bbd-ac54-4d27-ba77-d1c84cefa3b3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:31.035040 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e74bbd-ac54-4d27-ba77-d1c84cefa3b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:31.035040 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e74bbd-ac54-4d27-ba77-d1c84cefa3b3 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:31.036300 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:31.044976 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 464/933] 10.222.0.64 () {56 vars in 1122 bytes} [Mon Jul 18 02:17:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:31.046500 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f0d7f-f73c-48f1-b316-73d4630d0d90 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:31.126820 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065227b-2e6a-43f8-a0ef-df1029f556da None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:31.127165 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065227b-2e6a-43f8-a0ef-df1029f556da None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:31.127376 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065227b-2e6a-43f8-a0ef-df1029f556da None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:31.129660 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 465/934] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:17:31.139374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3428a-1d74-44d9-98f3-65bc13a3765a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:31.139682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3428a-1d74-44d9-98f3-65bc13a3765a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:31.139946 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab3428a-1d74-44d9-98f3-65bc13a3765a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:31.160439 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f0d7f-f73c-48f1-b316-73d4630d0d90 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:31.165230 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-cab3428a-1d74-44d9-98f3-65bc13a3765a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:31.166531 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cab3428a-1d74-44d9-98f3-65bc13a3765a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:31.198933 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed352d12-9094-48c5-af80-0d62c41b4e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:31.199951 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed352d12-9094-48c5-af80-0d62c41b4e34 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:31.200396 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed352d12-9094-48c5-af80-0d62c41b4e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:31.200825 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed352d12-9094-48c5-af80-0d62c41b4e34 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:31.201679 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed352d12-9094-48c5-af80-0d62c41b4e34 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:31.202245 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed352d12-9094-48c5-af80-0d62c41b4e34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:31.203976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed352d12-9094-48c5-af80-0d62c41b4e34 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:31.212810 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 470/935] 10.222.0.64 () {56 vars in 1122 bytes} [Mon Jul 18 02:17:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:31.218955 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed352d12-9094-48c5-af80-0d62c41b4e34 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:31.257540 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 466/936] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 02:17:31.257540 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb7f12-6eff-4a84-9895-6d15c7414300 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:31.257540 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb7f12-6eff-4a84-9895-6d15c7414300 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:31.257540 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb7f12-6eff-4a84-9895-6d15c7414300 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:31.257540 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 467/937] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:31.262225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a18fc7-5df3-48c5-9e1c-989d4b05ac65 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:31.262516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a18fc7-5df3-48c5-9e1c-989d4b05ac65 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:31.262800 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a18fc7-5df3-48c5-9e1c-989d4b05ac65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:31.279892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-96a18fc7-5df3-48c5-9e1c-989d4b05ac65 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:31.281092 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-96a18fc7-5df3-48c5-9e1c-989d4b05ac65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:31.281900 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:31.334190 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed352d12-9094-48c5-af80-0d62c41b4e34 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:31.361758 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 468/938] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:31 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 02:17:31.361758 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a18fc7-5df3-48c5-9e1c-989d4b05ac65 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:31.381482 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e13ca5-d4d5-47c3-8d71-d6a3fb6419a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:31.382453 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e13ca5-d4d5-47c3-8d71-d6a3fb6419a5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:31.382886 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e13ca5-d4d5-47c3-8d71-d6a3fb6419a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:31.383357 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e13ca5-d4d5-47c3-8d71-d6a3fb6419a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:31.384318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e13ca5-d4d5-47c3-8d71-d6a3fb6419a5 None admin] RBAC: Adding query filter params (interface=public, service_id=2e28d94df7434b5788fe1c86f8032342, region_id=RegionOne) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:31.384634 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e13ca5-d4d5-47c3-8d71-d6a3fb6419a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:31.386031 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e13ca5-d4d5-47c3-8d71-d6a3fb6419a5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:31.392292 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 471/939] 10.222.0.64 () {56 vars in 1251 bytes} [Mon Jul 18 02:17:31 2022] GET /identity/v3/endpoints?service_id=2e28d94df7434b5788fe1c86f8032342&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:31.392446 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e13ca5-d4d5-47c3-8d71-d6a3fb6419a5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:31.431183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:31.476524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a18fc7-5df3-48c5-9e1c-989d4b05ac65 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:31.495551 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e13ca5-d4d5-47c3-8d71-d6a3fb6419a5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:31.511757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:31.515307 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893306da-fa85-4293-9001-a3beeb7d8d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:31.516045 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893306da-fa85-4293-9001-a3beeb7d8d53 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:31.516332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893306da-fa85-4293-9001-a3beeb7d8d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:31.516607 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893306da-fa85-4293-9001-a3beeb7d8d53 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:31.517475 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893306da-fa85-4293-9001-a3beeb7d8d53 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:31.519168 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893306da-fa85-4293-9001-a3beeb7d8d53 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:31.520308 dv-cinder-850015-3-smb devstack@keystone.service[80357]: WARNING keystone.server.flask.common [None req-893306da-fa85-4293-9001-a3beeb7d8d53 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 18 02:17:31.529282 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40e7d9-a064-49a5-9a99-749834959fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:31.531722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40e7d9-a064-49a5-9a99-749834959fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:31.531722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40e7d9-a064-49a5-9a99-749834959fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:31.531722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40e7d9-a064-49a5-9a99-749834959fa7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:31.542291 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40e7d9-a064-49a5-9a99-749834959fa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:17:31.550643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-5b40e7d9-a064-49a5-9a99-749834959fa7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 02:17:31.550643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:31.550643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:31.550643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:31.550643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:31.550643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:31.550643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:31.550643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:31.550643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:31.550643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:31.550643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:31.550643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:31.550643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:17:31.550643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:17:31.550643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:17:31.550643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:17:31.551603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:17:31.551603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:17:31.551603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:17:31.551603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:17:31.551603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:31.551603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:31.551603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:31.551603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:31.551603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:31.551603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:31.551603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:31.551603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:31.551603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:31.551603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:31.551603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:31.551603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:31.552437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:31.552437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:31.552437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:31.552437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:31.552437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:17:31.552437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:17:31.552437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:17:31.552437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:17:31.552437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:17:31.552437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:17:31.552437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 02:17:31.552437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:31.552437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 472/940] 10.222.0.64 () {56 vars in 1120 bytes} [Mon Jul 18 02:17:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:31.553152 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40e7d9-a064-49a5-9a99-749834959fa7 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:31.595714 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.sql.core [None req-893306da-fa85-4293-9001-a3beeb7d8d53 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 02:17:31.595714 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 18 02:17:31.595714 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [parameters: {'id': '60bf001564e04d5ca8ee8d184a99cd3e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 18 02:17:31.595714 dv-cinder-850015-3-smb devstack@keystone.service[80357]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80357) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 02:17:31.612542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-893306da-fa85-4293-9001-a3beeb7d8d53 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 60bf001564e04d5ca8ee8d184a99cd3e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 60bf001564e04d5ca8ee8d184a99cd3e. Jul 18 02:17:31.612542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:31.612542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 02:17:31.612542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 02:17:31.612542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 02:17:31.612542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 02:17:31.612542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 02:17:31.612542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 02:17:31.612542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 02:17:31.612542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application conn.query(q) Jul 18 02:17:31.612542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 02:17:31.612542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 02:17:31.612542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 02:17:31.613440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application result.read() Jul 18 02:17:31.613440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 02:17:31.613440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 02:17:31.613440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 02:17:31.613440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 02:17:31.613440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 02:17:31.613440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 02:17:31.613440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 02:17:31.613440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 02:17:31.613440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 02:17:31.613440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:31.613440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 02:17:31.613440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:31.613440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:31.613440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 02:17:31.613440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 02:17:31.613440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 18 02:17:31.613440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 18 02:17:31.614721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 02:17:31.614721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application next(self.gen) Jul 18 02:17:31.614721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 02:17:31.614721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application yield resource Jul 18 02:17:31.614721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 02:17:31.614721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application next(self.gen) Jul 18 02:17:31.614721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 02:17:31.614721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 02:17:31.614721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:17:31.614721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 02:17:31.614721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:17:31.614721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise self.value Jul 18 02:17:31.614721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 02:17:31.614721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 02:17:31.614721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 02:17:31.614721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application session.commit() Jul 18 02:17:31.614721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 02:17:31.615606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 02:17:31.615606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 02:17:31.615606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 02:17:31.615606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 02:17:31.615606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self.session.flush() Jul 18 02:17:31.615606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 02:17:31.615606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 02:17:31.615606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 02:17:31.615606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 02:17:31.615606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 02:17:31.615606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application compat.raise_( Jul 18 02:17:31.615606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 02:17:31.615606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception Jul 18 02:17:31.615606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 02:17:31.615606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 02:17:31.615606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 02:17:31.615606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 02:17:31.616602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 02:17:31.616602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 02:17:31.616602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 02:17:31.616602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 02:17:31.616602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 18 02:17:31.616602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 18 02:17:31.616602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 02:17:31.616602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 02:17:31.616602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 02:17:31.616602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 02:17:31.616602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 02:17:31.616602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 02:17:31.616602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 02:17:31.616602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 02:17:31.616602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 02:17:31.617890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 02:17:31.617890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 02:17:31.617890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception Jul 18 02:17:31.617890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 02:17:31.617890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 02:17:31.617890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 02:17:31.617890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 02:17:31.617890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 02:17:31.617890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 02:17:31.617890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 02:17:31.617890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application conn.query(q) Jul 18 02:17:31.617890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 02:17:31.617890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 02:17:31.617890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 02:17:31.617890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application result.read() Jul 18 02:17:31.617890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 02:17:31.617890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 02:17:31.619786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 02:17:31.619786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 02:17:31.619786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 02:17:31.619786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 02:17:31.619786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 02:17:31.619786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 02:17:31.619786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 02:17:31.619786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 18 02:17:31.619786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [parameters: {'id': '60bf001564e04d5ca8ee8d184a99cd3e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 18 02:17:31.619786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 02:17:31.619786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:31.619786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:31.619786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:31.619786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:31.619786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 18 02:17:31.620747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 18 02:17:31.620747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 02:17:31.620747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 02:17:31.620747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 18 02:17:31.620747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:31.620747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:31.620747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:31.620747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:31.620747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:31.620747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:31.620747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:31.620747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:31.620747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:31.620747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:31.620747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:31.620747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:31.620747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:31.621855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:31.621855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 18 02:17:31.621855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 18 02:17:31.621855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:31.621855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:31.621855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 18 02:17:31.621855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 18 02:17:31.621855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 60bf001564e04d5ca8ee8d184a99cd3e. Jul 18 02:17:31.621855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:31.621855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 469/941] 10.222.0.64 () {60 vars in 1140 bytes} [Mon Jul 18 02:17:31 2022] POST /identity/v3/projects => generated 262 bytes in 256 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:31.621855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893306da-fa85-4293-9001-a3beeb7d8d53 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:31.692392 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40e7d9-a064-49a5-9a99-749834959fa7 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:31.739305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c7f28-adad-4873-9fda-dd8687ce006b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:31.740752 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c7f28-adad-4873-9fda-dd8687ce006b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:31.741215 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c7f28-adad-4873-9fda-dd8687ce006b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:31.741650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c7f28-adad-4873-9fda-dd8687ce006b None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:31.742528 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c7f28-adad-4873-9fda-dd8687ce006b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:31.743178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893306da-fa85-4293-9001-a3beeb7d8d53 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:31.744845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c7f28-adad-4873-9fda-dd8687ce006b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:31.758098 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 473/942] 10.222.0.64 () {56 vars in 1087 bytes} [Mon Jul 18 02:17:31 2022] GET /identity/v3/services => generated 1497 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:17:31.759833 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c7f28-adad-4873-9fda-dd8687ce006b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:31.765816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:31.789728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b28fc-859b-45d3-ad65-af4da3ba6aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:31.789728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b28fc-859b-45d3-ad65-af4da3ba6aeb None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:31.789728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b28fc-859b-45d3-ad65-af4da3ba6aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:31.789728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b28fc-859b-45d3-ad65-af4da3ba6aeb None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:31.790239 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b28fc-859b-45d3-ad65-af4da3ba6aeb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:31.793731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b28fc-859b-45d3-ad65-af4da3ba6aeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:31.793731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b28fc-859b-45d3-ad65-af4da3ba6aeb None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:31.812658 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 470/943] 10.222.0.64 () {56 vars in 1115 bytes} [Mon Jul 18 02:17:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:31.822198 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b28fc-859b-45d3-ad65-af4da3ba6aeb None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:31.860338 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:31.953428 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c7f28-adad-4873-9fda-dd8687ce006b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:31.999373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27900b-379a-4285-ab02-b161d70fec24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:32.000321 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27900b-379a-4285-ab02-b161d70fec24 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:32.003336 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27900b-379a-4285-ab02-b161d70fec24 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:32.003336 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b27900b-379a-4285-ab02-b161d70fec24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:32.013865 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27900b-379a-4285-ab02-b161d70fec24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:32.015692 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b27900b-379a-4285-ab02-b161d70fec24 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:32.022077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b28fc-859b-45d3-ad65-af4da3ba6aeb None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:32.032250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-1b27900b-379a-4285-ab02-b161d70fec24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:32.032250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:32.032250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:32.032250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:32.032250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:32.032250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:32.032250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:32.032250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:32.032250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:32.032250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:32.032250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:32.032250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:32.032250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:17:32.032250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:17:32.032250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:17:32.038189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:17:32.038189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:32.038189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:32.038189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:32.038189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:32.038189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:32.038189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:32.038189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:32.038189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:32.038189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:32.038189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:32.038189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:32.038189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:32.038189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:32.038189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:32.038189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:32.038189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:32.039092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:17:32.039092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:17:32.039092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:17:32.039092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:17:32.039092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:17:32.039092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:17:32.039092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:32.039092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:32.039092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 474/944] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:32.043024 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27900b-379a-4285-ab02-b161d70fec24 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:32.078340 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfd7b8-c828-4f05-b70d-1c2e6c3a6df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:32.079418 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfd7b8-c828-4f05-b70d-1c2e6c3a6df2 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:32.079704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfd7b8-c828-4f05-b70d-1c2e6c3a6df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:32.079978 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dfd7b8-c828-4f05-b70d-1c2e6c3a6df2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:32.094254 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfd7b8-c828-4f05-b70d-1c2e6c3a6df2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:32.095735 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dfd7b8-c828-4f05-b70d-1c2e6c3a6df2 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:32.116991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-92dfd7b8-c828-4f05-b70d-1c2e6c3a6df2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:32.116991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:32.116991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:32.116991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:32.116991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:32.116991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:32.116991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:32.116991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:32.116991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:32.116991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:32.116991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:32.116991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:32.116991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:32.116991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:32.116991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:32.118183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:32.118183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:32.118183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:32.118183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:32.118183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:32.118183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:32.118183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:32.118183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:32.118183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:32.118183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:32.118183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:32.118183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:32.118183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:32.118183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:32.118183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:32.118183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:32.118183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:32.119337 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:32.119337 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:32.119337 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:32.119337 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:32.119337 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 471/945] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:32.124099 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfd7b8-c828-4f05-b70d-1c2e6c3a6df2 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:32.169315 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:32.183193 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:32.186683 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b27900b-379a-4285-ab02-b161d70fec24 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:32.225648 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d2d34-a537-440c-8d64-789830316671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:32.226713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d2d34-a537-440c-8d64-789830316671 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:32.227235 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d2d34-a537-440c-8d64-789830316671 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:32.227719 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d2d34-a537-440c-8d64-789830316671 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:32.228786 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d2d34-a537-440c-8d64-789830316671 None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:32.229306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d2d34-a537-440c-8d64-789830316671 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:32.231062 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d2d34-a537-440c-8d64-789830316671 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:32.256973 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dfd7b8-c828-4f05-b70d-1c2e6c3a6df2 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:32.257406 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 475/946] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jul 18 02:17:32 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:32.296951 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7439e-bb86-4e37-8fdc-3d329cf4f8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:32.297560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7439e-bb86-4e37-8fdc-3d329cf4f8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:32.297887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7439e-bb86-4e37-8fdc-3d329cf4f8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:32.298152 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7439e-bb86-4e37-8fdc-3d329cf4f8d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:32.299150 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7439e-bb86-4e37-8fdc-3d329cf4f8d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:32.299458 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7439e-bb86-4e37-8fdc-3d329cf4f8d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:32.300841 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7439e-bb86-4e37-8fdc-3d329cf4f8d0 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:32.314524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 472/947] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:32.320329 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d2d34-a537-440c-8d64-789830316671 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:32.441301 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d2d34-a537-440c-8d64-789830316671 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:32.477200 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287cc38-a44a-4da0-b875-9fab296e3ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:32.478379 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287cc38-a44a-4da0-b875-9fab296e3ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:32.478850 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287cc38-a44a-4da0-b875-9fab296e3ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:32.479306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287cc38-a44a-4da0-b875-9fab296e3ec3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:32.487699 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287cc38-a44a-4da0-b875-9fab296e3ec3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:32.489412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287cc38-a44a-4da0-b875-9fab296e3ec3 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:32.505377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-5287cc38-a44a-4da0-b875-9fab296e3ec3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 02:17:32.505377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:32.505377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:32.505377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:32.505377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:32.505377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:32.505377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:32.505377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:32.505377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:32.505377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:32.505377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:32.505377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:32.505377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:17:32.505377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:17:32.505377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:17:32.505377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:17:32.506375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:32.506375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:32.506375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:17:32.506375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:32.506375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:17:32.506375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:32.506375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:32.506375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:32.506375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:32.506375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:32.506375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:32.506375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:32.506375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:32.506375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:32.506375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:32.506375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:32.506375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:32.506375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:32.507342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:32.507342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:32.507342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:17:32.507342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:17:32.507342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:17:32.507342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:17:32.507342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:17:32.507342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:17:32.507342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 02:17:32.507342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:32.510204 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 476/948] 10.222.0.64 () {56 vars in 1117 bytes} [Mon Jul 18 02:17:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:32.515974 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7439e-bb86-4e37-8fdc-3d329cf4f8d0 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:32.615659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:32.626235 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7439e-bb86-4e37-8fdc-3d329cf4f8d0 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:32.661061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55014469-efb7-4908-a9c4-19285b36e0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:32.661766 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55014469-efb7-4908-a9c4-19285b36e0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:32.662058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55014469-efb7-4908-a9c4-19285b36e0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:32.662339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55014469-efb7-4908-a9c4-19285b36e0f9 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:32.663187 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55014469-efb7-4908-a9c4-19285b36e0f9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:32.663849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55014469-efb7-4908-a9c4-19285b36e0f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:32.665322 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55014469-efb7-4908-a9c4-19285b36e0f9 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:32.687056 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 473/949] 10.222.0.64 () {56 vars in 1149 bytes} [Mon Jul 18 02:17:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:32.690273 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287cc38-a44a-4da0-b875-9fab296e3ec3 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:32.714052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:32.795225 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287cc38-a44a-4da0-b875-9fab296e3ec3 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:32.833838 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ac62e-161b-4b5d-a793-c3e31dcc7e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:32.834988 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ac62e-161b-4b5d-a793-c3e31dcc7e16 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:32.835522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ac62e-161b-4b5d-a793-c3e31dcc7e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:32.836049 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ac62e-161b-4b5d-a793-c3e31dcc7e16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:32.847249 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ac62e-161b-4b5d-a793-c3e31dcc7e16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:32.848959 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ac62e-161b-4b5d-a793-c3e31dcc7e16 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:32.868146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-040ac62e-161b-4b5d-a793-c3e31dcc7e16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:32.868146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:32.868146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:32.868146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:32.868146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:32.868146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:32.868146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:32.868146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:32.868146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:32.868146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:32.868146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:32.868146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:32.868146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:32.868146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:32.868146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:32.869066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:32.869066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:32.869066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:32.869066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:32.869066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:32.869066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:32.869066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:32.869066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:32.869066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:32.869066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:32.869066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:32.869066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:32.869066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:32.869066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:32.869066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:32.869066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:32.869066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:32.869983 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:32.869983 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:32.869983 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:32.869983 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:32.872336 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 477/950] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:32.878093 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55014469-efb7-4908-a9c4-19285b36e0f9 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:32.909852 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea10f1-38b7-4420-adff-e465afd9e18d None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:32.910468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea10f1-38b7-4420-adff-e465afd9e18d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:32.910975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea10f1-38b7-4420-adff-e465afd9e18d None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:32.912826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 478/951] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:17:32.918440 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6a8b0-73f2-479a-8e22-0c17730fabd4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:32.918851 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6a8b0-73f2-479a-8e22-0c17730fabd4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:32.919142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef6a8b0-73f2-479a-8e22-0c17730fabd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:32.937554 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6ef6a8b0-73f2-479a-8e22-0c17730fabd4 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:32.938948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6ef6a8b0-73f2-479a-8e22-0c17730fabd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:32.993040 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55014469-efb7-4908-a9c4-19285b36e0f9 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:33.012301 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 479/952] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 02:17:33.035971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6a8b0-73f2-479a-8e22-0c17730fabd4 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:33.037987 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4535d0-da52-41ec-8461-0d957678fe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:33.038432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:33.039158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4535d0-da52-41ec-8461-0d957678fe7c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:33.039707 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4535d0-da52-41ec-8461-0d957678fe7c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:33.040240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4535d0-da52-41ec-8461-0d957678fe7c None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:33.041109 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4535d0-da52-41ec-8461-0d957678fe7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:33.041423 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4535d0-da52-41ec-8461-0d957678fe7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:33.042893 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4535d0-da52-41ec-8461-0d957678fe7c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:33.056689 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 474/953] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:33.061880 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4535d0-da52-41ec-8461-0d957678fe7c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:33.081605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:33.158219 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef6a8b0-73f2-479a-8e22-0c17730fabd4 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:33.196232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7838d7-b208-43ef-be4c-f66e326b640e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:33.197059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4535d0-da52-41ec-8461-0d957678fe7c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:33.198196 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7838d7-b208-43ef-be4c-f66e326b640e None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:33.198768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7838d7-b208-43ef-be4c-f66e326b640e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:33.199354 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7838d7-b208-43ef-be4c-f66e326b640e None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:33.200289 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7838d7-b208-43ef-be4c-f66e326b640e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:33.201959 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7838d7-b208-43ef-be4c-f66e326b640e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:33.232129 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba371b-0c13-442f-9123-b3affdc92a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:33.232925 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba371b-0c13-442f-9123-b3affdc92a09 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:33.233213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba371b-0c13-442f-9123-b3affdc92a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:33.233494 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba371b-0c13-442f-9123-b3affdc92a09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:33.240775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba371b-0c13-442f-9123-b3affdc92a09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:33.242291 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba371b-0c13-442f-9123-b3affdc92a09 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:33.257356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-31ba371b-0c13-442f-9123-b3affdc92a09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:33.257356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:33.257356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:33.257356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:33.257356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:33.257356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:33.257356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:33.257356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:33.257356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:33.257356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:33.257356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:33.257356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:33.257356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:17:33.257356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:17:33.257356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:17:33.259072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:17:33.259072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:33.259072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:33.259072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:33.259072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:33.259072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:33.259072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:33.259072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:33.259072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:33.259072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:33.259072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:33.259072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:33.259072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:33.259072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:33.259072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:33.259072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:33.259072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:33.260141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:17:33.260141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:17:33.260141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:17:33.260141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:17:33.260141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:17:33.260141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:17:33.260141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:33.260141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:33.260141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 475/954] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:33.264709 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba371b-0c13-442f-9123-b3affdc92a09 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:33.277178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 480/955] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jul 18 02:17:33 2022] POST /identity/v3/services => generated 242 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:17:33.342519 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:33.380595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba371b-0c13-442f-9123-b3affdc92a09 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:33.426299 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d6d58-9dbd-445d-a889-bfd4277934bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:33.426906 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d6d58-9dbd-445d-a889-bfd4277934bf None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:33.427193 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d6d58-9dbd-445d-a889-bfd4277934bf None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:33.427477 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d6d58-9dbd-445d-a889-bfd4277934bf None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:33.428283 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d6d58-9dbd-445d-a889-bfd4277934bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:33.428599 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d6d58-9dbd-445d-a889-bfd4277934bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:33.430797 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d6d58-9dbd-445d-a889-bfd4277934bf None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:33.444283 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 476/956] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:17:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:33.450401 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7838d7-b208-43ef-be4c-f66e326b640e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:33.521298 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:33.562701 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7838d7-b208-43ef-be4c-f66e326b640e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:33.598488 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229cd55e-e408-4a29-9696-74fdce296f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:33.599962 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cd55e-e408-4a29-9696-74fdce296f9f None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:33.600507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cd55e-e408-4a29-9696-74fdce296f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:33.601457 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229cd55e-e408-4a29-9696-74fdce296f9f None admin] PATH_INFO: `/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/01113a3f8cbf46b09fb5fcf4315a219b/roles/77405dcb2b214a28a22b24a17ed1f66e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:33.604289 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229cd55e-e408-4a29-9696-74fdce296f9f None admin] RBAC: Authorizing `identity:create_grant(project_id=1f6f840feba049ee9eeaf7bf0b300730, user_id=01113a3f8cbf46b09fb5fcf4315a219b, role_id=77405dcb2b214a28a22b24a17ed1f66e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:33.605742 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229cd55e-e408-4a29-9696-74fdce296f9f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:33.735089 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 481/957] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:17:33 2022] PUT /identity/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/01113a3f8cbf46b09fb5fcf4315a219b/roles/77405dcb2b214a28a22b24a17ed1f66e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:17:34.025046 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b83cdc-4a9a-4fd6-8fce-1702cfdf81c0 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:34.025401 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b83cdc-4a9a-4fd6-8fce-1702cfdf81c0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:34.025511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b83cdc-4a9a-4fd6-8fce-1702cfdf81c0 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:34.027209 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 477/958] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:34.032535 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e19988-56f9-46d4-9911-757e192afa7e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:34.032831 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e19988-56f9-46d4-9911-757e192afa7e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:34.033111 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e19988-56f9-46d4-9911-757e192afa7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:34.051120 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-78e19988-56f9-46d4-9911-757e192afa7e None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:34.052321 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-78e19988-56f9-46d4-9911-757e192afa7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:34.124164 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 482/959] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:34.157654 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b83cdc-4a9a-4fd6-8fce-1702cfdf81c0 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:34.259883 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b83cdc-4a9a-4fd6-8fce-1702cfdf81c0 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:34.283131 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:34.297665 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c09ab2-43e1-42c7-abd4-15684aa2f6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:34.301143 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c09ab2-43e1-42c7-abd4-15684aa2f6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:34.301143 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c09ab2-43e1-42c7-abd4-15684aa2f6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:34.301143 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c09ab2-43e1-42c7-abd4-15684aa2f6d5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:34.301143 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c09ab2-43e1-42c7-abd4-15684aa2f6d5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:34.301500 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c09ab2-43e1-42c7-abd4-15684aa2f6d5 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:34.313751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-10c09ab2-43e1-42c7-abd4-15684aa2f6d5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 02:17:34.313751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:34.313751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:17:34.313751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:17:34.313751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:17:34.313751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:17:34.313751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:17:34.313751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:34.313751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 02:17:34.313751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:34.313751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:34.313751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:34.313751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:34.313751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:34.313751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:34.313751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:34.313751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:34.314872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:34.314872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:34.314872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:34.314872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:34.314872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:34.314872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:34.314872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:17:34.314872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:17:34.314872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:17:34.314872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:17:34.314872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:34.314872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:34.314872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:34.314872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:34.314872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:34.314872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:34.315729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:34.315729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:34.315729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:34.315729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:34.315729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:34.315729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:34.315729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:34.315729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:34.315729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:34.315729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:34.315729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:17:34.315729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:34.315729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 02:17:34.315729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:34.315729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 478/960] 10.222.0.64 () {56 vars in 1126 bytes} [Mon Jul 18 02:17:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:34.323091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e19988-56f9-46d4-9911-757e192afa7e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:34.394878 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:34.435466 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e19988-56f9-46d4-9911-757e192afa7e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:34.471317 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a6340-b48e-4589-a8e7-443dfdfcb724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:34.472365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a6340-b48e-4589-a8e7-443dfdfcb724 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:34.472855 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a6340-b48e-4589-a8e7-443dfdfcb724 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:34.473335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a6340-b48e-4589-a8e7-443dfdfcb724 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:34.474376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a6340-b48e-4589-a8e7-443dfdfcb724 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:34.474906 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a6340-b48e-4589-a8e7-443dfdfcb724 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:34.476606 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a6340-b48e-4589-a8e7-443dfdfcb724 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:34.482822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 483/961] 10.222.0.64 () {56 vars in 1122 bytes} [Mon Jul 18 02:17:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:34.488742 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c09ab2-43e1-42c7-abd4-15684aa2f6d5 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:34.493907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb55ed-eea3-44ca-b17f-7f4802dc7f88 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:34.494201 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb55ed-eea3-44ca-b17f-7f4802dc7f88 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:34.494480 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb55ed-eea3-44ca-b17f-7f4802dc7f88 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:34.496109 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 484/962] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:34.501496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492faac-edff-4154-9d64-ce71df6d60a6 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:34.501816 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492faac-edff-4154-9d64-ce71df6d60a6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:34.502116 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492faac-edff-4154-9d64-ce71df6d60a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:34.520700 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b492faac-edff-4154-9d64-ce71df6d60a6 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:34.522162 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b492faac-edff-4154-9d64-ce71df6d60a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:34.601491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c09ab2-43e1-42c7-abd4-15684aa2f6d5 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:34.602321 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 485/963] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 02:17:34.621986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492faac-edff-4154-9d64-ce71df6d60a6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:34.637288 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bed1a8-7395-44f7-8baf-4c03ace73bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:34.638002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bed1a8-7395-44f7-8baf-4c03ace73bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:34.638390 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bed1a8-7395-44f7-8baf-4c03ace73bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:34.638676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bed1a8-7395-44f7-8baf-4c03ace73bb8 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:34.639384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bed1a8-7395-44f7-8baf-4c03ace73bb8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:34.639699 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bed1a8-7395-44f7-8baf-4c03ace73bb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:34.641182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bed1a8-7395-44f7-8baf-4c03ace73bb8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:34.646726 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 479/964] 10.222.0.64 () {56 vars in 1122 bytes} [Mon Jul 18 02:17:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:34.652245 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bed1a8-7395-44f7-8baf-4c03ace73bb8 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:34.677723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:34.713536 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:34.753074 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492faac-edff-4154-9d64-ce71df6d60a6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:34.763981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bed1a8-7395-44f7-8baf-4c03ace73bb8 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:34.799251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae37d5-ed44-4eb4-8a9d-5f7f7068323e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:34.800050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf321e6-1098-4717-b13c-ecf5cc927aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:34.800590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae37d5-ed44-4eb4-8a9d-5f7f7068323e None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:34.800713 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf321e6-1098-4717-b13c-ecf5cc927aa8 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:34.800970 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf321e6-1098-4717-b13c-ecf5cc927aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:34.801243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf321e6-1098-4717-b13c-ecf5cc927aa8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:34.801602 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae37d5-ed44-4eb4-8a9d-5f7f7068323e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:34.802008 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf321e6-1098-4717-b13c-ecf5cc927aa8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:34.802342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae37d5-ed44-4eb4-8a9d-5f7f7068323e None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:34.803225 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae37d5-ed44-4eb4-8a9d-5f7f7068323e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:34.803396 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf321e6-1098-4717-b13c-ecf5cc927aa8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:34.805526 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae37d5-ed44-4eb4-8a9d-5f7f7068323e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:34.807352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: WARNING keystone.server.flask.common [None req-3eae37d5-ed44-4eb4-8a9d-5f7f7068323e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 18 02:17:34.852866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.sql.core [None req-3eae37d5-ed44-4eb4-8a9d-5f7f7068323e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 02:17:34.852866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 18 02:17:34.852866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [parameters: {'user_id': 'd3de4ad8fba245748aa62934d6d08791', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 18 02:17:34.852866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80358) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 02:17:34.860209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-3eae37d5-ed44-4eb4-8a9d-5f7f7068323e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 18 02:17:34.860209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:34.860209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 02:17:34.860209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 02:17:34.860209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 02:17:34.860209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 02:17:34.860209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 02:17:34.860209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 02:17:34.860209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 02:17:34.860209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application conn.query(q) Jul 18 02:17:34.860209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 02:17:34.860209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 02:17:34.860209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 02:17:34.860209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application result.read() Jul 18 02:17:34.860209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 02:17:34.861084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 02:17:34.861084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 02:17:34.861084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 02:17:34.861084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 02:17:34.861084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 02:17:34.861084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 02:17:34.861084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 02:17:34.861084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 02:17:34.861084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:34.861084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 02:17:34.861084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:34.861084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:34.861084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 02:17:34.861084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 02:17:34.861084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 18 02:17:34.861084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 18 02:17:34.861084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 02:17:34.861084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application next(self.gen) Jul 18 02:17:34.862045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 02:17:34.862045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application yield resource Jul 18 02:17:34.862045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 02:17:34.862045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application next(self.gen) Jul 18 02:17:34.862045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 02:17:34.862045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 02:17:34.862045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 02:17:34.862045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 02:17:34.862045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 02:17:34.862045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise self.value Jul 18 02:17:34.862045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 02:17:34.862045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 02:17:34.862045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 02:17:34.862045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application session.commit() Jul 18 02:17:34.862045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 02:17:34.862045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 02:17:34.862045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 02:17:34.863502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 02:17:34.863502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 02:17:34.863502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self.session.flush() Jul 18 02:17:34.863502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 02:17:34.863502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 02:17:34.863502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 02:17:34.863502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 02:17:34.863502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 02:17:34.863502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application compat.raise_( Jul 18 02:17:34.863502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 02:17:34.863502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception Jul 18 02:17:34.863502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 02:17:34.863502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 02:17:34.863502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 02:17:34.863502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 02:17:34.863502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 02:17:34.863502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 02:17:34.864391 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 02:17:34.864391 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 02:17:34.864391 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 18 02:17:34.864391 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 18 02:17:34.864391 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 02:17:34.864391 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 02:17:34.864391 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 02:17:34.864391 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 02:17:34.864391 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 02:17:34.864391 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 02:17:34.864391 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 02:17:34.864391 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 02:17:34.864391 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 02:17:34.864391 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 02:17:34.864391 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 02:17:34.864391 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception Jul 18 02:17:34.865901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 02:17:34.865901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 02:17:34.865901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 02:17:34.865901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 02:17:34.865901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 02:17:34.865901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 02:17:34.865901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 02:17:34.865901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application conn.query(q) Jul 18 02:17:34.865901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 02:17:34.865901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 02:17:34.865901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 02:17:34.865901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application result.read() Jul 18 02:17:34.865901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 02:17:34.865901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 02:17:34.865901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 02:17:34.865901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 02:17:34.868599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 02:17:34.868599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 02:17:34.868599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 02:17:34.868599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 02:17:34.868599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 02:17:34.868599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 18 02:17:34.868599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd3de4ad8fba245748aa62934d6d08791', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 18 02:17:34.868599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 02:17:34.868599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:34.868599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:34.868599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:34.868599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:34.868599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:34.868599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:34.868599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:34.870519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:34.870519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:34.870519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:34.870519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:34.870519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:34.870519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:34.870519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:34.870519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 18 02:17:34.870519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 18 02:17:34.870519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:34.870519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:34.870519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:17:34.870519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:34.870519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:17:34.870519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:34.870519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 18 02:17:34.870519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 18 02:17:34.874208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 18 02:17:34.874208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 18 02:17:34.874208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 02:17:34.874208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 02:17:34.874208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 18 02:17:34.874208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:34.874208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 486/965] 10.222.0.64 () {60 vars in 1131 bytes} [Mon Jul 18 02:17:34 2022] POST /identity/v3/users => generated 160 bytes in 245 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:34.874208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae37d5-ed44-4eb4-8a9d-5f7f7068323e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:34.887241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 480/966] 10.222.0.64 () {60 vars in 1144 bytes} [Mon Jul 18 02:17:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:17:35.006252 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae37d5-ed44-4eb4-8a9d-5f7f7068323e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:35.016921 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:35.056228 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798ffea-4c4b-49cd-9aee-089058ce6fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:35.057323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798ffea-4c4b-49cd-9aee-089058ce6fdf None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:35.057958 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798ffea-4c4b-49cd-9aee-089058ce6fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:35.058583 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798ffea-4c4b-49cd-9aee-089058ce6fdf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:35.067964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798ffea-4c4b-49cd-9aee-089058ce6fdf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:35.074243 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798ffea-4c4b-49cd-9aee-089058ce6fdf None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:35.086081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-1798ffea-4c4b-49cd-9aee-089058ce6fdf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 02:17:35.086081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:35.086081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:35.086081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:35.086081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:35.086081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:35.086081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:35.086081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:35.086081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:35.086081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:35.086081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:35.086081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:35.086081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:17:35.086081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:17:35.086081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:17:35.086081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:17:35.087026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:35.087026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:35.087026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:17:35.087026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:35.087026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:17:35.087026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:35.087026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:35.087026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:35.087026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:35.087026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:35.087026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:35.087026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:35.087026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:35.087026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:35.087026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:35.087026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:35.087026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:35.087026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:35.088052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:35.088052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:35.088052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:17:35.088052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:17:35.088052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:17:35.088052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:17:35.088052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:17:35.088052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:17:35.088052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 02:17:35.088052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:35.088052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 487/967] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:17:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:35.095549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf321e6-1098-4717-b13c-ecf5cc927aa8 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:35.212934 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf321e6-1098-4717-b13c-ecf5cc927aa8 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:35.222757 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:35.250285 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbc02e-6010-4dd6-ab24-2682bc478bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:35.251244 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbc02e-6010-4dd6-ab24-2682bc478bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:35.251679 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbc02e-6010-4dd6-ab24-2682bc478bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:35.252158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbc02e-6010-4dd6-ab24-2682bc478bb5 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:35.253123 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbc02e-6010-4dd6-ab24-2682bc478bb5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:35.253583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbc02e-6010-4dd6-ab24-2682bc478bb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:35.255197 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbc02e-6010-4dd6-ab24-2682bc478bb5 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:35.291896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 481/968] 10.222.0.64 () {56 vars in 1101 bytes} [Mon Jul 18 02:17:35 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:35.459835 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a1ebb-8c27-4724-a9cb-76ecfe6ef625 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:35.460322 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a1ebb-8c27-4724-a9cb-76ecfe6ef625 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:35.460322 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a1ebb-8c27-4724-a9cb-76ecfe6ef625 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:35.462665 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 488/969] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:35.468315 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cfdd1-1c4a-48c3-8334-2a86563d903d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:35.468882 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cfdd1-1c4a-48c3-8334-2a86563d903d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:35.469387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cfdd1-1c4a-48c3-8334-2a86563d903d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:35.487310 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-ac7cfdd1-1c4a-48c3-8334-2a86563d903d None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:35.489122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ac7cfdd1-1c4a-48c3-8334-2a86563d903d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:35.559408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 482/970] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:35.582106 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a1ebb-8c27-4724-a9cb-76ecfe6ef625 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:35.688259 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828a1ebb-8c27-4724-a9cb-76ecfe6ef625 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:35.725346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f35a1-08e8-40a9-b0e5-5594d4db148d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:35.726161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f35a1-08e8-40a9-b0e5-5594d4db148d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:35.726450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f35a1-08e8-40a9-b0e5-5594d4db148d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:35.726798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f35a1-08e8-40a9-b0e5-5594d4db148d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:35.727457 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f35a1-08e8-40a9-b0e5-5594d4db148d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:35.728830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f35a1-08e8-40a9-b0e5-5594d4db148d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:35.740768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-ea0f35a1-08e8-40a9-b0e5-5594d4db148d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 02:17:35.740768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:35.740768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:17:35.740768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:17:35.740768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:17:35.740768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:17:35.740768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:17:35.740768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:35.740768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 02:17:35.740768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:35.740768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:35.740768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:35.740768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:35.740768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:35.740768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:35.740768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:35.740768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:35.742036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:35.742036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:35.742036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:35.742036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:35.742036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:35.742036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:35.742036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:17:35.742036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:17:35.742036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:17:35.742036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:17:35.742036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:35.742036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:35.742036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:35.742036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:35.742036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:35.742036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:35.743472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:35.743472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:35.743472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:35.743472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:35.743472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:35.743472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:35.743472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:35.743472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:35.743472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:35.743472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:35.743472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:17:35.743472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:35.743472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 02:17:35.743472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:35.745779 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 489/971] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:35.748429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cfdd1-1c4a-48c3-8334-2a86563d903d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:35.793093 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6f7de-8db7-4289-8772-e7e6155f2741 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:35.793375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6f7de-8db7-4289-8772-e7e6155f2741 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:35.793651 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6f7de-8db7-4289-8772-e7e6155f2741 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:35.795067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 490/972] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:17:35.800137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213f5ce-f1ce-4159-af5f-9dbddc34fae5 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:35.800422 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213f5ce-f1ce-4159-af5f-9dbddc34fae5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:35.800696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213f5ce-f1ce-4159-af5f-9dbddc34fae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:35.819043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1213f5ce-f1ce-4159-af5f-9dbddc34fae5 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:35.821581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1213f5ce-f1ce-4159-af5f-9dbddc34fae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:35.845291 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:35.848946 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:35.855134 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cfdd1-1c4a-48c3-8334-2a86563d903d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:35.889876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f86df-c9b5-4aef-9e20-1be4d7d2b410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:35.890743 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f86df-c9b5-4aef-9e20-1be4d7d2b410 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:35.891032 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f86df-c9b5-4aef-9e20-1be4d7d2b410 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:35.891305 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f86df-c9b5-4aef-9e20-1be4d7d2b410 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:35.893748 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 491/973] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 02:17:35.893892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f86df-c9b5-4aef-9e20-1be4d7d2b410 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:35.893892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f86df-c9b5-4aef-9e20-1be4d7d2b410 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:35.894042 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6f86df-c9b5-4aef-9e20-1be4d7d2b410 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:35.901749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 483/974] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jul 18 02:17:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:35.905186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213f5ce-f1ce-4159-af5f-9dbddc34fae5 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:35.917644 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f86df-c9b5-4aef-9e20-1be4d7d2b410 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:36.016405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213f5ce-f1ce-4159-af5f-9dbddc34fae5 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:36.021327 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f86df-c9b5-4aef-9e20-1be4d7d2b410 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:36.053263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606abb5-2393-476b-a449-a0221917cf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:36.053972 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606abb5-2393-476b-a449-a0221917cf35 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:36.054260 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606abb5-2393-476b-a449-a0221917cf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:36.054528 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606abb5-2393-476b-a449-a0221917cf35 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:36.055811 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606abb5-2393-476b-a449-a0221917cf35 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:36.056122 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606abb5-2393-476b-a449-a0221917cf35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:36.057494 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606abb5-2393-476b-a449-a0221917cf35 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:36.058299 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8371ca-8406-4771-9f39-cb0ab97a41a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:36.059115 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8371ca-8406-4771-9f39-cb0ab97a41a8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:36.061033 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8371ca-8406-4771-9f39-cb0ab97a41a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:36.061033 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8371ca-8406-4771-9f39-cb0ab97a41a8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:36.063222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 492/975] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jul 18 02:17:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:36.068836 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606abb5-2393-476b-a449-a0221917cf35 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:36.073286 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8371ca-8406-4771-9f39-cb0ab97a41a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:17:36.081532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-9f8371ca-8406-4771-9f39-cb0ab97a41a8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 02:17:36.081532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:36.081532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:36.081532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:36.081532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:36.081532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:36.081532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:36.081532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:36.081532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:36.081532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:36.081532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:36.081532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:36.081532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:17:36.081532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:17:36.081532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:17:36.081532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:17:36.082704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:17:36.082704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:17:36.082704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:17:36.082704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:17:36.082704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:36.082704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:36.082704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:36.082704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:36.082704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:36.082704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:36.082704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:36.082704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:36.082704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:36.082704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:36.082704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:36.082704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:36.086832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:36.086832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:36.086832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:36.086832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:36.086832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:17:36.086832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:17:36.086832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:17:36.086832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:17:36.086832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:17:36.086832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:17:36.086832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 02:17:36.086832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:36.086832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 484/976] 10.222.0.64 () {56 vars in 1120 bytes} [Mon Jul 18 02:17:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:36.088589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8371ca-8406-4771-9f39-cb0ab97a41a8 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:36.100301 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:36.113245 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:36.184769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606abb5-2393-476b-a449-a0221917cf35 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:36.196940 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8371ca-8406-4771-9f39-cb0ab97a41a8 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:36.220495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa328c-a9b3-41de-8338-40a2be14e349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:36.221337 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa328c-a9b3-41de-8338-40a2be14e349 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:36.221746 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa328c-a9b3-41de-8338-40a2be14e349 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:36.222130 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa328c-a9b3-41de-8338-40a2be14e349 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:36.223014 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa328c-a9b3-41de-8338-40a2be14e349 None admin] RBAC: Adding query filter params (interface=public, service_id=840f048757b34395a32926bd2f51c337, region_id=RegionOne) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:36.223430 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa328c-a9b3-41de-8338-40a2be14e349 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:36.224887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa328c-a9b3-41de-8338-40a2be14e349 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:36.230850 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 493/977] 10.222.0.64 () {56 vars in 1251 bytes} [Mon Jul 18 02:17:36 2022] GET /identity/v3/endpoints?service_id=840f048757b34395a32926bd2f51c337&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:36.233405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0a549-e3ff-4a9c-8390-f31ca3e43288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:36.234110 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0a549-e3ff-4a9c-8390-f31ca3e43288 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:36.234394 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0a549-e3ff-4a9c-8390-f31ca3e43288 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:36.234668 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc0a549-e3ff-4a9c-8390-f31ca3e43288 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:36.235417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0a549-e3ff-4a9c-8390-f31ca3e43288 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:36.235727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0a549-e3ff-4a9c-8390-f31ca3e43288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:36.236137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa328c-a9b3-41de-8338-40a2be14e349 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:36.237083 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc0a549-e3ff-4a9c-8390-f31ca3e43288 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:36.249891 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 485/978] 10.222.0.64 () {56 vars in 1115 bytes} [Mon Jul 18 02:17:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:36.250861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0a549-e3ff-4a9c-8390-f31ca3e43288 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:36.326342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:36.339134 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:36.345559 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa328c-a9b3-41de-8338-40a2be14e349 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:36.357782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc0a549-e3ff-4a9c-8390-f31ca3e43288 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:36.383874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cfa6a-d98d-47e4-87fc-88fb934ccf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:36.384794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cfa6a-d98d-47e4-87fc-88fb934ccf8b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:36.385243 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cfa6a-d98d-47e4-87fc-88fb934ccf8b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:36.388499 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cfa6a-d98d-47e4-87fc-88fb934ccf8b None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:36.388499 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cfa6a-d98d-47e4-87fc-88fb934ccf8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:36.388499 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cfa6a-d98d-47e4-87fc-88fb934ccf8b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:36.391111 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08035c8a-b70a-4a5e-afe2-0f64249e31c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:36.391909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08035c8a-b70a-4a5e-afe2-0f64249e31c5 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:36.392195 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08035c8a-b70a-4a5e-afe2-0f64249e31c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:36.392478 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08035c8a-b70a-4a5e-afe2-0f64249e31c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:36.402831 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 494/979] 10.222.0.64 () {56 vars in 1087 bytes} [Mon Jul 18 02:17:36 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:17:36.405287 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08035c8a-b70a-4a5e-afe2-0f64249e31c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:36.406866 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08035c8a-b70a-4a5e-afe2-0f64249e31c5 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:36.427220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-08035c8a-b70a-4a5e-afe2-0f64249e31c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:36.427220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:36.427220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:36.427220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:36.427220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:36.427220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:36.427220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:36.427220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:36.427220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:36.427220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:36.427220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:36.427220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:36.427220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:36.427220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:36.427220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:36.428186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:36.428186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:36.428186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:36.428186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:36.428186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:36.428186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:36.428186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:36.428186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:36.428186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:36.428186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:36.428186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:36.428186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:36.428186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:36.428186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:36.428186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:36.428186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:36.428186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:36.429065 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:36.429065 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:36.429065 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:36.429065 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:36.433471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 486/980] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:36.434770 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cfa6a-d98d-47e4-87fc-88fb934ccf8b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:36.544794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cfa6a-d98d-47e4-87fc-88fb934ccf8b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:36.581800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e7822-3382-459a-8e64-2f17df412ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:36.582407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e7822-3382-459a-8e64-2f17df412ded None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:36.582697 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e7822-3382-459a-8e64-2f17df412ded None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:36.582977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e7822-3382-459a-8e64-2f17df412ded None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:36.583699 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e7822-3382-459a-8e64-2f17df412ded None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:36.584009 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e7822-3382-459a-8e64-2f17df412ded None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:36.585371 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e7822-3382-459a-8e64-2f17df412ded None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:36.598035 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 495/981] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:36.603968 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08035c8a-b70a-4a5e-afe2-0f64249e31c5 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:36.705066 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08035c8a-b70a-4a5e-afe2-0f64249e31c5 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:36.740719 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0800ab-8919-4228-97cb-5018a55d6a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:36.742078 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0800ab-8919-4228-97cb-5018a55d6a9c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:36.742570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0800ab-8919-4228-97cb-5018a55d6a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:36.743021 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0800ab-8919-4228-97cb-5018a55d6a9c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:36.745189 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:36.752229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0800ab-8919-4228-97cb-5018a55d6a9c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:36.753707 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0800ab-8919-4228-97cb-5018a55d6a9c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:36.768907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-3e0800ab-8919-4228-97cb-5018a55d6a9c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 02:17:36.768907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:36.768907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:36.768907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:36.768907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:36.768907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:36.768907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:36.768907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:36.768907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:36.768907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:36.768907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:36.768907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:36.768907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:17:36.768907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:17:36.768907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:17:36.768907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:17:36.769861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:36.769861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:36.769861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:17:36.769861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:36.769861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:17:36.769861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:36.769861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:36.769861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:36.769861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:36.769861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:36.769861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:36.769861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:36.769861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:36.769861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:36.769861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:36.769861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:36.769861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:36.769861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:36.770788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:36.770788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:36.770788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:17:36.770788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:17:36.770788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:17:36.770788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:17:36.770788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:17:36.770788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:17:36.770788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 02:17:36.770788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:36.773781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 487/982] 10.222.0.64 () {56 vars in 1117 bytes} [Mon Jul 18 02:17:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:36.775989 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e7822-3382-459a-8e64-2f17df412ded None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:36.788894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:36.880766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e7822-3382-459a-8e64-2f17df412ded None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:36.914743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83302296-28bf-4e36-8138-0988c474abcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:36.915442 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83302296-28bf-4e36-8138-0988c474abcd None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:36.915726 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83302296-28bf-4e36-8138-0988c474abcd None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:36.916045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83302296-28bf-4e36-8138-0988c474abcd None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:36.916889 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83302296-28bf-4e36-8138-0988c474abcd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:36.917199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83302296-28bf-4e36-8138-0988c474abcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:36.918675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83302296-28bf-4e36-8138-0988c474abcd None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:36.941746 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 496/983] 10.222.0.64 () {56 vars in 1149 bytes} [Mon Jul 18 02:17:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:36.943773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0800ab-8919-4228-97cb-5018a55d6a9c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:37.053027 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0800ab-8919-4228-97cb-5018a55d6a9c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:37.056143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca2ec5-4bd9-4abc-87c6-6852be0ef492 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:37.056431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca2ec5-4bd9-4abc-87c6-6852be0ef492 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:37.056706 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca2ec5-4bd9-4abc-87c6-6852be0ef492 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:37.058113 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 497/984] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:17:37.063293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717092ee-dd49-4aa1-8b13-83a13a7683c4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:37.063574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717092ee-dd49-4aa1-8b13-83a13a7683c4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:37.063849 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717092ee-dd49-4aa1-8b13-83a13a7683c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:37.081138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-717092ee-dd49-4aa1-8b13-83a13a7683c4 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:37.082408 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-717092ee-dd49-4aa1-8b13-83a13a7683c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:37.091937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb3bee-f83c-4d7d-a5cb-63d92cd4ab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:37.092610 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb3bee-f83c-4d7d-a5cb-63d92cd4ab11 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:37.092900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb3bee-f83c-4d7d-a5cb-63d92cd4ab11 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:37.093182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb3bee-f83c-4d7d-a5cb-63d92cd4ab11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:37.158246 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:37.162484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:37.165799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 498/985] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 02:17:37.169948 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb3bee-f83c-4d7d-a5cb-63d92cd4ab11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:37.174887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acb3bee-f83c-4d7d-a5cb-63d92cd4ab11 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:37.187448 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717092ee-dd49-4aa1-8b13-83a13a7683c4 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:37.274334 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 488/986] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:17:36 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 02:17:37.279670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb3bee-f83c-4d7d-a5cb-63d92cd4ab11 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:37.289855 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717092ee-dd49-4aa1-8b13-83a13a7683c4 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:37.327760 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c605117-8878-48c9-8c6d-2a9a5e3fe77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:37.328654 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c605117-8878-48c9-8c6d-2a9a5e3fe77e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:37.328937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c605117-8878-48c9-8c6d-2a9a5e3fe77e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:37.329207 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c605117-8878-48c9-8c6d-2a9a5e3fe77e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:37.330035 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c605117-8878-48c9-8c6d-2a9a5e3fe77e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:37.331534 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c605117-8878-48c9-8c6d-2a9a5e3fe77e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:37.344948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-3c605117-8878-48c9-8c6d-2a9a5e3fe77e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 02:17:37.344948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:37.344948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:17:37.344948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:17:37.344948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:17:37.344948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:17:37.344948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:17:37.344948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:37.344948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 02:17:37.344948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:37.344948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:37.344948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:37.344948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:37.344948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:37.344948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:37.344948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:37.344948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:37.349845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:37.349845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:37.349845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:37.349845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:37.349845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:37.349845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:37.349845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:17:37.349845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:17:37.349845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:17:37.349845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:17:37.349845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:37.349845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:37.349845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:37.349845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:37.349845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:37.349845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:37.350774 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:37.350774 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:37.350774 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:37.350774 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:37.350774 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:37.350774 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:37.350774 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:37.350774 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:37.350774 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:37.350774 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:37.350774 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:17:37.350774 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:37.350774 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 02:17:37.350774 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:37.350774 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 499/987] 10.222.0.64 () {56 vars in 1126 bytes} [Mon Jul 18 02:17:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:37.352872 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c605117-8878-48c9-8c6d-2a9a5e3fe77e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:37.381823 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:37.389814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb3bee-f83c-4d7d-a5cb-63d92cd4ab11 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:37.436246 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9114a5c-fa0c-4930-8fd9-ff5a701f1d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:37.437409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9114a5c-fa0c-4930-8fd9-ff5a701f1d94 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:37.437693 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9114a5c-fa0c-4930-8fd9-ff5a701f1d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:37.438001 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9114a5c-fa0c-4930-8fd9-ff5a701f1d94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:37.441161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:37.451399 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9114a5c-fa0c-4930-8fd9-ff5a701f1d94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:37.452866 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9114a5c-fa0c-4930-8fd9-ff5a701f1d94 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:37.475226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-c9114a5c-fa0c-4930-8fd9-ff5a701f1d94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:37.475226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:37.475226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:37.475226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:37.475226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:37.475226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:37.475226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:37.475226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:37.475226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:37.475226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:37.475226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:37.475226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:37.475226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:37.475226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:37.475226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:37.476186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:37.476186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:37.476186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:37.476186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:37.476186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:37.476186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:37.476186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:37.476186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:37.476186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:37.476186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:37.476186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:37.476186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:37.476186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:37.476186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:37.476186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:37.476186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:37.476186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:37.477116 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:37.477116 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:37.477116 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:37.477116 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:37.477116 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 489/988] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:37.481918 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9114a5c-fa0c-4930-8fd9-ff5a701f1d94 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:37.488059 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c605117-8878-48c9-8c6d-2a9a5e3fe77e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:37.526334 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890bcdf-57d7-4061-870f-fbcc9c45e7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:37.527005 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890bcdf-57d7-4061-870f-fbcc9c45e7ae None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:37.527290 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890bcdf-57d7-4061-870f-fbcc9c45e7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:37.527573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890bcdf-57d7-4061-870f-fbcc9c45e7ae None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:37.528468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890bcdf-57d7-4061-870f-fbcc9c45e7ae None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:37.528782 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890bcdf-57d7-4061-870f-fbcc9c45e7ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:37.530311 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8890bcdf-57d7-4061-870f-fbcc9c45e7ae None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:37.535293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 500/989] 10.222.0.64 () {56 vars in 1122 bytes} [Mon Jul 18 02:17:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:37.540926 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890bcdf-57d7-4061-870f-fbcc9c45e7ae None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:37.601817 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9114a5c-fa0c-4930-8fd9-ff5a701f1d94 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:37.644533 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807ecbe-812d-4dcf-bd98-b3cb7e8a5594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:37.645217 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807ecbe-812d-4dcf-bd98-b3cb7e8a5594 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:37.645511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807ecbe-812d-4dcf-bd98-b3cb7e8a5594 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:37.645847 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807ecbe-812d-4dcf-bd98-b3cb7e8a5594 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:37.646697 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807ecbe-812d-4dcf-bd98-b3cb7e8a5594 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:37.647010 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807ecbe-812d-4dcf-bd98-b3cb7e8a5594 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:37.649009 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2807ecbe-812d-4dcf-bd98-b3cb7e8a5594 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:37.658648 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890bcdf-57d7-4061-870f-fbcc9c45e7ae None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:37.661230 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 490/990] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:37.666843 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807ecbe-812d-4dcf-bd98-b3cb7e8a5594 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:37.676683 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:37.692542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:37.703737 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e184458-4a0e-41bb-ad3e-2aab94a6a94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:37.704417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e184458-4a0e-41bb-ad3e-2aab94a6a94f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:37.706696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e184458-4a0e-41bb-ad3e-2aab94a6a94f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:37.706696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e184458-4a0e-41bb-ad3e-2aab94a6a94f None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:37.706696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e184458-4a0e-41bb-ad3e-2aab94a6a94f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:37.706696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e184458-4a0e-41bb-ad3e-2aab94a6a94f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:37.707343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e184458-4a0e-41bb-ad3e-2aab94a6a94f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:37.719369 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 501/991] 10.222.0.64 () {56 vars in 1122 bytes} [Mon Jul 18 02:17:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:37.721182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e184458-4a0e-41bb-ad3e-2aab94a6a94f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:37.792269 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807ecbe-812d-4dcf-bd98-b3cb7e8a5594 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:37.832228 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c054a-265d-4836-95b4-6d0af9f72a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:37.833030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c054a-265d-4836-95b4-6d0af9f72a4d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:37.833313 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c054a-265d-4836-95b4-6d0af9f72a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:37.833588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c054a-265d-4836-95b4-6d0af9f72a4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:37.840791 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c054a-265d-4836-95b4-6d0af9f72a4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:37.842334 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c054a-265d-4836-95b4-6d0af9f72a4d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:37.855329 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e184458-4a0e-41bb-ad3e-2aab94a6a94f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:37.858309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-cc0c054a-265d-4836-95b4-6d0af9f72a4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:37.858309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:37.858309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:37.858309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:37.858309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:37.858309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:37.858309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:37.858309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:37.858309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:37.858309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:37.858309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:37.858309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:37.858309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:17:37.858309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:17:37.858309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:17:37.859331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:17:37.859331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:37.859331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:37.859331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:37.859331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:37.859331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:37.859331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:37.859331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:37.859331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:37.859331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:37.859331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:37.859331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:37.859331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:37.859331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:37.859331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:37.859331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:37.859331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:37.865131 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:17:37.865131 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:17:37.865131 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:17:37.865131 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:17:37.865131 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:17:37.865131 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:17:37.865131 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:37.865131 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:37.865131 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 491/992] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:37.865724 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c054a-265d-4836-95b4-6d0af9f72a4d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:37.905785 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a290c-be68-4aec-8027-80c5b0ae6a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:37.906649 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a290c-be68-4aec-8027-80c5b0ae6a0f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:37.907150 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a290c-be68-4aec-8027-80c5b0ae6a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:37.907629 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a290c-be68-4aec-8027-80c5b0ae6a0f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:37.908674 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a290c-be68-4aec-8027-80c5b0ae6a0f None admin] RBAC: Adding query filter params (interface=admin, service_id=2e28d94df7434b5788fe1c86f8032342, region_id=RegionOne) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:37.908999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a290c-be68-4aec-8027-80c5b0ae6a0f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:37.910463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a290c-be68-4aec-8027-80c5b0ae6a0f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:37.925245 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 502/993] 10.222.0.64 () {56 vars in 1249 bytes} [Mon Jul 18 02:17:37 2022] GET /identity/v3/endpoints?service_id=2e28d94df7434b5788fe1c86f8032342&interface=admin®ion_id=RegionOne => generated 193 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:37.926286 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a290c-be68-4aec-8027-80c5b0ae6a0f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:37.945882 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:37.993848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:37.994591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c054a-265d-4836-95b4-6d0af9f72a4d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:38.035293 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b2d51-dd67-4de4-81e6-566bb09a505d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:38.035973 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b2d51-dd67-4de4-81e6-566bb09a505d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:38.036264 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b2d51-dd67-4de4-81e6-566bb09a505d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:38.036739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374b2d51-dd67-4de4-81e6-566bb09a505d None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:38.037332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b2d51-dd67-4de4-81e6-566bb09a505d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:38.037667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b2d51-dd67-4de4-81e6-566bb09a505d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:38.039727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374b2d51-dd67-4de4-81e6-566bb09a505d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:38.043548 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a290c-be68-4aec-8027-80c5b0ae6a0f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:38.052092 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 492/994] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:17:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:38.058175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b2d51-dd67-4de4-81e6-566bb09a505d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:38.086553 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0683dc9e-47c4-4b98-b488-278858c7dae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:38.087237 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683dc9e-47c4-4b98-b488-278858c7dae1 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:38.087573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683dc9e-47c4-4b98-b488-278858c7dae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:38.087860 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0683dc9e-47c4-4b98-b488-278858c7dae1 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:38.088549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683dc9e-47c4-4b98-b488-278858c7dae1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:38.089999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0683dc9e-47c4-4b98-b488-278858c7dae1 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:38.106179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 503/995] 10.222.0.64 () {56 vars in 1087 bytes} [Mon Jul 18 02:17:37 2022] GET /identity/v3/services => generated 1727 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:17:38.190233 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374b2d51-dd67-4de4-81e6-566bb09a505d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:38.221176 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:38.232335 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4cd9d-f3a6-429c-bdce-dc9991a76a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:38.233020 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4cd9d-f3a6-429c-bdce-dc9991a76a21 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:38.233302 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4cd9d-f3a6-429c-bdce-dc9991a76a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:38.237125 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4cd9d-f3a6-429c-bdce-dc9991a76a21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:38.237125 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4cd9d-f3a6-429c-bdce-dc9991a76a21 None admin] RBAC: Adding query filter params (role.id=77405dcb2b214a28a22b24a17ed1f66e, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=01113a3f8cbf46b09fb5fcf4315a219b) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:38.237125 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4cd9d-f3a6-429c-bdce-dc9991a76a21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:38.237125 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4cd9d-f3a6-429c-bdce-dc9991a76a21 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:38.249952 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 493/996] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:17:38 2022] GET /identity/v3/role_assignments?user.id=01113a3f8cbf46b09fb5fcf4315a219b&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=77405dcb2b214a28a22b24a17ed1f66e => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:38.460493 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef13c27-af22-464d-9c20-94fd6ecefc9a None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:38.461366 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef13c27-af22-464d-9c20-94fd6ecefc9a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:38.461590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef13c27-af22-464d-9c20-94fd6ecefc9a None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:38.463167 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 504/997] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:38.468199 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162d349-a418-4dcc-8810-02d9a42fc5bc None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:38.468646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162d349-a418-4dcc-8810-02d9a42fc5bc None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:38.468825 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6162d349-a418-4dcc-8810-02d9a42fc5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:38.486074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-6162d349-a418-4dcc-8810-02d9a42fc5bc None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:38.487197 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6162d349-a418-4dcc-8810-02d9a42fc5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:38.556912 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 494/998] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:38.578944 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef13c27-af22-464d-9c20-94fd6ecefc9a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:38.686104 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef13c27-af22-464d-9c20-94fd6ecefc9a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:38.703581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:38.721006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef47a7-2053-4a5c-93d4-f222f45f706e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:38.721847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef47a7-2053-4a5c-93d4-f222f45f706e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:38.722136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef47a7-2053-4a5c-93d4-f222f45f706e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:38.722419 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef47a7-2053-4a5c-93d4-f222f45f706e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:38.723069 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef47a7-2053-4a5c-93d4-f222f45f706e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:38.724503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef47a7-2053-4a5c-93d4-f222f45f706e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:38.736877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-c2ef47a7-2053-4a5c-93d4-f222f45f706e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 02:17:38.736877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:38.736877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:17:38.736877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:17:38.736877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:17:38.736877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:17:38.736877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:17:38.736877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:38.736877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 02:17:38.736877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:38.736877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:38.736877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:38.736877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:38.736877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:38.736877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:38.736877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:38.736877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:38.737927 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:38.737927 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:38.737927 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:38.737927 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:38.737927 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:38.737927 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:38.737927 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:17:38.737927 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:17:38.737927 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:17:38.737927 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:17:38.737927 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:38.737927 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:38.737927 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:38.737927 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:38.737927 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:38.737927 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:38.738790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:38.738790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:38.738790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:38.738790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:38.738790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:38.738790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:38.738790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:38.738790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:38.738790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:38.738790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:38.738790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:17:38.738790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:38.738790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 02:17:38.738790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:38.738790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 505/999] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:38.746165 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162d349-a418-4dcc-8810-02d9a42fc5bc None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:38.847730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6162d349-a418-4dcc-8810-02d9a42fc5bc None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:38.868686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:38.882831 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43569adb-1d20-4a1a-a86a-47228f55e851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:38.883508 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43569adb-1d20-4a1a-a86a-47228f55e851 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:38.883795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43569adb-1d20-4a1a-a86a-47228f55e851 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:38.884076 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43569adb-1d20-4a1a-a86a-47228f55e851 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:38.884786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43569adb-1d20-4a1a-a86a-47228f55e851 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:38.885098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43569adb-1d20-4a1a-a86a-47228f55e851 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:38.886497 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43569adb-1d20-4a1a-a86a-47228f55e851 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:38.898984 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 495/1000] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jul 18 02:17:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:38.899170 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef47a7-2053-4a5c-93d4-f222f45f706e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:38.999483 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef47a7-2053-4a5c-93d4-f222f45f706e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:39.032426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871694b-8cc1-45cd-a41c-43a0aad63928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:39.033094 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871694b-8cc1-45cd-a41c-43a0aad63928 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:39.033382 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871694b-8cc1-45cd-a41c-43a0aad63928 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:39.033663 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871694b-8cc1-45cd-a41c-43a0aad63928 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:39.034400 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871694b-8cc1-45cd-a41c-43a0aad63928 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:39.034713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871694b-8cc1-45cd-a41c-43a0aad63928 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:39.036079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871694b-8cc1-45cd-a41c-43a0aad63928 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:39.041627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 506/1001] 10.222.0.64 () {56 vars in 1112 bytes} [Mon Jul 18 02:17:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:39.047209 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43569adb-1d20-4a1a-a86a-47228f55e851 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:39.163759 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43569adb-1d20-4a1a-a86a-47228f55e851 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:39.197573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a97a5-f4df-4f8b-8875-1f690126a6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:39.198271 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a97a5-f4df-4f8b-8875-1f690126a6c4 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:39.198562 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a97a5-f4df-4f8b-8875-1f690126a6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:39.198843 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a97a5-f4df-4f8b-8875-1f690126a6c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:39.199589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a97a5-f4df-4f8b-8875-1f690126a6c4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:39.200953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a97a5-f4df-4f8b-8875-1f690126a6c4 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:39.325814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 496/1002] 10.222.0.64 () {60 vars in 1144 bytes} [Mon Jul 18 02:17:39 2022] POST /identity/v3/endpoints => generated 334 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:17:40.178848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a17b-035c-42da-9012-c42472ef1e56 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:40.179898 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a17b-035c-42da-9012-c42472ef1e56 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:40.179898 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a17b-035c-42da-9012-c42472ef1e56 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:40.181334 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 507/1003] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:40.186724 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e256c-f86f-4089-9dcc-84c72ad8e715 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:40.187126 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e256c-f86f-4089-9dcc-84c72ad8e715 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:40.187306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e256c-f86f-4089-9dcc-84c72ad8e715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:40.204570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-da8e256c-f86f-4089-9dcc-84c72ad8e715 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:40.205803 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-da8e256c-f86f-4089-9dcc-84c72ad8e715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:40.239072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:40.274977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f43f95-0c86-4f8e-80c0-9aa328e7cc9c None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:40.275284 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f43f95-0c86-4f8e-80c0-9aa328e7cc9c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:40.275538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f43f95-0c86-4f8e-80c0-9aa328e7cc9c None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:40.277233 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 508/1004] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:17:40.281895 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bc793-6e55-4aef-ab07-6e9d81d88551 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:40.282176 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bc793-6e55-4aef-ab07-6e9d81d88551 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:40.282569 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bc793-6e55-4aef-ab07-6e9d81d88551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:40.282793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 497/1005] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:40 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:40.299348 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-bb6bc793-6e55-4aef-ab07-6e9d81d88551 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:40.300595 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bb6bc793-6e55-4aef-ab07-6e9d81d88551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:40.300996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e256c-f86f-4089-9dcc-84c72ad8e715 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:40.346273 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:40.372400 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 509/1006] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:40 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 02:17:40.394745 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6bc793-6e55-4aef-ab07-6e9d81d88551 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:40.407204 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e256c-f86f-4089-9dcc-84c72ad8e715 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:40.446296 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95e61e-f30f-4e4c-a003-e1a17f3a89d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:40.447363 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95e61e-f30f-4e4c-a003-e1a17f3a89d9 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:40.447655 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95e61e-f30f-4e4c-a003-e1a17f3a89d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:40.447928 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95e61e-f30f-4e4c-a003-e1a17f3a89d9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:40.448579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95e61e-f30f-4e4c-a003-e1a17f3a89d9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:40.449987 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb95e61e-f30f-4e4c-a003-e1a17f3a89d9 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:40.462548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-cb95e61e-f30f-4e4c-a003-e1a17f3a89d9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 02:17:40.462548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:40.462548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:17:40.462548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:17:40.462548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:17:40.462548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:17:40.462548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:17:40.462548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:40.462548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 02:17:40.462548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:40.462548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:40.462548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:40.462548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:40.462548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:40.462548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:40.462548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:40.462548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:40.463552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:40.463552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:40.463552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:40.463552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:40.463552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:40.463552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:40.463552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:17:40.463552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:17:40.463552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:17:40.463552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:17:40.463552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:40.463552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:40.463552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:40.463552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:40.463552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:40.463552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:40.464393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:40.464393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:40.464393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:40.464393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:40.464393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:40.464393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:40.464393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:40.464393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:40.464393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:40.464393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:40.464393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:17:40.464393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:40.464393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 02:17:40.464393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:40.466900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 498/1007] 10.222.0.64 () {56 vars in 1126 bytes} [Mon Jul 18 02:17:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:40.476642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95e61e-f30f-4e4c-a003-e1a17f3a89d9 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:40.508842 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6bc793-6e55-4aef-ab07-6e9d81d88551 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:40.513203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:40.547676 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a3c77-efa2-481f-b680-b58b19975f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:40.548742 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a3c77-efa2-481f-b680-b58b19975f98 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:40.549023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a3c77-efa2-481f-b680-b58b19975f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:40.549297 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a3c77-efa2-481f-b680-b58b19975f98 None admin] PATH_INFO: `/v3/services/image` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:40.549979 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a3c77-efa2-481f-b680-b58b19975f98 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:40.551338 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a3c77-efa2-481f-b680-b58b19975f98 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:40.563732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-319a3c77-efa2-481f-b680-b58b19975f98 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 02:17:40.563732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:40.563732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:17:40.563732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:17:40.563732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:17:40.563732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:17:40.563732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:17:40.563732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:40.563732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 02:17:40.563732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:40.563732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:40.563732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:40.563732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:40.563732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:40.563732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:40.563732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:40.563732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:40.564999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:40.564999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:40.564999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:40.564999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:40.564999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:40.564999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:40.564999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:17:40.564999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:17:40.564999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:17:40.564999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:17:40.564999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:40.564999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:40.564999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:40.564999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:40.564999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:40.564999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:40.565863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:40.565863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:40.565863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:40.565863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:40.565863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:40.565863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:40.565863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:40.565863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:40.565863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:40.565863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:40.565863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:17:40.565863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:40.565863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 02:17:40.565863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:40.565863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 510/1008] 10.222.0.64 () {56 vars in 1105 bytes} [Mon Jul 18 02:17:40 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:40.572422 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a3c77-efa2-481f-b680-b58b19975f98 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:40.595196 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95e61e-f30f-4e4c-a003-e1a17f3a89d9 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:40.614913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:40.630903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98a597-5f42-4545-b416-bef730d3745b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:40.631570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98a597-5f42-4545-b416-bef730d3745b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:40.631855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98a597-5f42-4545-b416-bef730d3745b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:40.632123 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98a597-5f42-4545-b416-bef730d3745b None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:40.632850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98a597-5f42-4545-b416-bef730d3745b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:40.633155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98a597-5f42-4545-b416-bef730d3745b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:40.634543 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f98a597-5f42-4545-b416-bef730d3745b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:40.639472 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 499/1009] 10.222.0.64 () {56 vars in 1122 bytes} [Mon Jul 18 02:17:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:40.644887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98a597-5f42-4545-b416-bef730d3745b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:40.679001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a3c77-efa2-481f-b680-b58b19975f98 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:40.715148 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f5ad2-416c-4487-8733-8ad598015072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:40.715806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f5ad2-416c-4487-8733-8ad598015072 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:40.716090 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f5ad2-416c-4487-8733-8ad598015072 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:40.716367 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f5ad2-416c-4487-8733-8ad598015072 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:40.717062 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f5ad2-416c-4487-8733-8ad598015072 None admin] RBAC: Adding query filter params (name=image) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:40.717369 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f5ad2-416c-4487-8733-8ad598015072 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:40.718749 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f5ad2-416c-4487-8733-8ad598015072 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:40.723755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 511/1010] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:40.729366 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f5ad2-416c-4487-8733-8ad598015072 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:40.744828 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:40.751578 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98a597-5f42-4545-b416-bef730d3745b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:40.789681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ae913-0267-41c5-86e2-93e5297a8254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:40.790374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ae913-0267-41c5-86e2-93e5297a8254 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:40.790655 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ae913-0267-41c5-86e2-93e5297a8254 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:40.790929 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ae913-0267-41c5-86e2-93e5297a8254 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:40.791625 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ae913-0267-41c5-86e2-93e5297a8254 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:40.791931 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ae913-0267-41c5-86e2-93e5297a8254 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:40.793294 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ae913-0267-41c5-86e2-93e5297a8254 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:40.798542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 500/1011] 10.222.0.64 () {56 vars in 1122 bytes} [Mon Jul 18 02:17:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:40.804308 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ae913-0267-41c5-86e2-93e5297a8254 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:40.842051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f5ad2-416c-4487-8733-8ad598015072 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:40.844853 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:40.876573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f9a88-84f6-4041-b323-c9157d2f0dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:40.877246 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f9a88-84f6-4041-b323-c9157d2f0dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:40.877527 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f9a88-84f6-4041-b323-c9157d2f0dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:40.877840 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f9a88-84f6-4041-b323-c9157d2f0dd6 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:40.878547 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f9a88-84f6-4041-b323-c9157d2f0dd6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:40.878851 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f9a88-84f6-4041-b323-c9157d2f0dd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:40.880216 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f9a88-84f6-4041-b323-c9157d2f0dd6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:40.887135 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 512/1012] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:40 2022] GET /identity/v3/services?type=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:40.910932 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ae913-0267-41c5-86e2-93e5297a8254 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:40.949653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07914698-b2cc-400f-9a24-5ee1472662f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:40.950280 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914698-b2cc-400f-9a24-5ee1472662f8 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:40.950562 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914698-b2cc-400f-9a24-5ee1472662f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:40.950834 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07914698-b2cc-400f-9a24-5ee1472662f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:40.951581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07914698-b2cc-400f-9a24-5ee1472662f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:40.953063 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07914698-b2cc-400f-9a24-5ee1472662f8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:41.053659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 501/1013] 10.222.0.64 () {60 vars in 1144 bytes} [Mon Jul 18 02:17:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:17:41.460036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9c9a8-c53e-4700-b3bc-89be43427b77 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:41.461063 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9c9a8-c53e-4700-b3bc-89be43427b77 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:41.461144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9c9a8-c53e-4700-b3bc-89be43427b77 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:41.462572 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 513/1014] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:41.467657 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96168a03-2c53-4452-a2dd-4c3d73d59a84 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:41.468039 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96168a03-2c53-4452-a2dd-4c3d73d59a84 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:41.468228 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96168a03-2c53-4452-a2dd-4c3d73d59a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:41.485394 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-96168a03-2c53-4452-a2dd-4c3d73d59a84 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:41.486622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-96168a03-2c53-4452-a2dd-4c3d73d59a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:41.500194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:41.561565 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 502/1015] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:41 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:41.584840 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9c9a8-c53e-4700-b3bc-89be43427b77 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:41.688009 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9c9a8-c53e-4700-b3bc-89be43427b77 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:41.722949 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299d191-3410-49c3-a2cd-3e40436ebd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:41.723692 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299d191-3410-49c3-a2cd-3e40436ebd32 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:41.723976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299d191-3410-49c3-a2cd-3e40436ebd32 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:41.724251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299d191-3410-49c3-a2cd-3e40436ebd32 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:41.734336 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299d191-3410-49c3-a2cd-3e40436ebd32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:17:41.743070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-5299d191-3410-49c3-a2cd-3e40436ebd32 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 02:17:41.743070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:41.743070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:41.743070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:41.743070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:41.743070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:41.743070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:41.743070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:41.743070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:41.743070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:41.743070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:41.743070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:41.743070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:17:41.743070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:17:41.743070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:17:41.743070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:17:41.744006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:17:41.744006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:17:41.744006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:17:41.744006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:17:41.744006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:41.744006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:41.744006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:41.744006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:41.744006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:41.744006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:41.744006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:41.744006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:41.744006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:41.744006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:41.744006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:41.744006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:41.744864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:41.744864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:41.744864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:41.744864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:41.744864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:17:41.744864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:17:41.744864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:17:41.744864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:17:41.744864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:17:41.744864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:17:41.744864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 02:17:41.744864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:41.746303 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 514/1016] 10.222.0.64 () {56 vars in 1120 bytes} [Mon Jul 18 02:17:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:41.750283 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96168a03-2c53-4452-a2dd-4c3d73d59a84 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:41.853196 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96168a03-2c53-4452-a2dd-4c3d73d59a84 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:41.887183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a49c9d-cd74-419e-b264-13d058e4f239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:41.887852 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a49c9d-cd74-419e-b264-13d058e4f239 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:41.888145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a49c9d-cd74-419e-b264-13d058e4f239 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:41.888423 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a49c9d-cd74-419e-b264-13d058e4f239 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:41.889165 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a49c9d-cd74-419e-b264-13d058e4f239 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:41.889475 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a49c9d-cd74-419e-b264-13d058e4f239 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:41.890868 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a49c9d-cd74-419e-b264-13d058e4f239 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:41.899029 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 503/1017] 10.222.0.64 () {56 vars in 1115 bytes} [Mon Jul 18 02:17:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:41.904402 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299d191-3410-49c3-a2cd-3e40436ebd32 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:41.934072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:42.008851 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299d191-3410-49c3-a2cd-3e40436ebd32 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:42.045852 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c124a0-460c-44e3-866e-0faa8465e1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:42.046628 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c124a0-460c-44e3-866e-0faa8465e1af None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:42.046918 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c124a0-460c-44e3-866e-0faa8465e1af None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:42.047200 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c124a0-460c-44e3-866e-0faa8465e1af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:42.058573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c124a0-460c-44e3-866e-0faa8465e1af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:42.060804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c124a0-460c-44e3-866e-0faa8465e1af None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:42.077907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-f6c124a0-460c-44e3-866e-0faa8465e1af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:42.077907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:42.077907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:42.077907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:42.077907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:42.077907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:42.077907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:42.077907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:42.077907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:42.077907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:42.077907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:42.077907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:42.077907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:42.077907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:42.077907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:42.078824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:42.078824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:42.078824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:42.078824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:42.078824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:42.078824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:42.078824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:42.078824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:42.078824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:42.078824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:42.078824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:42.078824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:42.078824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:42.078824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:42.078824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:42.078824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:42.078824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:42.079732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:42.079732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:42.079732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:42.079732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:42.079732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 515/1018] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:42.084849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a49c9d-cd74-419e-b264-13d058e4f239 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:42.094474 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:42.194172 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a49c9d-cd74-419e-b264-13d058e4f239 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:42.228998 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3eb80-de22-4913-9d46-746a8c06d4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:42.229664 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3eb80-de22-4913-9d46-746a8c06d4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:42.229982 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3eb80-de22-4913-9d46-746a8c06d4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:42.230264 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3eb80-de22-4913-9d46-746a8c06d4f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:42.230983 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3eb80-de22-4913-9d46-746a8c06d4f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:42.231296 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3eb80-de22-4913-9d46-746a8c06d4f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:42.232663 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3eb80-de22-4913-9d46-746a8c06d4f6 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:42.245324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 504/1019] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:42.250928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c124a0-460c-44e3-866e-0faa8465e1af None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:42.330420 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:42.349693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c124a0-460c-44e3-866e-0faa8465e1af None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:42.383972 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ba76b-c2da-4359-8e0c-85b6908e15ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:42.384766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ba76b-c2da-4359-8e0c-85b6908e15ea None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:42.385055 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ba76b-c2da-4359-8e0c-85b6908e15ea None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:42.385335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ba76b-c2da-4359-8e0c-85b6908e15ea None admin] PATH_INFO: `/v3/users/nova` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:42.392340 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ba76b-c2da-4359-8e0c-85b6908e15ea None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:42.393804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ba76b-c2da-4359-8e0c-85b6908e15ea None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:42.408511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-313ba76b-c2da-4359-8e0c-85b6908e15ea None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 02:17:42.408511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:42.408511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:42.408511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:42.408511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:42.408511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:42.408511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:42.408511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:42.408511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:42.408511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:42.408511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:42.408511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:42.408511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:17:42.408511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:17:42.408511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:17:42.408511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:17:42.409450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:42.409450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:42.409450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:17:42.409450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:42.409450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:17:42.409450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:42.409450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:42.409450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:42.409450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:42.409450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:42.409450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:42.409450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:42.409450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:42.409450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:42.409450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:42.409450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:42.409450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:42.409450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:42.410904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:42.410904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:42.410904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:17:42.410904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:17:42.410904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:17:42.410904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:17:42.410904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:17:42.410904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:17:42.410904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 02:17:42.410904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:42.414032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 516/1020] 10.222.0.64 () {56 vars in 1093 bytes} [Mon Jul 18 02:17:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:42.415549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3eb80-de22-4913-9d46-746a8c06d4f6 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:42.481433 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:42.518071 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3eb80-de22-4913-9d46-746a8c06d4f6 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:42.552307 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e0e3c-51ed-4ab9-b488-6a0214a7cc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:42.552990 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e0e3c-51ed-4ab9-b488-6a0214a7cc3b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:42.553279 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e0e3c-51ed-4ab9-b488-6a0214a7cc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:42.553561 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e0e3c-51ed-4ab9-b488-6a0214a7cc3b None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:42.554950 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e0e3c-51ed-4ab9-b488-6a0214a7cc3b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:42.555270 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e0e3c-51ed-4ab9-b488-6a0214a7cc3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:42.556706 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e0e3c-51ed-4ab9-b488-6a0214a7cc3b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:42.575424 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 505/1021] 10.222.0.64 () {56 vars in 1133 bytes} [Mon Jul 18 02:17:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:42.581092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ba76b-c2da-4359-8e0c-85b6908e15ea None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:42.683144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ba76b-c2da-4359-8e0c-85b6908e15ea None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:42.717006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d6cbdb-ff6e-4c64-aeed-ad8c6f645dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:42.717663 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6cbdb-ff6e-4c64-aeed-ad8c6f645dfe None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:42.717979 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6cbdb-ff6e-4c64-aeed-ad8c6f645dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:42.718258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d6cbdb-ff6e-4c64-aeed-ad8c6f645dfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:42.729246 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:42.786985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6cbdb-ff6e-4c64-aeed-ad8c6f645dfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:42.788981 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d6cbdb-ff6e-4c64-aeed-ad8c6f645dfe None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:42.892088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 517/1022] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:17:42 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 02:17:42.893565 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e0e3c-51ed-4ab9-b488-6a0214a7cc3b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:42.917874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f471e-c8dc-436a-b68b-457bb6f729ad None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:42.918168 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f471e-c8dc-436a-b68b-457bb6f729ad None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:42.918434 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f471e-c8dc-436a-b68b-457bb6f729ad None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:42.919798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 518/1023] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:17:42.924898 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb620ea8-c565-4aa7-ba69-fdccb01cda3d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:42.925184 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb620ea8-c565-4aa7-ba69-fdccb01cda3d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:42.925465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb620ea8-c565-4aa7-ba69-fdccb01cda3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:42.942797 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-cb620ea8-c565-4aa7-ba69-fdccb01cda3d None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:42.943982 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cb620ea8-c565-4aa7-ba69-fdccb01cda3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:42.982840 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:43.000767 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e0e3c-51ed-4ab9-b488-6a0214a7cc3b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:43.017486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 519/1024] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:42 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 02:17:43.031005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:43.040433 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb620ea8-c565-4aa7-ba69-fdccb01cda3d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:43.042331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3aae0-b501-41c6-8038-593cc7a8d6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:43.043137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3aae0-b501-41c6-8038-593cc7a8d6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:43.043426 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3aae0-b501-41c6-8038-593cc7a8d6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:43.043702 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3aae0-b501-41c6-8038-593cc7a8d6a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:43.054333 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c3aae0-b501-41c6-8038-593cc7a8d6a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:43.055818 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c3aae0-b501-41c6-8038-593cc7a8d6a8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:43.073352 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-a1c3aae0-b501-41c6-8038-593cc7a8d6a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:43.073352 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:43.073352 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:43.073352 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:43.073352 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:43.073352 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:43.073352 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:43.073352 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:43.073352 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:43.073352 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:43.073352 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:43.073352 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:43.073352 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:43.073352 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:43.073352 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:43.074518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:43.074518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:43.074518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:43.074518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:43.074518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:43.074518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:43.074518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:43.074518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:43.074518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:43.074518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:43.074518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:43.074518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:43.074518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:43.074518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:43.074518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:43.074518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:43.074518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:43.075439 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:43.075439 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:43.075439 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:43.075439 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:43.075439 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 506/1025] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:43.080311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3aae0-b501-41c6-8038-593cc7a8d6a8 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:43.148511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb620ea8-c565-4aa7-ba69-fdccb01cda3d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:43.182289 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3aae0-b501-41c6-8038-593cc7a8d6a8 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:43.182469 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ef686-2ae1-4146-8e21-443ba220301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:43.182992 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ef686-2ae1-4146-8e21-443ba220301c None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:43.183272 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ef686-2ae1-4146-8e21-443ba220301c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:43.183551 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ef686-2ae1-4146-8e21-443ba220301c None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:43.184256 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ef686-2ae1-4146-8e21-443ba220301c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:43.185605 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ef686-2ae1-4146-8e21-443ba220301c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:43.215551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e3002e-9909-463e-bcc4-472f71fc47a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:43.216205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3002e-9909-463e-bcc4-472f71fc47a3 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:43.216489 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3002e-9909-463e-bcc4-472f71fc47a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:43.216764 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e3002e-9909-463e-bcc4-472f71fc47a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:43.217470 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3002e-9909-463e-bcc4-472f71fc47a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:43.217803 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3002e-9909-463e-bcc4-472f71fc47a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:43.219154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e3002e-9909-463e-bcc4-472f71fc47a3 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:43.230748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 507/1026] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:43.236675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9935fc-315d-468a-a3d3-a63e58b9ae6d None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:43.236675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9935fc-315d-468a-a3d3-a63e58b9ae6d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:43.236675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9935fc-315d-468a-a3d3-a63e58b9ae6d None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:43.236675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 508/1027] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:43.236675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9935fc-315d-468a-a3d3-a63e58b9ae6d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:43.264154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 520/1028] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jul 18 02:17:43 2022] POST /identity/v3/services => generated 242 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:17:43.265295 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cbde3-417b-4fb5-a531-6c8f5e1aad2c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:43.265587 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cbde3-417b-4fb5-a531-6c8f5e1aad2c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:43.265980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314cbde3-417b-4fb5-a531-6c8f5e1aad2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:43.271425 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:43.294252 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-314cbde3-417b-4fb5-a531-6c8f5e1aad2c None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:43.296067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-314cbde3-417b-4fb5-a531-6c8f5e1aad2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:43.328190 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:43.352378 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9935fc-315d-468a-a3d3-a63e58b9ae6d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:43.376799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 521/1029] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:43.390221 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19de5a1-ff9b-4f0b-8584-6ba893fe1584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:43.391115 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19de5a1-ff9b-4f0b-8584-6ba893fe1584 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:43.391402 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19de5a1-ff9b-4f0b-8584-6ba893fe1584 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:43.391682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19de5a1-ff9b-4f0b-8584-6ba893fe1584 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:43.400035 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19de5a1-ff9b-4f0b-8584-6ba893fe1584 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:43.400940 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cbde3-417b-4fb5-a531-6c8f5e1aad2c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:43.401428 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19de5a1-ff9b-4f0b-8584-6ba893fe1584 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:43.418049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-a19de5a1-ff9b-4f0b-8584-6ba893fe1584 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:43.418049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:43.418049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:43.418049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:43.418049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:43.418049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:43.418049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:43.418049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:43.418049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:43.418049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:43.418049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:43.418049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:43.418049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:17:43.418049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:17:43.418049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:17:43.418996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:17:43.418996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:43.418996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:43.418996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:43.418996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:43.418996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:43.418996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:43.418996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:43.418996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:43.418996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:43.418996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:43.418996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:43.418996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:43.418996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:43.418996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:43.418996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:43.418996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:43.419892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:17:43.419892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:17:43.419892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:17:43.419892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:17:43.419892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:17:43.419892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:17:43.419892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:43.419892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:43.419892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 509/1030] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:43.425564 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19de5a1-ff9b-4f0b-8584-6ba893fe1584 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:43.519676 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314cbde3-417b-4fb5-a531-6c8f5e1aad2c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:43.520636 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:43.530126 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19de5a1-ff9b-4f0b-8584-6ba893fe1584 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:43.556440 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b4c36-c8aa-4c46-bc2b-e32ae96b9564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:43.557487 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b4c36-c8aa-4c46-bc2b-e32ae96b9564 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:43.557789 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b4c36-c8aa-4c46-bc2b-e32ae96b9564 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:43.558075 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b4c36-c8aa-4c46-bc2b-e32ae96b9564 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:43.559245 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b4c36-c8aa-4c46-bc2b-e32ae96b9564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:43.560680 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b4c36-c8aa-4c46-bc2b-e32ae96b9564 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:43.562691 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 522/1031] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:43.568036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b4c36-c8aa-4c46-bc2b-e32ae96b9564 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:43.570991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542deee1-7606-46e6-8feb-3200ba238d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:43.571978 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542deee1-7606-46e6-8feb-3200ba238d46 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:43.572269 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542deee1-7606-46e6-8feb-3200ba238d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:43.572553 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542deee1-7606-46e6-8feb-3200ba238d46 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:43.573354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542deee1-7606-46e6-8feb-3200ba238d46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:43.573668 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542deee1-7606-46e6-8feb-3200ba238d46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:43.575142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542deee1-7606-46e6-8feb-3200ba238d46 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:43.587929 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 510/1032] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:17:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:43.593894 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542deee1-7606-46e6-8feb-3200ba238d46 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:43.600634 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:43.680551 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b4c36-c8aa-4c46-bc2b-e32ae96b9564 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:43.698184 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542deee1-7606-46e6-8feb-3200ba238d46 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:43.719535 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a1bd21-bfbb-4dee-9ebc-fb5302bc4d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:43.720201 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1bd21-bfbb-4dee-9ebc-fb5302bc4d5d None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:43.720482 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1bd21-bfbb-4dee-9ebc-fb5302bc4d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:43.720757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a1bd21-bfbb-4dee-9ebc-fb5302bc4d5d None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:43.721460 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1bd21-bfbb-4dee-9ebc-fb5302bc4d5d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:43.722935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a1bd21-bfbb-4dee-9ebc-fb5302bc4d5d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:43.733653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f6c35-8dbe-4708-b1f5-6c4e9640483f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:43.734342 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f6c35-8dbe-4708-b1f5-6c4e9640483f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:43.734632 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f6c35-8dbe-4708-b1f5-6c4e9640483f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:43.734914 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f6c35-8dbe-4708-b1f5-6c4e9640483f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:43.735742 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f6c35-8dbe-4708-b1f5-6c4e9640483f None admin] RBAC: Adding query filter params (role.id=77405dcb2b214a28a22b24a17ed1f66e, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=6f51aae36f0b42868567840fa957ffe9) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:43.736058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f6c35-8dbe-4708-b1f5-6c4e9640483f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:43.737486 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f6c35-8dbe-4708-b1f5-6c4e9640483f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:43.743289 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 511/1033] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:17:43 2022] GET /identity/v3/role_assignments?user.id=6f51aae36f0b42868567840fa957ffe9&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=77405dcb2b214a28a22b24a17ed1f66e => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:43.814784 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 523/1034] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jul 18 02:17:43 2022] POST /identity/v3/projects => generated 311 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:17:45.310015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0317da-497d-4e08-b490-49b7f277f9a2 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:45.310527 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0317da-497d-4e08-b490-49b7f277f9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:45.310603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0317da-497d-4e08-b490-49b7f277f9a2 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:45.311988 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 512/1035] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:45.317135 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc163932-b69b-47b0-8b84-e6d415f8fece None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:45.317510 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc163932-b69b-47b0-8b84-e6d415f8fece None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:45.317742 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc163932-b69b-47b0-8b84-e6d415f8fece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:45.335218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-dc163932-b69b-47b0-8b84-e6d415f8fece None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:45.336422 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-dc163932-b69b-47b0-8b84-e6d415f8fece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:45.405834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 524/1036] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:45.428479 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0317da-497d-4e08-b490-49b7f277f9a2 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:45.447906 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:45.533350 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0317da-497d-4e08-b490-49b7f277f9a2 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:45.567405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31cc60-4df1-4a48-a193-2b8283c47feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:45.568206 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31cc60-4df1-4a48-a193-2b8283c47feb None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:45.568493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31cc60-4df1-4a48-a193-2b8283c47feb None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:45.568774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31cc60-4df1-4a48-a193-2b8283c47feb None admin] PATH_INFO: `/v3/services/image` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:45.569465 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31cc60-4df1-4a48-a193-2b8283c47feb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:45.570890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31cc60-4df1-4a48-a193-2b8283c47feb None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:45.582591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-8f31cc60-4df1-4a48-a193-2b8283c47feb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 02:17:45.582591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:45.582591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:17:45.582591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:17:45.582591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:17:45.582591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:17:45.582591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:17:45.582591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:45.582591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 02:17:45.582591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:45.582591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:45.582591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:45.582591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:45.582591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:45.582591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:45.582591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:45.582591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:45.583575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:45.583575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:45.583575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:45.583575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:45.583575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:45.583575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:45.583575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:17:45.583575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:17:45.583575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:17:45.583575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:17:45.583575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:45.583575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:45.583575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:45.583575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:45.583575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:45.583575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:45.584429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:45.584429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:45.584429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:45.584429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:45.584429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:45.584429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:45.584429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:45.584429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:45.584429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:45.584429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:45.584429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:17:45.584429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:45.584429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 02:17:45.584429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:45.592314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 513/1037] 10.222.0.64 () {56 vars in 1105 bytes} [Mon Jul 18 02:17:45 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:45.592466 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc163932-b69b-47b0-8b84-e6d415f8fece None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:45.603047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:45.691418 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc163932-b69b-47b0-8b84-e6d415f8fece None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:45.712216 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d8be3-e2de-4774-9dd5-d0afe6f70ece None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:45.712504 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d8be3-e2de-4774-9dd5-d0afe6f70ece None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:45.712774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d8be3-e2de-4774-9dd5-d0afe6f70ece None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:45.714340 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 514/1038] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:17:45.719200 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b09167-f921-4d7a-8a0e-2d354d603276 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:45.719613 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b09167-f921-4d7a-8a0e-2d354d603276 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:45.720023 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b09167-f921-4d7a-8a0e-2d354d603276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:45.731831 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c12537-836f-4831-869f-394a38c57341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:45.732903 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c12537-836f-4831-869f-394a38c57341 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:45.733189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c12537-836f-4831-869f-394a38c57341 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:45.737733 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-77b09167-f921-4d7a-8a0e-2d354d603276 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:45.739145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-77b09167-f921-4d7a-8a0e-2d354d603276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:45.740233 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c12537-836f-4831-869f-394a38c57341 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:45.740985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c12537-836f-4831-869f-394a38c57341 None admin] RBAC: Adding query filter params (name=image) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:45.741324 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c12537-836f-4831-869f-394a38c57341 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:45.743353 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c12537-836f-4831-869f-394a38c57341 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:45.748929 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 525/1039] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:45.754367 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c12537-836f-4831-869f-394a38c57341 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:45.817316 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 515/1040] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:45 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 02:17:45.837731 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:45.839613 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b09167-f921-4d7a-8a0e-2d354d603276 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:45.851939 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:45.865471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c12537-836f-4831-869f-394a38c57341 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:45.899799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c53552f-1a84-4ac6-85fc-8a5b8fa07328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:45.900458 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53552f-1a84-4ac6-85fc-8a5b8fa07328 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:45.900741 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53552f-1a84-4ac6-85fc-8a5b8fa07328 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:45.901015 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c53552f-1a84-4ac6-85fc-8a5b8fa07328 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:45.901732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c53552f-1a84-4ac6-85fc-8a5b8fa07328 None admin] RBAC: Adding query filter params (type=image) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:45.902082 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c53552f-1a84-4ac6-85fc-8a5b8fa07328 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:45.903403 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c53552f-1a84-4ac6-85fc-8a5b8fa07328 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:45.908389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 526/1041] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:45.909638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020fb6-4110-4d59-a7dc-d9b02e8512a9 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:45.909953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020fb6-4110-4d59-a7dc-d9b02e8512a9 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:45.910231 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30020fb6-4110-4d59-a7dc-d9b02e8512a9 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:45.911463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 527/1042] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:45.916773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30020fb6-4110-4d59-a7dc-d9b02e8512a9 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:45.956988 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b09167-f921-4d7a-8a0e-2d354d603276 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:45.991115 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7bca1-9bf2-493f-8547-d64f25112299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:45.991928 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7bca1-9bf2-493f-8547-d64f25112299 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:45.992214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7bca1-9bf2-493f-8547-d64f25112299 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:45.992492 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7bca1-9bf2-493f-8547-d64f25112299 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:46.002422 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7bca1-9bf2-493f-8547-d64f25112299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:17:46.010603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-43a7bca1-9bf2-493f-8547-d64f25112299 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 02:17:46.010603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:46.010603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:46.010603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:46.010603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:46.010603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:46.010603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:46.010603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:46.010603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:46.010603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:46.010603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:46.010603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:46.010603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:17:46.010603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:17:46.010603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:17:46.010603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:17:46.011560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:17:46.011560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:17:46.011560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:17:46.011560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:17:46.011560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:46.011560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:46.011560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:46.011560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:46.011560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:46.011560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:46.011560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:46.011560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:46.011560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:46.011560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:46.011560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:46.011560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:46.012469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:46.012469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:46.012469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:46.012469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:46.012469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:17:46.012469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:17:46.012469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:17:46.012469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:17:46.012469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:17:46.012469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:17:46.012469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 02:17:46.012469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:46.012469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 516/1043] 10.222.0.64 () {56 vars in 1120 bytes} [Mon Jul 18 02:17:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:46.013399 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287e935-65da-474b-95fe-9a79755cd4d4 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:46.013658 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287e935-65da-474b-95fe-9a79755cd4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:46.013968 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287e935-65da-474b-95fe-9a79755cd4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:46.020470 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30020fb6-4110-4d59-a7dc-d9b02e8512a9 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:46.030361 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c287e935-65da-474b-95fe-9a79755cd4d4 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:46.031554 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c287e935-65da-474b-95fe-9a79755cd4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:46.055397 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf2a73-b31d-498b-81bd-019bf929f207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:46.056050 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf2a73-b31d-498b-81bd-019bf929f207 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:46.056330 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf2a73-b31d-498b-81bd-019bf929f207 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:46.056603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bf2a73-b31d-498b-81bd-019bf929f207 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:46.057377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf2a73-b31d-498b-81bd-019bf929f207 None admin] RBAC: Adding query filter params (interface=public, service_id=d3fd2aaba8a54b698ee993d3a761961c, region_id=RegionOne) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:46.057683 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf2a73-b31d-498b-81bd-019bf929f207 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:46.059065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bf2a73-b31d-498b-81bd-019bf929f207 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:46.063992 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 528/1044] 10.222.0.64 () {56 vars in 1251 bytes} [Mon Jul 18 02:17:45 2022] GET /identity/v3/endpoints?service_id=d3fd2aaba8a54b698ee993d3a761961c&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:46.064754 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf2a73-b31d-498b-81bd-019bf929f207 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:46.067158 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:46.097285 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:46.102405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 517/1045] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:46 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:46.103198 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287e935-65da-474b-95fe-9a79755cd4d4 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:46.166767 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bf2a73-b31d-498b-81bd-019bf929f207 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:46.199439 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287e935-65da-474b-95fe-9a79755cd4d4 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:46.201186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8e6df-34d3-4cfb-81c0-13f442f0f6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:46.201984 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8e6df-34d3-4cfb-81c0-13f442f0f6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:46.202281 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8e6df-34d3-4cfb-81c0-13f442f0f6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:46.202558 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8e6df-34d3-4cfb-81c0-13f442f0f6d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:46.203298 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8e6df-34d3-4cfb-81c0-13f442f0f6d4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:46.203605 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8e6df-34d3-4cfb-81c0-13f442f0f6d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:46.204959 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8e6df-34d3-4cfb-81c0-13f442f0f6d4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:46.213844 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 529/1046] 10.222.0.64 () {56 vars in 1115 bytes} [Mon Jul 18 02:17:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:46.213844 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8e6df-34d3-4cfb-81c0-13f442f0f6d4 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:46.232910 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b892f-65e1-47e1-bd63-49bc9f901423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:46.233579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b892f-65e1-47e1-bd63-49bc9f901423 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:46.233892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b892f-65e1-47e1-bd63-49bc9f901423 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:46.234195 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b892f-65e1-47e1-bd63-49bc9f901423 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:46.234863 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b892f-65e1-47e1-bd63-49bc9f901423 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:46.236224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b892f-65e1-47e1-bd63-49bc9f901423 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:46.243309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 518/1047] 10.222.0.64 () {56 vars in 1087 bytes} [Mon Jul 18 02:17:46 2022] GET /identity/v3/services => generated 1957 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:17:46.244078 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b892f-65e1-47e1-bd63-49bc9f901423 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:46.290325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:46.318280 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:46.337313 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8e6df-34d3-4cfb-81c0-13f442f0f6d4 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:46.359125 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b892f-65e1-47e1-bd63-49bc9f901423 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:46.374985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5e93b-3417-458a-b1aa-b8a3e62e53ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:46.375798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5e93b-3417-458a-b1aa-b8a3e62e53ab None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:46.376104 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5e93b-3417-458a-b1aa-b8a3e62e53ab None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:46.376359 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5e93b-3417-458a-b1aa-b8a3e62e53ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:46.377564 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5e93b-3417-458a-b1aa-b8a3e62e53ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:46.379068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5e93b-3417-458a-b1aa-b8a3e62e53ab None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:46.380753 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 530/1048] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:46.386827 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5e93b-3417-458a-b1aa-b8a3e62e53ab None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:46.398684 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43453e73-059d-4bcf-80b1-c75b220dfd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:46.399488 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43453e73-059d-4bcf-80b1-c75b220dfd33 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:46.399773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43453e73-059d-4bcf-80b1-c75b220dfd33 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:46.400049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43453e73-059d-4bcf-80b1-c75b220dfd33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:46.411061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43453e73-059d-4bcf-80b1-c75b220dfd33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:46.414775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43453e73-059d-4bcf-80b1-c75b220dfd33 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:46.431721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-43453e73-059d-4bcf-80b1-c75b220dfd33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:46.431721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:46.431721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:46.431721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:46.431721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:46.431721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:46.431721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:46.431721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:46.431721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:46.431721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:46.431721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:46.431721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:46.431721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:46.431721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:46.431721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:46.432854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:46.432854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:46.432854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:46.432854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:46.432854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:46.432854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:46.432854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:46.432854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:46.432854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:46.432854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:46.432854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:46.432854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:46.432854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:46.432854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:46.432854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:46.432854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:46.432854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:46.433903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:46.433903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:46.433903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:46.433903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:46.433903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 519/1049] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:46.439103 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43453e73-059d-4bcf-80b1-c75b220dfd33 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:46.500240 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5e93b-3417-458a-b1aa-b8a3e62e53ab None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:46.531617 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:46.537082 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367707e-d53b-49b8-a746-2e58becfbcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:46.537773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367707e-d53b-49b8-a746-2e58becfbcf9 None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:46.538594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367707e-d53b-49b8-a746-2e58becfbcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:46.538995 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b367707e-d53b-49b8-a746-2e58becfbcf9 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:46.539846 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367707e-d53b-49b8-a746-2e58becfbcf9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:46.541272 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b367707e-d53b-49b8-a746-2e58becfbcf9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:46.545498 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43453e73-059d-4bcf-80b1-c75b220dfd33 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:46.572958 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:46.590322 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857d37c-0b2f-4fbe-968c-c51e04dba83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:46.590995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857d37c-0b2f-4fbe-968c-c51e04dba83d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:46.591280 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857d37c-0b2f-4fbe-968c-c51e04dba83d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:46.591557 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857d37c-0b2f-4fbe-968c-c51e04dba83d None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:46.592333 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857d37c-0b2f-4fbe-968c-c51e04dba83d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:46.592640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857d37c-0b2f-4fbe-968c-c51e04dba83d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:46.594071 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857d37c-0b2f-4fbe-968c-c51e04dba83d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:46.610404 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 520/1050] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:46.611484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857d37c-0b2f-4fbe-968c-c51e04dba83d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:46.642284 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 531/1051] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jul 18 02:17:46 2022] POST /identity/v3/users => generated 285 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:17:46.719676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857d37c-0b2f-4fbe-968c-c51e04dba83d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:46.758172 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66d821-4451-413d-9a26-9e0ba7304661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:46.758908 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66d821-4451-413d-9a26-9e0ba7304661 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:46.759190 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66d821-4451-413d-9a26-9e0ba7304661 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:46.759465 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66d821-4451-413d-9a26-9e0ba7304661 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:46.768300 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66d821-4451-413d-9a26-9e0ba7304661 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:46.769794 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66d821-4451-413d-9a26-9e0ba7304661 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:46.785518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-5b66d821-4451-413d-9a26-9e0ba7304661 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 02:17:46.785518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:46.785518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:46.785518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:46.785518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:46.785518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:46.785518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:46.785518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:46.785518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:46.785518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:46.785518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:46.785518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:46.785518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:17:46.785518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:17:46.785518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:17:46.785518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:17:46.792137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:46.792137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:46.792137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:17:46.792137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:46.792137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:17:46.792137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:46.792137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:46.792137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:46.792137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:46.792137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:46.792137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:46.792137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:46.792137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:46.792137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:46.792137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:46.792137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:46.792137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:46.792137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:46.793382 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:46.793382 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:46.793382 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:17:46.793382 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:17:46.793382 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:17:46.793382 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:17:46.793382 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:17:46.793382 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:17:46.793382 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 02:17:46.793382 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:46.793382 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 521/1052] 10.222.0.64 () {56 vars in 1093 bytes} [Mon Jul 18 02:17:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:46.795205 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367707e-d53b-49b8-a746-2e58becfbcf9 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:46.902188 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b367707e-d53b-49b8-a746-2e58becfbcf9 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:46.942520 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d9094-9bd2-4df1-9f62-6301b9e8a41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:46.943288 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d9094-9bd2-4df1-9f62-6301b9e8a41b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:46.943574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d9094-9bd2-4df1-9f62-6301b9e8a41b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:46.943852 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d9094-9bd2-4df1-9f62-6301b9e8a41b None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:46.944789 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d9094-9bd2-4df1-9f62-6301b9e8a41b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:46.945104 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d9094-9bd2-4df1-9f62-6301b9e8a41b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:46.946579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d9094-9bd2-4df1-9f62-6301b9e8a41b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:46.969427 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 532/1053] 10.222.0.64 () {56 vars in 1133 bytes} [Mon Jul 18 02:17:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:46.970608 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66d821-4451-413d-9a26-9e0ba7304661 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:47.006520 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:47.073755 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66d821-4451-413d-9a26-9e0ba7304661 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:47.107857 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bb396-53d0-4c92-ac74-e8c8dc1bd24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:47.108649 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bb396-53d0-4c92-ac74-e8c8dc1bd24c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:47.108930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bb396-53d0-4c92-ac74-e8c8dc1bd24c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:47.109206 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bb396-53d0-4c92-ac74-e8c8dc1bd24c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:47.119895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545bb396-53d0-4c92-ac74-e8c8dc1bd24c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:47.121389 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545bb396-53d0-4c92-ac74-e8c8dc1bd24c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:47.142544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-545bb396-53d0-4c92-ac74-e8c8dc1bd24c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:47.142544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:47.142544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:47.142544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:47.142544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:47.142544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:47.142544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:47.142544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:47.142544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:47.142544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:47.142544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:47.142544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:47.142544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:47.142544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:47.142544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:47.143493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:47.143493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:47.143493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:47.143493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:47.143493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:47.143493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:47.143493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:47.143493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:47.143493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:47.143493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:47.143493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:47.143493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:47.143493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:47.143493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:47.143493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:47.143493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:47.143493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:47.144405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:47.144405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:47.144405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:47.144405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:47.146578 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 522/1054] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:47.152787 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d9094-9bd2-4df1-9f62-6301b9e8a41b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:47.204195 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:47.258950 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d9094-9bd2-4df1-9f62-6301b9e8a41b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:47.292871 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee49ecc-a20d-456d-aed0-da8144b6db8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:47.293532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee49ecc-a20d-456d-aed0-da8144b6db8a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:47.293859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee49ecc-a20d-456d-aed0-da8144b6db8a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:47.294139 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee49ecc-a20d-456d-aed0-da8144b6db8a None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:47.294851 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee49ecc-a20d-456d-aed0-da8144b6db8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:47.295159 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee49ecc-a20d-456d-aed0-da8144b6db8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:47.296518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee49ecc-a20d-456d-aed0-da8144b6db8a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:47.309528 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 533/1055] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:47.315243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bb396-53d0-4c92-ac74-e8c8dc1bd24c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:47.407944 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:47.420791 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545bb396-53d0-4c92-ac74-e8c8dc1bd24c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:47.456210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57f006-3969-44ef-8b1e-ee8a5fbc4edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:47.457008 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57f006-3969-44ef-8b1e-ee8a5fbc4edf None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:47.457292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57f006-3969-44ef-8b1e-ee8a5fbc4edf None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:47.457560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc57f006-3969-44ef-8b1e-ee8a5fbc4edf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:47.464724 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57f006-3969-44ef-8b1e-ee8a5fbc4edf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:47.466176 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc57f006-3969-44ef-8b1e-ee8a5fbc4edf None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:47.480238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-dc57f006-3969-44ef-8b1e-ee8a5fbc4edf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:47.480238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:47.480238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:47.480238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:47.480238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:47.480238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:47.480238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:47.480238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:47.480238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:47.480238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:47.480238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:47.480238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:47.480238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:17:47.480238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:17:47.480238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:17:47.481140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:17:47.481140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:47.481140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:47.481140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:47.481140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:47.481140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:47.481140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:47.481140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:47.481140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:47.481140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:47.481140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:47.481140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:47.481140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:47.481140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:47.481140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:47.481140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:47.481140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:47.482061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:17:47.482061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:17:47.482061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:17:47.482061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:17:47.482061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:17:47.482061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:17:47.482061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:47.482061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:47.482061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 523/1056] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:47.487246 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee49ecc-a20d-456d-aed0-da8144b6db8a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:47.593612 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee49ecc-a20d-456d-aed0-da8144b6db8a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:47.600802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:47.627027 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66062e9-5171-4aa3-9a05-1d2956a62ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:47.627685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66062e9-5171-4aa3-9a05-1d2956a62ed5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:47.627967 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66062e9-5171-4aa3-9a05-1d2956a62ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:47.628243 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66062e9-5171-4aa3-9a05-1d2956a62ed5 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:47.629023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66062e9-5171-4aa3-9a05-1d2956a62ed5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:47.629333 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66062e9-5171-4aa3-9a05-1d2956a62ed5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:47.630828 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66062e9-5171-4aa3-9a05-1d2956a62ed5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:47.643765 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 534/1057] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:17:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:47.649476 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57f006-3969-44ef-8b1e-ee8a5fbc4edf None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:47.749325 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc57f006-3969-44ef-8b1e-ee8a5fbc4edf None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:47.783228 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08fc41-42c0-4457-8d07-b2269bf6ad8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:47.784132 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08fc41-42c0-4457-8d07-b2269bf6ad8e None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:47.784514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08fc41-42c0-4457-8d07-b2269bf6ad8e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:47.784686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08fc41-42c0-4457-8d07-b2269bf6ad8e None admin] PATH_INFO: `/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/6f51aae36f0b42868567840fa957ffe9/roles/77405dcb2b214a28a22b24a17ed1f66e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:47.787200 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08fc41-42c0-4457-8d07-b2269bf6ad8e None admin] RBAC: Authorizing `identity:create_grant(project_id=1f6f840feba049ee9eeaf7bf0b300730, user_id=6f51aae36f0b42868567840fa957ffe9, role_id=77405dcb2b214a28a22b24a17ed1f66e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:47.788657 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08fc41-42c0-4457-8d07-b2269bf6ad8e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:47.861836 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 524/1058] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:17:47 2022] PUT /identity/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/6f51aae36f0b42868567840fa957ffe9/roles/77405dcb2b214a28a22b24a17ed1f66e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:17:48.290763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bc4d7-a158-45e6-963d-15d2d0e4f43f None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:48.291135 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bc4d7-a158-45e6-963d-15d2d0e4f43f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:48.291343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8bc4d7-a158-45e6-963d-15d2d0e4f43f None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:48.292876 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 535/1059] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:48.298214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a87a0-04a7-41cc-a47a-e46ca82b63e2 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:48.298506 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a87a0-04a7-41cc-a47a-e46ca82b63e2 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:48.298786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a87a0-04a7-41cc-a47a-e46ca82b63e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:48.316685 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-db6a87a0-04a7-41cc-a47a-e46ca82b63e2 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:48.317902 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-db6a87a0-04a7-41cc-a47a-e46ca82b63e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:48.320141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:48.385610 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 525/1060] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:48.408456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bc4d7-a158-45e6-963d-15d2d0e4f43f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:48.514759 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8bc4d7-a158-45e6-963d-15d2d0e4f43f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:48.550017 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79abe2a-3ae9-410e-99d7-49577d107fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:48.550874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79abe2a-3ae9-410e-99d7-49577d107fce None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:48.551167 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79abe2a-3ae9-410e-99d7-49577d107fce None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:48.551448 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79abe2a-3ae9-410e-99d7-49577d107fce None admin] PATH_INFO: `/v3/services/image` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:48.552096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79abe2a-3ae9-410e-99d7-49577d107fce None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:48.553483 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79abe2a-3ae9-410e-99d7-49577d107fce None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:48.565315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-e79abe2a-3ae9-410e-99d7-49577d107fce None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 02:17:48.565315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:48.565315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:17:48.565315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:17:48.565315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:17:48.565315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:17:48.565315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:17:48.565315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:48.565315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 02:17:48.565315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:48.565315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:17:48.565315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:48.565315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:48.565315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:48.565315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:48.565315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:48.565315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:48.566331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:48.566331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:48.566331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:48.566331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:48.566331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:48.566331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:48.566331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:17:48.566331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:17:48.566331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:17:48.566331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:17:48.566331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:48.566331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:48.566331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:48.566331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:48.566331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:48.566331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:48.567178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:48.567178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:48.567178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:48.567178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:48.567178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:48.567178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:48.567178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:48.567178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:48.567178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:48.567178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:48.567178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:17:48.567178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:17:48.567178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 02:17:48.567178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:48.570039 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 536/1061] 10.222.0.64 () {56 vars in 1105 bytes} [Mon Jul 18 02:17:48 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:48.572517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a87a0-04a7-41cc-a47a-e46ca82b63e2 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:48.673966 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a87a0-04a7-41cc-a47a-e46ca82b63e2 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:48.708409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f99ecb4-1e50-47ee-8ced-4b54e7e238db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:48.709086 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99ecb4-1e50-47ee-8ced-4b54e7e238db None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:48.709388 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99ecb4-1e50-47ee-8ced-4b54e7e238db None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:48.709657 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f99ecb4-1e50-47ee-8ced-4b54e7e238db None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:48.710939 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99ecb4-1e50-47ee-8ced-4b54e7e238db None admin] RBAC: Adding query filter params (name=image) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:48.711251 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99ecb4-1e50-47ee-8ced-4b54e7e238db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:48.712623 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f99ecb4-1e50-47ee-8ced-4b54e7e238db None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:48.722359 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 526/1062] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:48.723884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79abe2a-3ae9-410e-99d7-49577d107fce None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:48.745042 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1c6df-d6bc-4036-9660-a5259e3c4f7f None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:48.745334 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1c6df-d6bc-4036-9660-a5259e3c4f7f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:48.745616 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1c6df-d6bc-4036-9660-a5259e3c4f7f None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:48.747613 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 527/1063] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:17:48.752335 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea8131-3ed3-46e6-9d5d-84c4664f33cc None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:48.752631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea8131-3ed3-46e6-9d5d-84c4664f33cc None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:48.752915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea8131-3ed3-46e6-9d5d-84c4664f33cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:48.756109 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:48.758514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:48.770212 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-2aea8131-3ed3-46e6-9d5d-84c4664f33cc None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:48.771398 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2aea8131-3ed3-46e6-9d5d-84c4664f33cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:48.832460 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79abe2a-3ae9-410e-99d7-49577d107fce None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:48.845978 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 528/1064] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 02:17:48.868990 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea8131-3ed3-46e6-9d5d-84c4664f33cc None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:48.873181 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88fcfb-a3c9-40e7-a21f-871b50af20df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:48.873887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88fcfb-a3c9-40e7-a21f-871b50af20df None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:48.874180 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88fcfb-a3c9-40e7-a21f-871b50af20df None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:48.874460 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88fcfb-a3c9-40e7-a21f-871b50af20df None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:48.875178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88fcfb-a3c9-40e7-a21f-871b50af20df None admin] RBAC: Adding query filter params (type=image) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:48.875490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88fcfb-a3c9-40e7-a21f-871b50af20df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:48.877285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88fcfb-a3c9-40e7-a21f-871b50af20df None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:48.887569 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 537/1065] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:48.888793 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88fcfb-a3c9-40e7-a21f-871b50af20df None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:48.983395 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea8131-3ed3-46e6-9d5d-84c4664f33cc None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:48.995973 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:49.003317 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88fcfb-a3c9-40e7-a21f-871b50af20df None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:49.013506 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:49.018603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f4a62-dcdb-42aa-9550-308dcba700fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:49.019400 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f4a62-dcdb-42aa-9550-308dcba700fe None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:49.019686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f4a62-dcdb-42aa-9550-308dcba700fe None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:49.019971 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f4a62-dcdb-42aa-9550-308dcba700fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:49.031062 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f4a62-dcdb-42aa-9550-308dcba700fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:17:49.039005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-9d8f4a62-dcdb-42aa-9550-308dcba700fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:17:49.039005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:49.039005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:49.039005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:49.039005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:49.039005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:49.039005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:49.039005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:49.039005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:49.039005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:49.039005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:49.039005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:49.039005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:17:49.039005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:17:49.039005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:17:49.039005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:17:49.039936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:17:49.039936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:17:49.039936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:17:49.039936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:17:49.039936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:49.039936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:49.039936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:49.039936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:49.039936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:49.039936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:49.039936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:49.039936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:49.039936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:49.039936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:49.039936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:49.039936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:49.040780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:49.040780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:49.040780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:49.040780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:49.040780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:17:49.040780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:17:49.040780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:17:49.040780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:17:49.040780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:17:49.040780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:17:49.040780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:17:49.040780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:49.040780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 529/1066] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:17:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:49.044262 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2118480-cf60-4f78-b56c-129900bc3d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:49.044953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2118480-cf60-4f78-b56c-129900bc3d9d None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:49.045239 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2118480-cf60-4f78-b56c-129900bc3d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:49.045523 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2118480-cf60-4f78-b56c-129900bc3d9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:49.046289 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2118480-cf60-4f78-b56c-129900bc3d9d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:49.046387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f4a62-dcdb-42aa-9550-308dcba700fe None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:49.047925 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2118480-cf60-4f78-b56c-129900bc3d9d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:49.132122 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 538/1067] 10.222.0.64 () {60 vars in 1144 bytes} [Mon Jul 18 02:17:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:17:49.156412 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f4a62-dcdb-42aa-9550-308dcba700fe None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:49.201730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26df3b9-c725-40c7-89ee-59cbfb5dcf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:49.202417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26df3b9-c725-40c7-89ee-59cbfb5dcf3a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:49.202705 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26df3b9-c725-40c7-89ee-59cbfb5dcf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:49.202991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26df3b9-c725-40c7-89ee-59cbfb5dcf3a None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:49.203746 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26df3b9-c725-40c7-89ee-59cbfb5dcf3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:49.204059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26df3b9-c725-40c7-89ee-59cbfb5dcf3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:49.205455 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26df3b9-c725-40c7-89ee-59cbfb5dcf3a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:49.220184 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 530/1068] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:17:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:49.221219 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2118480-cf60-4f78-b56c-129900bc3d9d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:49.330977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2118480-cf60-4f78-b56c-129900bc3d9d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:49.366245 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bba41-8c99-4c50-955e-03c277ff3e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:49.367131 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bba41-8c99-4c50-955e-03c277ff3e13 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:49.367415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bba41-8c99-4c50-955e-03c277ff3e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:49.367691 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46bba41-8c99-4c50-955e-03c277ff3e13 None admin] PATH_INFO: `/v3/users/10382113f56841a5b00044fc1f959c11` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:49.382127 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bba41-8c99-4c50-955e-03c277ff3e13 None admin] RBAC: Authorizing `identity:get_user(user_id=10382113f56841a5b00044fc1f959c11)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:49.383573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46bba41-8c99-4c50-955e-03c277ff3e13 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:49.385434 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 539/1069] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:17:49 2022] GET /identity/v3/users/10382113f56841a5b00044fc1f959c11 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:49.390960 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26df3b9-c725-40c7-89ee-59cbfb5dcf3a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:49.442117 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:49.494101 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26df3b9-c725-40c7-89ee-59cbfb5dcf3a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:49.526965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f5401-da73-4d75-b84f-0781bbf29dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:49.527638 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f5401-da73-4d75-b84f-0781bbf29dcc None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:49.528097 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f5401-da73-4d75-b84f-0781bbf29dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:49.528379 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f5401-da73-4d75-b84f-0781bbf29dcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:49.596833 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f5401-da73-4d75-b84f-0781bbf29dcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:49.598240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f5401-da73-4d75-b84f-0781bbf29dcc None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:49.646692 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:49.702461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 531/1070] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:17:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 02:17:49.703898 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bba41-8c99-4c50-955e-03c277ff3e13 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:49.715390 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:49.806428 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46bba41-8c99-4c50-955e-03c277ff3e13 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:49.840989 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5e8e7-4054-4fa2-80e4-6c1115ab752f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:49.841891 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5e8e7-4054-4fa2-80e4-6c1115ab752f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:49.842179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5e8e7-4054-4fa2-80e4-6c1115ab752f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:49.842457 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5e8e7-4054-4fa2-80e4-6c1115ab752f None admin] PATH_INFO: `/v3/projects/2417ea55144c48e99e3bd63f104b7e53` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:49.843662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5e8e7-4054-4fa2-80e4-6c1115ab752f None admin] RBAC: Authorizing `identity:get_project(project_id=2417ea55144c48e99e3bd63f104b7e53)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:49.845092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df5e8e7-4054-4fa2-80e4-6c1115ab752f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:49.852528 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 540/1071] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:17:49 2022] GET /identity/v3/projects/2417ea55144c48e99e3bd63f104b7e53 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:49.853657 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f5401-da73-4d75-b84f-0781bbf29dcc None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:49.873412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327efe0-46b7-42fd-9351-571c08a1bd8b None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:49.873770 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327efe0-46b7-42fd-9351-571c08a1bd8b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:49.880997 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327efe0-46b7-42fd-9351-571c08a1bd8b None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:49.882706 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 541/1072] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:17:49.889503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a0832-22cc-4d02-b09d-3a8758b2626b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:49.889823 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a0832-22cc-4d02-b09d-3a8758b2626b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:49.890117 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a0832-22cc-4d02-b09d-3a8758b2626b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:49.908696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-4f4a0832-22cc-4d02-b09d-3a8758b2626b None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:49.909918 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4f4a0832-22cc-4d02-b09d-3a8758b2626b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:50.006671 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 542/1073] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 02:17:50.017387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f5401-da73-4d75-b84f-0781bbf29dcc None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:50.043278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a0832-22cc-4d02-b09d-3a8758b2626b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:50.056477 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:50.073288 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd3b41-3951-40db-81c6-a53d9bba0481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:50.074362 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd3b41-3951-40db-81c6-a53d9bba0481 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:50.074824 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd3b41-3951-40db-81c6-a53d9bba0481 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:50.075280 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffd3b41-3951-40db-81c6-a53d9bba0481 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:50.076698 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd3b41-3951-40db-81c6-a53d9bba0481 None admin] RBAC: Adding query filter params (role.id=5dfa34e7a4594751aed7c0495c9a2383, scope.project.id=2417ea55144c48e99e3bd63f104b7e53, user.id=10382113f56841a5b00044fc1f959c11) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:50.077210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd3b41-3951-40db-81c6-a53d9bba0481 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:50.079757 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffd3b41-3951-40db-81c6-a53d9bba0481 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:50.097741 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 532/1074] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:17:49 2022] GET /identity/v3/role_assignments?user.id=10382113f56841a5b00044fc1f959c11&scope.project.id=2417ea55144c48e99e3bd63f104b7e53&role.id=5dfa34e7a4594751aed7c0495c9a2383 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:50.183428 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4a0832-22cc-4d02-b09d-3a8758b2626b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:50.230062 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1791d-a2ff-4ccd-be9e-abe46775e2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:50.230993 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1791d-a2ff-4ccd-be9e-abe46775e2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:50.231335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1791d-a2ff-4ccd-be9e-abe46775e2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:50.231676 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1791d-a2ff-4ccd-be9e-abe46775e2c2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:50.244526 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1791d-a2ff-4ccd-be9e-abe46775e2c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:17:50.253136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-d1d1791d-a2ff-4ccd-be9e-abe46775e2c2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 02:17:50.253136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:50.253136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:50.253136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:50.253136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:50.253136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:50.253136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:50.253136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:50.253136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:50.253136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:50.253136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:50.253136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:50.253136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:17:50.253136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:17:50.253136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:17:50.253136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:17:50.254248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:17:50.254248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:17:50.254248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:17:50.254248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:17:50.254248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:50.254248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:50.254248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:50.254248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:50.254248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:50.254248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:50.254248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:50.254248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:50.254248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:50.254248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:50.254248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:50.254248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:50.255153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:50.255153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:50.255153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:50.255153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:50.255153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:17:50.255153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:17:50.255153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:17:50.255153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:17:50.255153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:17:50.255153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:17:50.255153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 02:17:50.255153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:50.255153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 543/1075] 10.222.0.64 () {56 vars in 1120 bytes} [Mon Jul 18 02:17:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:50.261045 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd3b41-3951-40db-81c6-a53d9bba0481 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:50.279865 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:50.364127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffd3b41-3951-40db-81c6-a53d9bba0481 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:50.398405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8e1ae-8de4-4dd9-b36e-2f0ec90be5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:50.398998 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8e1ae-8de4-4dd9-b36e-2f0ec90be5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:50.399281 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8e1ae-8de4-4dd9-b36e-2f0ec90be5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:50.399558 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8e1ae-8de4-4dd9-b36e-2f0ec90be5f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:50.400304 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8e1ae-8de4-4dd9-b36e-2f0ec90be5f8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:50.400616 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8e1ae-8de4-4dd9-b36e-2f0ec90be5f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:50.402024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8e1ae-8de4-4dd9-b36e-2f0ec90be5f8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:50.414672 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 533/1076] 10.222.0.64 () {56 vars in 1115 bytes} [Mon Jul 18 02:17:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:50.416268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1791d-a2ff-4ccd-be9e-abe46775e2c2 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:50.481976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:50.517680 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1791d-a2ff-4ccd-be9e-abe46775e2c2 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:50.552537 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d3f18-eb62-4b76-8ef7-ec49acb9bb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:50.553876 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d3f18-eb62-4b76-8ef7-ec49acb9bb01 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:50.554164 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d3f18-eb62-4b76-8ef7-ec49acb9bb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:50.554439 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d3f18-eb62-4b76-8ef7-ec49acb9bb01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:50.565016 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d3f18-eb62-4b76-8ef7-ec49acb9bb01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:50.566485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d3f18-eb62-4b76-8ef7-ec49acb9bb01 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:50.584004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-673d3f18-eb62-4b76-8ef7-ec49acb9bb01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:50.584004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:50.584004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:50.584004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:50.584004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:50.584004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:50.584004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:50.584004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:50.584004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:50.584004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:50.584004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:50.584004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:50.584004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:50.584004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:50.584004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:50.584956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:50.584956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:50.584956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:50.584956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:50.584956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:50.584956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:50.584956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:50.584956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:50.584956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:50.584956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:50.584956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:50.584956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:50.584956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:50.584956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:50.584956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:50.584956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:50.584956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:50.590702 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:50.590702 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:50.590702 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:50.590702 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:50.590702 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 544/1077] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:50.592568 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8e1ae-8de4-4dd9-b36e-2f0ec90be5f8 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:50.669102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:50.692620 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8e1ae-8de4-4dd9-b36e-2f0ec90be5f8 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:50.726824 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271d6f6-6e8c-4c1c-8c21-901e56f9c0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:50.727493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271d6f6-6e8c-4c1c-8c21-901e56f9c0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:50.727779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271d6f6-6e8c-4c1c-8c21-901e56f9c0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:50.728056 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271d6f6-6e8c-4c1c-8c21-901e56f9c0b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:50.728772 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271d6f6-6e8c-4c1c-8c21-901e56f9c0b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:50.729081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271d6f6-6e8c-4c1c-8c21-901e56f9c0b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:50.730476 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271d6f6-6e8c-4c1c-8c21-901e56f9c0b8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:50.748179 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 534/1078] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:50.749827 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d3f18-eb62-4b76-8ef7-ec49acb9bb01 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:50.852523 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d3f18-eb62-4b76-8ef7-ec49acb9bb01 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:50.870013 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:50.886881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30413f4-343c-4820-83bb-e20357eeb475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:50.887686 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30413f4-343c-4820-83bb-e20357eeb475 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:50.887972 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30413f4-343c-4820-83bb-e20357eeb475 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:50.888253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30413f4-343c-4820-83bb-e20357eeb475 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:50.895845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30413f4-343c-4820-83bb-e20357eeb475 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:50.897514 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30413f4-343c-4820-83bb-e20357eeb475 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:50.911581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-b30413f4-343c-4820-83bb-e20357eeb475 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 02:17:50.911581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:50.911581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:50.911581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:50.911581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:50.911581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:50.911581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:50.911581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:50.911581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:50.911581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:50.911581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:50.911581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:50.911581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:17:50.911581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:17:50.911581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:17:50.911581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:17:50.912511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:50.912511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:50.912511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:17:50.912511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:50.912511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:17:50.912511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:17:50.912511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:50.912511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:50.912511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:50.912511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:50.912511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:50.912511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:50.912511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:50.912511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:50.912511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:50.912511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:50.912511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:50.912511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:50.914037 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:50.914037 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:50.914037 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:17:50.914037 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:17:50.914037 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:17:50.914037 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:17:50.914037 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:17:50.914037 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:17:50.914037 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 02:17:50.914037 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:50.914037 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 545/1079] 10.222.0.64 () {56 vars in 1093 bytes} [Mon Jul 18 02:17:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:50.920618 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271d6f6-6e8c-4c1c-8c21-901e56f9c0b8 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:51.023441 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271d6f6-6e8c-4c1c-8c21-901e56f9c0b8 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:51.057892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c891979-a57b-4c5f-8a25-b97a050f9141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:51.058631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c891979-a57b-4c5f-8a25-b97a050f9141 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:51.058923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c891979-a57b-4c5f-8a25-b97a050f9141 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:51.059204 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c891979-a57b-4c5f-8a25-b97a050f9141 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:51.060039 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c891979-a57b-4c5f-8a25-b97a050f9141 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:51.060348 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c891979-a57b-4c5f-8a25-b97a050f9141 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:51.061889 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c891979-a57b-4c5f-8a25-b97a050f9141 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:51.064504 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:51.085568 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 535/1080] 10.222.0.64 () {56 vars in 1133 bytes} [Mon Jul 18 02:17:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:51.086809 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30413f4-343c-4820-83bb-e20357eeb475 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:51.179773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2d91c-dfe6-47d5-8ec8-30c924897da9 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:51.179994 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2d91c-dfe6-47d5-8ec8-30c924897da9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:51.180248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa2d91c-dfe6-47d5-8ec8-30c924897da9 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:51.181858 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 536/1081] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:51.187551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e21b7-edfd-4b8d-beaa-c0fc5f76cb06 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:51.187901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e21b7-edfd-4b8d-beaa-c0fc5f76cb06 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:51.188130 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e21b7-edfd-4b8d-beaa-c0fc5f76cb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:51.197799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30413f4-343c-4820-83bb-e20357eeb475 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:51.206169 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9c1e21b7-edfd-4b8d-beaa-c0fc5f76cb06 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:51.207745 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9c1e21b7-edfd-4b8d-beaa-c0fc5f76cb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:51.233921 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf3482-8cd4-4689-8802-e7d8fc3f7b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:51.234578 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf3482-8cd4-4689-8802-e7d8fc3f7b6a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:51.234886 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf3482-8cd4-4689-8802-e7d8fc3f7b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:51.235151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf3482-8cd4-4689-8802-e7d8fc3f7b6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:51.276778 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 537/1082] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 02:17:51.283288 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:51.300062 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e21b7-edfd-4b8d-beaa-c0fc5f76cb06 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:51.305387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf3482-8cd4-4689-8802-e7d8fc3f7b6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:51.306959 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf3482-8cd4-4689-8802-e7d8fc3f7b6a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:51.410375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 546/1083] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:17:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 02:17:51.411665 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e21b7-edfd-4b8d-beaa-c0fc5f76cb06 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:51.415976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf3482-8cd4-4689-8802-e7d8fc3f7b6a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:51.437107 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:51.449634 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2951648-ef4e-4a48-baa0-2553871af708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:51.450513 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2951648-ef4e-4a48-baa0-2553871af708 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:51.450965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2951648-ef4e-4a48-baa0-2553871af708 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:51.451246 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2951648-ef4e-4a48-baa0-2553871af708 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:51.494729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:51.518166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf3482-8cd4-4689-8802-e7d8fc3f7b6a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:51.523835 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2951648-ef4e-4a48-baa0-2553871af708 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:51.525507 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2951648-ef4e-4a48-baa0-2553871af708 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:51.554254 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c214b0e-0fc0-41f3-82a1-086ddcda5b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:51.555059 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c214b0e-0fc0-41f3-82a1-086ddcda5b95 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:51.555349 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c214b0e-0fc0-41f3-82a1-086ddcda5b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:51.555629 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c214b0e-0fc0-41f3-82a1-086ddcda5b95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:51.565825 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c214b0e-0fc0-41f3-82a1-086ddcda5b95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:51.567266 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c214b0e-0fc0-41f3-82a1-086ddcda5b95 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:51.587144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-4c214b0e-0fc0-41f3-82a1-086ddcda5b95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:51.587144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:51.587144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:51.587144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:51.587144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:51.587144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:51.587144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:51.587144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:51.587144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:51.587144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:51.587144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:51.587144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:51.587144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:51.587144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:51.587144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:51.588065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:51.588065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:51.588065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:51.588065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:51.588065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:51.588065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:51.588065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:51.588065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:51.588065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:51.588065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:51.588065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:51.588065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:51.588065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:51.588065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:51.588065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:51.588065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:51.588065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:51.589352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:51.589352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:51.589352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:51.589352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:51.589352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 547/1084] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:17:51.593902 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c214b0e-0fc0-41f3-82a1-086ddcda5b95 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:51.634933 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 538/1085] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:17:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 02:17:51.640265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2951648-ef4e-4a48-baa0-2553871af708 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:51.665981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:51.700736 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c214b0e-0fc0-41f3-82a1-086ddcda5b95 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:51.731974 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:51.738644 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d660e0-e801-48cb-919e-935e4c717f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:51.739310 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d660e0-e801-48cb-919e-935e4c717f6e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:51.739602 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d660e0-e801-48cb-919e-935e4c717f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:51.739884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d660e0-e801-48cb-919e-935e4c717f6e None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:51.740763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d660e0-e801-48cb-919e-935e4c717f6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:51.741190 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d660e0-e801-48cb-919e-935e4c717f6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:51.742584 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d660e0-e801-48cb-919e-935e4c717f6e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:51.743793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2951648-ef4e-4a48-baa0-2553871af708 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:51.760027 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 548/1086] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:51.760722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d660e0-e801-48cb-919e-935e4c717f6e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:51.780736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70826c49-d73e-405d-ba38-4b7a86f2f80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:51.781543 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70826c49-d73e-405d-ba38-4b7a86f2f80a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:51.781861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70826c49-d73e-405d-ba38-4b7a86f2f80a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:51.782140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70826c49-d73e-405d-ba38-4b7a86f2f80a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:51.792380 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70826c49-d73e-405d-ba38-4b7a86f2f80a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:51.793875 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70826c49-d73e-405d-ba38-4b7a86f2f80a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:51.811598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-70826c49-d73e-405d-ba38-4b7a86f2f80a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:51.811598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:51.811598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:51.811598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:51.811598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:51.811598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:51.811598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:51.811598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:51.811598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:51.811598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:51.811598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:51.811598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:51.811598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:17:51.811598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:17:51.811598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:17:51.812943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:17:51.812943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:51.812943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:51.812943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:51.812943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:51.812943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:51.812943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:51.812943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:51.812943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:51.812943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:51.812943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:51.812943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:51.812943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:51.812943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:51.812943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:51.812943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:51.812943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:51.813897 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:17:51.813897 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:17:51.813897 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:17:51.813897 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:51.813897 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 539/1087] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:51.819530 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70826c49-d73e-405d-ba38-4b7a86f2f80a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:51.875127 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d660e0-e801-48cb-919e-935e4c717f6e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:51.899439 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:51.915282 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb321545-d762-4948-a221-cd788c45b8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:51.916090 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb321545-d762-4948-a221-cd788c45b8bb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:51.916373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb321545-d762-4948-a221-cd788c45b8bb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:51.916648 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb321545-d762-4948-a221-cd788c45b8bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:51.924181 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb321545-d762-4948-a221-cd788c45b8bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:51.925628 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb321545-d762-4948-a221-cd788c45b8bb None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:51.927366 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70826c49-d73e-405d-ba38-4b7a86f2f80a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:51.940653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-bb321545-d762-4948-a221-cd788c45b8bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:51.940653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:51.940653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:51.940653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:51.940653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:51.940653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:51.940653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:51.940653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:51.940653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:51.940653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:51.940653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:51.940653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:51.940653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:17:51.940653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:17:51.940653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:17:51.941582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:17:51.941582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:51.941582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:51.941582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:51.941582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:51.941582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:51.941582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:51.941582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:51.941582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:51.941582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:51.941582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:51.941582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:51.941582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:51.941582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:51.941582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:51.941582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:51.941582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:51.942568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:17:51.942568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:17:51.942568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:17:51.942568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:17:51.942568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:17:51.942568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:17:51.942568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:17:51.942568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:51.946155 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 549/1088] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:17:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:51.947797 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb321545-d762-4948-a221-cd788c45b8bb None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:51.971025 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d3dc6-b5d2-4888-87cf-33b68ea451ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:51.972153 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d3dc6-b5d2-4888-87cf-33b68ea451ed None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:51.972442 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d3dc6-b5d2-4888-87cf-33b68ea451ed None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:51.973009 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d3dc6-b5d2-4888-87cf-33b68ea451ed None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:51.973762 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d3dc6-b5d2-4888-87cf-33b68ea451ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:51.974332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d3dc6-b5d2-4888-87cf-33b68ea451ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:51.976991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d3dc6-b5d2-4888-87cf-33b68ea451ed None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:51.990444 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 540/1089] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:52.014196 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:52.071190 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb321545-d762-4948-a221-cd788c45b8bb None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:52.106316 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac076fb4-23e8-4829-a736-a2885a0ede5f None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:52.106635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac076fb4-23e8-4829-a736-a2885a0ede5f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:52.106878 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac076fb4-23e8-4829-a736-a2885a0ede5f None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:52.108441 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 541/1090] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:17:52.109025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced811a5-2cd7-44f0-ac9d-d57f42bc8a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:52.109733 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced811a5-2cd7-44f0-ac9d-d57f42bc8a22 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:52.110021 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced811a5-2cd7-44f0-ac9d-d57f42bc8a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:52.110299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced811a5-2cd7-44f0-ac9d-d57f42bc8a22 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:52.111106 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced811a5-2cd7-44f0-ac9d-d57f42bc8a22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:52.111422 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced811a5-2cd7-44f0-ac9d-d57f42bc8a22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:52.112888 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced811a5-2cd7-44f0-ac9d-d57f42bc8a22 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:52.114119 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f7091-28b0-4a0d-acf0-700e4f5612b1 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:52.114414 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f7091-28b0-4a0d-acf0-700e4f5612b1 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:52.114692 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f7091-28b0-4a0d-acf0-700e4f5612b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:52.132182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 550/1091] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:17:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:52.132415 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-057f7091-28b0-4a0d-acf0-700e4f5612b1 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:52.136302 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced811a5-2cd7-44f0-ac9d-d57f42bc8a22 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:52.136477 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-057f7091-28b0-4a0d-acf0-700e4f5612b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:52.228701 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 542/1092] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 02:17:52.250228 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced811a5-2cd7-44f0-ac9d-d57f42bc8a22 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:52.251496 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f7091-28b0-4a0d-acf0-700e4f5612b1 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:52.262334 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:52.288310 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8133d-467c-416e-aaff-d3cae954fc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:52.288976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8133d-467c-416e-aaff-d3cae954fc96 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:52.289322 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8133d-467c-416e-aaff-d3cae954fc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:52.289600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8133d-467c-416e-aaff-d3cae954fc96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:52.290529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8133d-467c-416e-aaff-d3cae954fc96 None admin] RBAC: Adding query filter params (role.id=77405dcb2b214a28a22b24a17ed1f66e, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=6f51aae36f0b42868567840fa957ffe9) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:52.290841 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8133d-467c-416e-aaff-d3cae954fc96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:52.292270 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8133d-467c-416e-aaff-d3cae954fc96 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:52.298782 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 551/1093] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:17:52 2022] GET /identity/v3/role_assignments?user.id=6f51aae36f0b42868567840fa957ffe9&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=77405dcb2b214a28a22b24a17ed1f66e => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:52.331883 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:52.368969 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f7091-28b0-4a0d-acf0-700e4f5612b1 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:52.404226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355473c-7ea1-4e04-a9c4-2298d21fa7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:52.405042 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355473c-7ea1-4e04-a9c4-2298d21fa7ce None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:52.405329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355473c-7ea1-4e04-a9c4-2298d21fa7ce None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:52.405608 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355473c-7ea1-4e04-a9c4-2298d21fa7ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:52.417429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355473c-7ea1-4e04-a9c4-2298d21fa7ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:17:52.425552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-c355473c-7ea1-4e04-a9c4-2298d21fa7ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:17:52.425552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:52.425552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:52.425552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:52.425552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:52.425552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:52.425552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:52.425552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:52.425552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:52.425552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:52.425552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:52.425552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:52.425552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:17:52.425552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:17:52.425552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:17:52.425552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:17:52.426524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:17:52.426524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:17:52.426524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:17:52.426524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:17:52.426524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:52.426524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:52.426524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:52.426524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:52.426524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:52.426524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:52.426524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:52.426524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:52.426524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:52.426524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:52.426524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:52.426524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:52.427365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:52.427365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:52.427365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:52.427365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:52.427365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:17:52.427365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:17:52.427365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:17:52.427365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:17:52.427365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:17:52.427365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:17:52.427365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:17:52.427365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:17:52.427365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 543/1094] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:17:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:52.433881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8133d-467c-416e-aaff-d3cae954fc96 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:52.536206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8133d-467c-416e-aaff-d3cae954fc96 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:52.573190 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e9db6-55fa-4bb4-a8e7-ec48cc138051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:52.573900 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e9db6-55fa-4bb4-a8e7-ec48cc138051 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:52.574186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e9db6-55fa-4bb4-a8e7-ec48cc138051 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:52.574469 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e9db6-55fa-4bb4-a8e7-ec48cc138051 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:52.575401 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e9db6-55fa-4bb4-a8e7-ec48cc138051 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:52.575715 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e9db6-55fa-4bb4-a8e7-ec48cc138051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:52.577076 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e9db6-55fa-4bb4-a8e7-ec48cc138051 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:52.587234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 552/1095] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:17:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:17:52.593572 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355473c-7ea1-4e04-a9c4-2298d21fa7ce None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:52.699028 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355473c-7ea1-4e04-a9c4-2298d21fa7ce None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:52.724315 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:52.733007 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168603b9-30f1-4021-a2eb-74f33d561f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:52.733909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168603b9-30f1-4021-a2eb-74f33d561f72 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:52.734191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168603b9-30f1-4021-a2eb-74f33d561f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:52.749040 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168603b9-30f1-4021-a2eb-74f33d561f72 None admin] PATH_INFO: `/v3/users/10382113f56841a5b00044fc1f959c11` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:52.749040 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168603b9-30f1-4021-a2eb-74f33d561f72 None admin] RBAC: Authorizing `identity:get_user(user_id=10382113f56841a5b00044fc1f959c11)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:52.749040 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168603b9-30f1-4021-a2eb-74f33d561f72 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:52.749040 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 544/1096] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:17:52 2022] GET /identity/v3/users/10382113f56841a5b00044fc1f959c11 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:52.749825 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e9db6-55fa-4bb4-a8e7-ec48cc138051 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:52.782481 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:52.849839 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e9db6-55fa-4bb4-a8e7-ec48cc138051 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:52.892496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fde168-fa49-47ce-afd3-f2a45446041e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:52.893391 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fde168-fa49-47ce-afd3-f2a45446041e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:52.893684 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fde168-fa49-47ce-afd3-f2a45446041e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:52.893993 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fde168-fa49-47ce-afd3-f2a45446041e None admin] PATH_INFO: `/v3/projects/2417ea55144c48e99e3bd63f104b7e53` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:52.895178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fde168-fa49-47ce-afd3-f2a45446041e None admin] RBAC: Authorizing `identity:get_project(project_id=2417ea55144c48e99e3bd63f104b7e53)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:52.896615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fde168-fa49-47ce-afd3-f2a45446041e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:52.898382 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 553/1097] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:17:52 2022] GET /identity/v3/projects/2417ea55144c48e99e3bd63f104b7e53 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:52.904469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168603b9-30f1-4021-a2eb-74f33d561f72 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:53.020171 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168603b9-30f1-4021-a2eb-74f33d561f72 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:53.054901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19157d51-26fd-45f9-ad89-452a76b34fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:53.055850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19157d51-26fd-45f9-ad89-452a76b34fcd None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:53.056146 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19157d51-26fd-45f9-ad89-452a76b34fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:53.056421 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19157d51-26fd-45f9-ad89-452a76b34fcd None admin] PATH_INFO: `/v3/projects/2417ea55144c48e99e3bd63f104b7e53/users/10382113f56841a5b00044fc1f959c11/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:53.058401 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19157d51-26fd-45f9-ad89-452a76b34fcd None admin] RBAC: Authorizing `identity:create_grant(project_id=2417ea55144c48e99e3bd63f104b7e53, user_id=10382113f56841a5b00044fc1f959c11, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:53.059906 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19157d51-26fd-45f9-ad89-452a76b34fcd None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:53.152219 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 545/1098] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:17:52 2022] PUT /identity/v3/projects/2417ea55144c48e99e3bd63f104b7e53/users/10382113f56841a5b00044fc1f959c11/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:17:55.127185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a4272-47be-46f9-8474-e10dafc0a691 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:55.127715 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a4272-47be-46f9-8474-e10dafc0a691 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:55.127715 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a4272-47be-46f9-8474-e10dafc0a691 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:55.129092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 554/1099] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:55.134968 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a786cc6-1a65-4769-a541-2bae6f8cf443 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:55.135381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a786cc6-1a65-4769-a541-2bae6f8cf443 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:55.135532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a786cc6-1a65-4769-a541-2bae6f8cf443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:55.152799 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-2a786cc6-1a65-4769-a541-2bae6f8cf443 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:55.154035 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2a786cc6-1a65-4769-a541-2bae6f8cf443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:55.201889 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:55.218515 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 546/1100] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:55.241913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a4272-47be-46f9-8474-e10dafc0a691 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:55.340258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a4272-47be-46f9-8474-e10dafc0a691 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:55.342612 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:55.373134 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f777ad-7a22-41ff-bdc9-432791cd3e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:55.373940 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f777ad-7a22-41ff-bdc9-432791cd3e6e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:55.374228 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f777ad-7a22-41ff-bdc9-432791cd3e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:55.374504 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f777ad-7a22-41ff-bdc9-432791cd3e6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:55.384869 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f777ad-7a22-41ff-bdc9-432791cd3e6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:17:55.392405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-99f777ad-7a22-41ff-bdc9-432791cd3e6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:17:55.392405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:17:55.392405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:17:55.392405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:17:55.392405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:17:55.392405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:17:55.392405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:17:55.392405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:17:55.392405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:17:55.392405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:17:55.392405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:17:55.392405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:17:55.392405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:17:55.392405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:17:55.392405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:17:55.392405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:17:55.393525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:17:55.393525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:17:55.393525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:17:55.393525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:17:55.393525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:17:55.393525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:17:55.393525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:17:55.393525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:17:55.393525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:17:55.393525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:17:55.393525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:17:55.393525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:17:55.393525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:17:55.393525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:17:55.393525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:17:55.393525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:17:55.394847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:17:55.394847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:17:55.394847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:17:55.394847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:17:55.394847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:17:55.394847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:17:55.394847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:17:55.394847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:17:55.394847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:17:55.394847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:17:55.394847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:17:55.394847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:17:55.394847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 555/1101] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:17:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:17:55.400026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a786cc6-1a65-4769-a541-2bae6f8cf443 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:55.496467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a786cc6-1a65-4769-a541-2bae6f8cf443 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:55.528189 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d1691-3a1a-40ac-ae0d-a184937423eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:55.528847 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d1691-3a1a-40ac-ae0d-a184937423eb None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:55.529128 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d1691-3a1a-40ac-ae0d-a184937423eb None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:55.529402 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d1691-3a1a-40ac-ae0d-a184937423eb None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:55.530232 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d1691-3a1a-40ac-ae0d-a184937423eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:55.530567 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d1691-3a1a-40ac-ae0d-a184937423eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:55.531926 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319d1691-3a1a-40ac-ae0d-a184937423eb None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:55.540354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 547/1102] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:17:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:55.546178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f777ad-7a22-41ff-bdc9-432791cd3e6e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:55.641983 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f777ad-7a22-41ff-bdc9-432791cd3e6e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:55.674302 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8b95f-0cff-40ce-b2f9-cd46b8a3c00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:55.675153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8b95f-0cff-40ce-b2f9-cd46b8a3c00a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:55.675438 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8b95f-0cff-40ce-b2f9-cd46b8a3c00a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:55.675715 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8b95f-0cff-40ce-b2f9-cd46b8a3c00a None admin] PATH_INFO: `/v3/users/10382113f56841a5b00044fc1f959c11` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:55.676874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8b95f-0cff-40ce-b2f9-cd46b8a3c00a None admin] RBAC: Authorizing `identity:get_user(user_id=10382113f56841a5b00044fc1f959c11)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:55.678904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8b95f-0cff-40ce-b2f9-cd46b8a3c00a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:55.680493 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 556/1103] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:17:55 2022] GET /identity/v3/users/10382113f56841a5b00044fc1f959c11 => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:55.685993 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d1691-3a1a-40ac-ae0d-a184937423eb None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:55.730952 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:55.780863 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d1691-3a1a-40ac-ae0d-a184937423eb None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:55.813723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f665e2-0944-4a1f-a42b-bbe6bba934d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:55.814367 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f665e2-0944-4a1f-a42b-bbe6bba934d4 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:55.814648 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f665e2-0944-4a1f-a42b-bbe6bba934d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:55.814921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f665e2-0944-4a1f-a42b-bbe6bba934d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:55.879794 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f665e2-0944-4a1f-a42b-bbe6bba934d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:55.881271 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f665e2-0944-4a1f-a42b-bbe6bba934d4 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:55.925094 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:55.977377 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 548/1104] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:17:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 02:17:55.983366 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8b95f-0cff-40ce-b2f9-cd46b8a3c00a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:56.013589 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:56.079563 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8b95f-0cff-40ce-b2f9-cd46b8a3c00a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:56.112800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1653bb-ce70-4d3b-8ebd-7eeab5c12888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:56.113649 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1653bb-ce70-4d3b-8ebd-7eeab5c12888 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:56.113958 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1653bb-ce70-4d3b-8ebd-7eeab5c12888 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:56.114234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1653bb-ce70-4d3b-8ebd-7eeab5c12888 None admin] PATH_INFO: `/v3/projects/2417ea55144c48e99e3bd63f104b7e53` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:56.115433 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1653bb-ce70-4d3b-8ebd-7eeab5c12888 None admin] RBAC: Authorizing `identity:get_project(project_id=2417ea55144c48e99e3bd63f104b7e53)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:56.116854 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1653bb-ce70-4d3b-8ebd-7eeab5c12888 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:56.118563 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 557/1105] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:17:55 2022] GET /identity/v3/projects/2417ea55144c48e99e3bd63f104b7e53 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:56.124641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f665e2-0944-4a1f-a42b-bbe6bba934d4 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:56.220918 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f665e2-0944-4a1f-a42b-bbe6bba934d4 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:56.253020 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660b482-b80a-4bed-93e8-ae63a6c42fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:56.253671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660b482-b80a-4bed-93e8-ae63a6c42fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:56.253990 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660b482-b80a-4bed-93e8-ae63a6c42fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:56.254272 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660b482-b80a-4bed-93e8-ae63a6c42fe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:56.255096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660b482-b80a-4bed-93e8-ae63a6c42fe0 None admin] RBAC: Adding query filter params (role.id=5dfa34e7a4594751aed7c0495c9a2383, scope.project.id=2417ea55144c48e99e3bd63f104b7e53, user.id=10382113f56841a5b00044fc1f959c11) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:17:56.255411 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660b482-b80a-4bed-93e8-ae63a6c42fe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:56.257370 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660b482-b80a-4bed-93e8-ae63a6c42fe0 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:56.263121 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 549/1106] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:17:56 2022] GET /identity/v3/role_assignments?user.id=10382113f56841a5b00044fc1f959c11&scope.project.id=2417ea55144c48e99e3bd63f104b7e53&role.id=5dfa34e7a4594751aed7c0495c9a2383 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:58.250230 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b2a84-4751-4139-9fe1-f009c3bb5814 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:58.250739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b2a84-4751-4139-9fe1-f009c3bb5814 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:58.250833 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b2a84-4751-4139-9fe1-f009c3bb5814 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:58.252153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 558/1107] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:17:58.257401 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c7ff3-3650-4ab2-9873-21701c90afdf None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:58.257848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c7ff3-3650-4ab2-9873-21701c90afdf None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:58.258021 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c7ff3-3650-4ab2-9873-21701c90afdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:58.274773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-433c7ff3-3650-4ab2-9873-21701c90afdf None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:17:58.275964 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-433c7ff3-3650-4ab2-9873-21701c90afdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:17:58.278667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:58.340143 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 550/1108] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:17:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:17:58.364864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b2a84-4751-4139-9fe1-f009c3bb5814 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:58.459457 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:58.463115 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b2a84-4751-4139-9fe1-f009c3bb5814 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:58.495230 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f118d5b3-92b5-4a3c-957d-5dbf3bc26eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:58.496009 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118d5b3-92b5-4a3c-957d-5dbf3bc26eef None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:58.496293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118d5b3-92b5-4a3c-957d-5dbf3bc26eef None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:58.496571 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f118d5b3-92b5-4a3c-957d-5dbf3bc26eef None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:58.497742 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118d5b3-92b5-4a3c-957d-5dbf3bc26eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:58.499173 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f118d5b3-92b5-4a3c-957d-5dbf3bc26eef None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:58.500764 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 559/1109] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:17:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:17:58.507087 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c7ff3-3650-4ab2-9873-21701c90afdf None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:17:58.601213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c7ff3-3650-4ab2-9873-21701c90afdf None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:17:58.633249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b81bc8-7f57-44ff-a17c-6acc04c9d343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:17:58.633938 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b81bc8-7f57-44ff-a17c-6acc04c9d343 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:17:58.634222 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b81bc8-7f57-44ff-a17c-6acc04c9d343 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:17:58.634495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b81bc8-7f57-44ff-a17c-6acc04c9d343 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:17:58.635186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b81bc8-7f57-44ff-a17c-6acc04c9d343 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:17:58.636591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b81bc8-7f57-44ff-a17c-6acc04c9d343 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:17:58.646885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:17:58.742521 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 551/1110] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jul 18 02:17:58 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:18:00.804253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2257c3-9b1e-4ac9-bc5d-1a4dab9247db None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:00.804888 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2257c3-9b1e-4ac9-bc5d-1a4dab9247db None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:00.804888 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2257c3-9b1e-4ac9-bc5d-1a4dab9247db None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:00.806232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 560/1111] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:18:00.811447 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969fab2-dab1-44e3-98f1-f2f9860a5bc0 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:00.811878 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969fab2-dab1-44e3-98f1-f2f9860a5bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:00.812002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969fab2-dab1-44e3-98f1-f2f9860a5bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:00.828698 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c969fab2-dab1-44e3-98f1-f2f9860a5bc0 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:18:00.829920 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c969fab2-dab1-44e3-98f1-f2f9860a5bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:18:00.893615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 552/1112] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:18:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:18:00.916852 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2257c3-9b1e-4ac9-bc5d-1a4dab9247db None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:01.015066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2257c3-9b1e-4ac9-bc5d-1a4dab9247db None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:01.047762 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638586a-d927-413f-a4f6-6a4f047753b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:01.048591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638586a-d927-413f-a4f6-6a4f047753b4 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:01.048869 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638586a-d927-413f-a4f6-6a4f047753b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:01.049145 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d638586a-d927-413f-a4f6-6a4f047753b4 None admin] PATH_INFO: `/v3/roles/aa317d762bd64a9d864e54d074507f94` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:01.050611 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638586a-d927-413f-a4f6-6a4f047753b4 None admin] RBAC: Authorizing `identity:get_role(role_id=aa317d762bd64a9d864e54d074507f94)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:01.051955 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d638586a-d927-413f-a4f6-6a4f047753b4 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:01.053812 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 561/1113] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:18:00 2022] GET /identity/v3/roles/aa317d762bd64a9d864e54d074507f94 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:01.059503 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969fab2-dab1-44e3-98f1-f2f9860a5bc0 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:01.157017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969fab2-dab1-44e3-98f1-f2f9860a5bc0 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:01.182208 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:01.190653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70abfd-5f59-4c30-87dc-e15b5141247c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:01.201587 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70abfd-5f59-4c30-87dc-e15b5141247c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:01.201587 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70abfd-5f59-4c30-87dc-e15b5141247c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:01.201587 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a70abfd-5f59-4c30-87dc-e15b5141247c None admin] PATH_INFO: `/v3/users/48b148bd646749848572a50ea1d26f41` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:01.205162 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70abfd-5f59-4c30-87dc-e15b5141247c None admin] RBAC: Authorizing `identity:get_user(user_id=48b148bd646749848572a50ea1d26f41)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:01.206635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a70abfd-5f59-4c30-87dc-e15b5141247c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:01.208279 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 553/1114] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:18:01 2022] GET /identity/v3/users/48b148bd646749848572a50ea1d26f41 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:01.214093 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638586a-d927-413f-a4f6-6a4f047753b4 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:01.247960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:01.311466 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d638586a-d927-413f-a4f6-6a4f047753b4 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:01.344164 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57205277-8491-4d20-b254-51f02fcd7f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:01.344803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57205277-8491-4d20-b254-51f02fcd7f3c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:01.345091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57205277-8491-4d20-b254-51f02fcd7f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:01.345373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57205277-8491-4d20-b254-51f02fcd7f3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:01.409821 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57205277-8491-4d20-b254-51f02fcd7f3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:01.411267 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57205277-8491-4d20-b254-51f02fcd7f3c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:01.444119 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:01.506484 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 562/1115] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:18:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 02:18:01.512353 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70abfd-5f59-4c30-87dc-e15b5141247c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:01.616432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a70abfd-5f59-4c30-87dc-e15b5141247c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:01.649549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafa004-2679-415a-8301-926ed275eaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:01.650435 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafa004-2679-415a-8301-926ed275eaf3 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:01.650722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafa004-2679-415a-8301-926ed275eaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:01.651000 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafa004-2679-415a-8301-926ed275eaf3 None admin] PATH_INFO: `/v3/projects/2417ea55144c48e99e3bd63f104b7e53` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:01.652166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafa004-2679-415a-8301-926ed275eaf3 None admin] RBAC: Authorizing `identity:get_project(project_id=2417ea55144c48e99e3bd63f104b7e53)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:01.653591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafa004-2679-415a-8301-926ed275eaf3 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:01.655315 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 554/1116] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:18:01 2022] GET /identity/v3/projects/2417ea55144c48e99e3bd63f104b7e53 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:01.661451 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57205277-8491-4d20-b254-51f02fcd7f3c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:01.757766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57205277-8491-4d20-b254-51f02fcd7f3c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:01.789148 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd5c99-4973-4ef8-8423-191c553b0b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:01.789815 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd5c99-4973-4ef8-8423-191c553b0b7f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:01.790102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd5c99-4973-4ef8-8423-191c553b0b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:01.790379 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd5c99-4973-4ef8-8423-191c553b0b7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:01.791193 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd5c99-4973-4ef8-8423-191c553b0b7f None admin] RBAC: Adding query filter params (role.id=aa317d762bd64a9d864e54d074507f94, scope.project.id=2417ea55144c48e99e3bd63f104b7e53, user.id=48b148bd646749848572a50ea1d26f41) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:18:01.791505 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd5c99-4973-4ef8-8423-191c553b0b7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:01.792912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd5c99-4973-4ef8-8423-191c553b0b7f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:01.795757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:01.798813 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 563/1117] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:18:01 2022] GET /identity/v3/role_assignments?user.id=48b148bd646749848572a50ea1d26f41&scope.project.id=2417ea55144c48e99e3bd63f104b7e53&role.id=aa317d762bd64a9d864e54d074507f94 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:03.774815 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30229e-57c3-4b03-bf5c-2cd00dd1b19c None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:03.775382 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30229e-57c3-4b03-bf5c-2cd00dd1b19c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:03.775382 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30229e-57c3-4b03-bf5c-2cd00dd1b19c None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:03.776738 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 555/1118] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:18:03.781845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb2ae8-e0db-4749-add5-f5db24506311 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:03.782224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb2ae8-e0db-4749-add5-f5db24506311 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:03.782410 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb2ae8-e0db-4749-add5-f5db24506311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:03.799557 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-06bb2ae8-e0db-4749-add5-f5db24506311 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:18:03.800749 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-06bb2ae8-e0db-4749-add5-f5db24506311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:18:03.865987 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 564/1119] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:18:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:18:03.888221 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30229e-57c3-4b03-bf5c-2cd00dd1b19c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:03.940125 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:03.997103 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30229e-57c3-4b03-bf5c-2cd00dd1b19c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:04.029589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749dafc-8d5d-4e59-a075-82d6dadee1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:04.030403 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749dafc-8d5d-4e59-a075-82d6dadee1ed None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:04.030686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749dafc-8d5d-4e59-a075-82d6dadee1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:04.030961 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749dafc-8d5d-4e59-a075-82d6dadee1ed None admin] PATH_INFO: `/v3/roles/aa317d762bd64a9d864e54d074507f94` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:04.032417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749dafc-8d5d-4e59-a075-82d6dadee1ed None admin] RBAC: Authorizing `identity:get_role(role_id=aa317d762bd64a9d864e54d074507f94)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:04.033825 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749dafc-8d5d-4e59-a075-82d6dadee1ed None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:04.035199 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 556/1120] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:18:03 2022] GET /identity/v3/roles/aa317d762bd64a9d864e54d074507f94 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:04.042733 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb2ae8-e0db-4749-add5-f5db24506311 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:04.141756 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bb2ae8-e0db-4749-add5-f5db24506311 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:04.169519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:04.175449 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df947be-c1ed-40a7-9437-ba847c4c055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:04.176352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df947be-c1ed-40a7-9437-ba847c4c055b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:04.176639 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df947be-c1ed-40a7-9437-ba847c4c055b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:04.177449 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df947be-c1ed-40a7-9437-ba847c4c055b None admin] PATH_INFO: `/v3/users/48b148bd646749848572a50ea1d26f41` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:04.178673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df947be-c1ed-40a7-9437-ba847c4c055b None admin] RBAC: Authorizing `identity:get_user(user_id=48b148bd646749848572a50ea1d26f41)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:04.184184 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df947be-c1ed-40a7-9437-ba847c4c055b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:04.184184 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 565/1121] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:18:04 2022] GET /identity/v3/users/48b148bd646749848572a50ea1d26f41 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:04.188213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749dafc-8d5d-4e59-a075-82d6dadee1ed None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:04.285171 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749dafc-8d5d-4e59-a075-82d6dadee1ed None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:04.304999 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:04.318674 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085af33-9660-4969-9ed5-4ae0965a124e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:04.319554 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085af33-9660-4969-9ed5-4ae0965a124e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:04.319832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085af33-9660-4969-9ed5-4ae0965a124e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:04.320103 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085af33-9660-4969-9ed5-4ae0965a124e None admin] PATH_INFO: `/v3/projects/2417ea55144c48e99e3bd63f104b7e53` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:04.321257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085af33-9660-4969-9ed5-4ae0965a124e None admin] RBAC: Authorizing `identity:get_project(project_id=2417ea55144c48e99e3bd63f104b7e53)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:04.322718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085af33-9660-4969-9ed5-4ae0965a124e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:04.324388 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 557/1122] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:18:04 2022] GET /identity/v3/projects/2417ea55144c48e99e3bd63f104b7e53 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:04.330419 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df947be-c1ed-40a7-9437-ba847c4c055b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:04.429183 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df947be-c1ed-40a7-9437-ba847c4c055b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:04.462291 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64897397-57c1-480d-aabb-d82f45b7f4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:04.463163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64897397-57c1-480d-aabb-d82f45b7f4fa None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:04.463448 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64897397-57c1-480d-aabb-d82f45b7f4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:04.463727 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64897397-57c1-480d-aabb-d82f45b7f4fa None admin] PATH_INFO: `/v3/projects/2417ea55144c48e99e3bd63f104b7e53/users/48b148bd646749848572a50ea1d26f41/roles/aa317d762bd64a9d864e54d074507f94` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:04.465936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64897397-57c1-480d-aabb-d82f45b7f4fa None admin] RBAC: Authorizing `identity:create_grant(project_id=2417ea55144c48e99e3bd63f104b7e53, user_id=48b148bd646749848572a50ea1d26f41, role_id=aa317d762bd64a9d864e54d074507f94)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:04.467361 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64897397-57c1-480d-aabb-d82f45b7f4fa None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:04.548578 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 566/1123] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:18:04 2022] PUT /identity/v3/projects/2417ea55144c48e99e3bd63f104b7e53/users/48b148bd646749848572a50ea1d26f41/roles/aa317d762bd64a9d864e54d074507f94 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:18:06.535293 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780706e-8fd0-4bd8-9a3d-e393aaa37ec0 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:06.535825 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780706e-8fd0-4bd8-9a3d-e393aaa37ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:06.535825 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e780706e-8fd0-4bd8-9a3d-e393aaa37ec0 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:06.537684 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 558/1124] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:18:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:18:06.542935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d795f3c-ac6f-489b-b550-6e8d7819b833 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:06.543351 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d795f3c-ac6f-489b-b550-6e8d7819b833 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:06.543500 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d795f3c-ac6f-489b-b550-6e8d7819b833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:06.560066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7d795f3c-ac6f-489b-b550-6e8d7819b833 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:18:06.561256 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7d795f3c-ac6f-489b-b550-6e8d7819b833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:18:06.613157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:06.626625 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 567/1125] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:18:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:18:06.650609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780706e-8fd0-4bd8-9a3d-e393aaa37ec0 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:06.747700 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e780706e-8fd0-4bd8-9a3d-e393aaa37ec0 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:06.780756 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51bcd9-e31f-4936-a135-1ef81a116461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:06.781595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51bcd9-e31f-4936-a135-1ef81a116461 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:06.781912 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51bcd9-e31f-4936-a135-1ef81a116461 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:06.782188 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f51bcd9-e31f-4936-a135-1ef81a116461 None admin] PATH_INFO: `/v3/roles/aa317d762bd64a9d864e54d074507f94` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:06.783660 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51bcd9-e31f-4936-a135-1ef81a116461 None admin] RBAC: Authorizing `identity:get_role(role_id=aa317d762bd64a9d864e54d074507f94)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:06.785022 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f51bcd9-e31f-4936-a135-1ef81a116461 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:06.786517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 559/1126] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:18:06 2022] GET /identity/v3/roles/aa317d762bd64a9d864e54d074507f94 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:06.792270 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d795f3c-ac6f-489b-b550-6e8d7819b833 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:06.887698 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d795f3c-ac6f-489b-b550-6e8d7819b833 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:06.920172 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e268ece-05b8-432b-8b92-7efa9490495b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:06.921033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e268ece-05b8-432b-8b92-7efa9490495b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:06.921318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e268ece-05b8-432b-8b92-7efa9490495b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:06.921876 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e268ece-05b8-432b-8b92-7efa9490495b None admin] PATH_INFO: `/v3/users/48b148bd646749848572a50ea1d26f41` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:06.923046 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e268ece-05b8-432b-8b92-7efa9490495b None admin] RBAC: Authorizing `identity:get_user(user_id=48b148bd646749848572a50ea1d26f41)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:06.924458 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e268ece-05b8-432b-8b92-7efa9490495b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:06.926105 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 568/1127] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:18:06 2022] GET /identity/v3/users/48b148bd646749848572a50ea1d26f41 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:06.931623 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51bcd9-e31f-4936-a135-1ef81a116461 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:06.986055 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:07.028457 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f51bcd9-e31f-4936-a135-1ef81a116461 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:07.061293 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80199c89-4aa3-4d7d-96ba-ba29486c85a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:07.061904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80199c89-4aa3-4d7d-96ba-ba29486c85a6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:07.062192 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80199c89-4aa3-4d7d-96ba-ba29486c85a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:07.062471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80199c89-4aa3-4d7d-96ba-ba29486c85a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:07.126786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80199c89-4aa3-4d7d-96ba-ba29486c85a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:07.128232 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80199c89-4aa3-4d7d-96ba-ba29486c85a6 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:07.180855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:07.222826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 560/1128] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:18:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 02:18:07.228662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e268ece-05b8-432b-8b92-7efa9490495b None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:07.284151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:07.327474 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e268ece-05b8-432b-8b92-7efa9490495b None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:07.360749 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184a7c5-6694-41d1-8b4d-a051cbc4c484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:07.361597 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184a7c5-6694-41d1-8b4d-a051cbc4c484 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:07.361914 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184a7c5-6694-41d1-8b4d-a051cbc4c484 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:07.362197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184a7c5-6694-41d1-8b4d-a051cbc4c484 None admin] PATH_INFO: `/v3/projects/2417ea55144c48e99e3bd63f104b7e53` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:07.363367 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184a7c5-6694-41d1-8b4d-a051cbc4c484 None admin] RBAC: Authorizing `identity:get_project(project_id=2417ea55144c48e99e3bd63f104b7e53)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:07.365389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184a7c5-6694-41d1-8b4d-a051cbc4c484 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:07.367110 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 569/1129] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:18:07 2022] GET /identity/v3/projects/2417ea55144c48e99e3bd63f104b7e53 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:07.373175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80199c89-4aa3-4d7d-96ba-ba29486c85a6 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:07.466839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80199c89-4aa3-4d7d-96ba-ba29486c85a6 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:07.499657 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c95ba9-0f80-4b6a-9827-48099539d4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:07.500284 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c95ba9-0f80-4b6a-9827-48099539d4dd None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:07.500566 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c95ba9-0f80-4b6a-9827-48099539d4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:07.500839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c95ba9-0f80-4b6a-9827-48099539d4dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:07.501652 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c95ba9-0f80-4b6a-9827-48099539d4dd None admin] RBAC: Adding query filter params (role.id=aa317d762bd64a9d864e54d074507f94, scope.project.id=2417ea55144c48e99e3bd63f104b7e53, user.id=48b148bd646749848572a50ea1d26f41) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:18:07.501990 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c95ba9-0f80-4b6a-9827-48099539d4dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:07.503392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c95ba9-0f80-4b6a-9827-48099539d4dd None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:07.508976 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 561/1130] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:18:07 2022] GET /identity/v3/role_assignments?user.id=48b148bd646749848572a50ea1d26f41&scope.project.id=2417ea55144c48e99e3bd63f104b7e53&role.id=aa317d762bd64a9d864e54d074507f94 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:09.511192 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689a378-58c8-4b93-bd78-78ea3310ac1f None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:09.511685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689a378-58c8-4b93-bd78-78ea3310ac1f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:09.511685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8689a378-58c8-4b93-bd78-78ea3310ac1f None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:09.513084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 570/1131] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:18:09.518246 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53bd1a-953b-4248-a6b7-a1bc23b9edd0 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:09.518639 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53bd1a-953b-4248-a6b7-a1bc23b9edd0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:09.518799 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53bd1a-953b-4248-a6b7-a1bc23b9edd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:09.535469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-de53bd1a-953b-4248-a6b7-a1bc23b9edd0 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:18:09.537220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-de53bd1a-953b-4248-a6b7-a1bc23b9edd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:18:09.550909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:09.602622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 562/1132] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:18:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:18:09.624924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689a378-58c8-4b93-bd78-78ea3310ac1f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:09.722596 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8689a378-58c8-4b93-bd78-78ea3310ac1f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:09.744607 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:09.755253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eb683a-349d-4802-a857-f4fd7d5a58a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:09.759417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb683a-349d-4802-a857-f4fd7d5a58a3 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:09.759417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb683a-349d-4802-a857-f4fd7d5a58a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:09.759417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb683a-349d-4802-a857-f4fd7d5a58a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:09.759417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb683a-349d-4802-a857-f4fd7d5a58a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:09.759417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eb683a-349d-4802-a857-f4fd7d5a58a3 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:09.760759 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 571/1133] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:18:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:09.766483 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53bd1a-953b-4248-a6b7-a1bc23b9edd0 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:09.861507 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53bd1a-953b-4248-a6b7-a1bc23b9edd0 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:09.894509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf2f79-8d63-4d20-ba3a-06062e7e7ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:09.895218 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf2f79-8d63-4d20-ba3a-06062e7e7ce5 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:09.895503 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf2f79-8d63-4d20-ba3a-06062e7e7ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:09.895778 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf2f79-8d63-4d20-ba3a-06062e7e7ce5 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:09.896485 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf2f79-8d63-4d20-ba3a-06062e7e7ce5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:09.897922 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf2f79-8d63-4d20-ba3a-06062e7e7ce5 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:10.014640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 563/1134] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jul 18 02:18:09 2022] POST /identity/v3/projects => generated 311 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:18:12.017556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4ab63-dd44-44d8-bc25-aa0af27113c6 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:12.018133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4ab63-dd44-44d8-bc25-aa0af27113c6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:12.018133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4ab63-dd44-44d8-bc25-aa0af27113c6 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:12.019492 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 572/1135] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:18:12.025118 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180f3d9-6afb-414e-84b1-4a82430b9efe None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:12.025546 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180f3d9-6afb-414e-84b1-4a82430b9efe None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:12.025731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180f3d9-6afb-414e-84b1-4a82430b9efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:12.030795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:12.042768 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-2180f3d9-6afb-414e-84b1-4a82430b9efe None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:18:12.043962 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2180f3d9-6afb-414e-84b1-4a82430b9efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:18:12.112851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 564/1136] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:18:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:18:12.137052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4ab63-dd44-44d8-bc25-aa0af27113c6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:12.248544 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4ab63-dd44-44d8-bc25-aa0af27113c6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:12.281943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0d4e3-266a-4edf-bfe6-e68829205fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:12.282665 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0d4e3-266a-4edf-bfe6-e68829205fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:12.282947 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0d4e3-266a-4edf-bfe6-e68829205fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:12.283227 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0d4e3-266a-4edf-bfe6-e68829205fd7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:12.284369 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0d4e3-266a-4edf-bfe6-e68829205fd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:12.285842 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0d4e3-266a-4edf-bfe6-e68829205fd7 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:12.287420 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 573/1137] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:18:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:12.293344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180f3d9-6afb-414e-84b1-4a82430b9efe None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:12.389271 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180f3d9-6afb-414e-84b1-4a82430b9efe None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:12.416885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:12.421941 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c13ae3-707a-48fe-9b84-7e6d6d6516df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:12.429923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c13ae3-707a-48fe-9b84-7e6d6d6516df None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:12.429923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c13ae3-707a-48fe-9b84-7e6d6d6516df None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:12.429923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c13ae3-707a-48fe-9b84-7e6d6d6516df None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:12.429923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c13ae3-707a-48fe-9b84-7e6d6d6516df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:12.429923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c13ae3-707a-48fe-9b84-7e6d6d6516df None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:12.558269 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 565/1138] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jul 18 02:18:12 2022] POST /identity/v3/users => generated 286 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:18:14.594309 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6c6f8-73f6-4c2b-9810-d8aabc134020 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:14.594812 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6c6f8-73f6-4c2b-9810-d8aabc134020 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:14.594812 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c6c6f8-73f6-4c2b-9810-d8aabc134020 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:14.596143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 574/1139] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:18:14.601355 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a53395-19a7-41b7-9288-c01e9024f3fe None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:14.601756 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a53395-19a7-41b7-9288-c01e9024f3fe None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:14.601953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a53395-19a7-41b7-9288-c01e9024f3fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:14.618715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-67a53395-19a7-41b7-9288-c01e9024f3fe None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:18:14.619906 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-67a53395-19a7-41b7-9288-c01e9024f3fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:18:14.684909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 566/1140] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:18:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:18:14.707933 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6c6f8-73f6-4c2b-9810-d8aabc134020 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:14.766596 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:14.806108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c6c6f8-73f6-4c2b-9810-d8aabc134020 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:14.838891 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5296c2-3aa1-4f25-bff5-8159dee00376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:14.839672 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5296c2-3aa1-4f25-bff5-8159dee00376 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:14.839960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5296c2-3aa1-4f25-bff5-8159dee00376 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:14.840237 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5296c2-3aa1-4f25-bff5-8159dee00376 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:14.850665 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5296c2-3aa1-4f25-bff5-8159dee00376 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:18:14.858121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-6f5296c2-3aa1-4f25-bff5-8159dee00376 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:18:14.858121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:18:14.858121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:18:14.858121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:18:14.858121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:18:14.858121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:18:14.858121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:18:14.858121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:18:14.858121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:18:14.858121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:18:14.858121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:18:14.858121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:18:14.858121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:18:14.858121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:18:14.858121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:18:14.858121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:18:14.859278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:18:14.859278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:18:14.859278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:18:14.859278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:18:14.859278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:18:14.859278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:18:14.859278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:18:14.859278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:18:14.859278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:18:14.859278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:18:14.859278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:18:14.859278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:18:14.859278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:18:14.859278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:18:14.859278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:18:14.859278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:18:14.860257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:18:14.860257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:18:14.860257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:18:14.860257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:18:14.860257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:18:14.860257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:18:14.860257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:18:14.860257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:18:14.860257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:18:14.860257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:18:14.860257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:18:14.860257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:18:14.860257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 575/1141] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:18:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:18:14.865854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a53395-19a7-41b7-9288-c01e9024f3fe None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:14.959307 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a53395-19a7-41b7-9288-c01e9024f3fe None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:14.976026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:14.992480 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39ecac-ad8b-4356-bba9-b94d00834539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:14.993143 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39ecac-ad8b-4356-bba9-b94d00834539 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:14.993427 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39ecac-ad8b-4356-bba9-b94d00834539 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:14.993736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f39ecac-ad8b-4356-bba9-b94d00834539 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:14.994477 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39ecac-ad8b-4356-bba9-b94d00834539 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:18:14.994785 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39ecac-ad8b-4356-bba9-b94d00834539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:14.996159 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f39ecac-ad8b-4356-bba9-b94d00834539 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:15.004911 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 567/1142] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:18:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:15.011548 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5296c2-3aa1-4f25-bff5-8159dee00376 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:15.172783 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5296c2-3aa1-4f25-bff5-8159dee00376 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:15.193863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:15.207710 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172b348-3f14-441c-b5c1-d14ccdcdd104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:15.208566 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172b348-3f14-441c-b5c1-d14ccdcdd104 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:15.208848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172b348-3f14-441c-b5c1-d14ccdcdd104 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:15.209150 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9172b348-3f14-441c-b5c1-d14ccdcdd104 None admin] PATH_INFO: `/v3/users/7cf29fda299342b18335a64902c257b9` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:15.221647 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172b348-3f14-441c-b5c1-d14ccdcdd104 None admin] RBAC: Authorizing `identity:get_user(user_id=7cf29fda299342b18335a64902c257b9)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:15.223121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9172b348-3f14-441c-b5c1-d14ccdcdd104 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:15.225856 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 576/1143] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:18:15 2022] GET /identity/v3/users/7cf29fda299342b18335a64902c257b9 => generated 286 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:15.230704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39ecac-ad8b-4356-bba9-b94d00834539 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:15.327750 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f39ecac-ad8b-4356-bba9-b94d00834539 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:15.359177 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e6bd6-866f-40a8-950d-e96aab7e64c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:15.359816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e6bd6-866f-40a8-950d-e96aab7e64c7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:15.360100 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e6bd6-866f-40a8-950d-e96aab7e64c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:15.360379 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e6bd6-866f-40a8-950d-e96aab7e64c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:15.406497 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:15.424748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e6bd6-866f-40a8-950d-e96aab7e64c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:15.426701 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e6bd6-866f-40a8-950d-e96aab7e64c7 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:15.520032 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 568/1144] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:18:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 02:18:15.526010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172b348-3f14-441c-b5c1-d14ccdcdd104 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:15.621821 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9172b348-3f14-441c-b5c1-d14ccdcdd104 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:15.653686 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bb8d4-51d5-45c5-b06b-ae4aaff98478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:15.654547 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bb8d4-51d5-45c5-b06b-ae4aaff98478 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:15.654829 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bb8d4-51d5-45c5-b06b-ae4aaff98478 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:15.655102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bb8d4-51d5-45c5-b06b-ae4aaff98478 None admin] PATH_INFO: `/v3/projects/05c1759b00f5454190f169209e57902a` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:15.656248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bb8d4-51d5-45c5-b06b-ae4aaff98478 None admin] RBAC: Authorizing `identity:get_project(project_id=05c1759b00f5454190f169209e57902a)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:15.657729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bb8d4-51d5-45c5-b06b-ae4aaff98478 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:15.659349 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 577/1145] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:18:15 2022] GET /identity/v3/projects/05c1759b00f5454190f169209e57902a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:15.665920 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e6bd6-866f-40a8-950d-e96aab7e64c7 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:15.743253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:15.761172 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e6bd6-866f-40a8-950d-e96aab7e64c7 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:15.793304 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68f4f8-bad8-47a5-bdb7-78569be78b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:15.793975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68f4f8-bad8-47a5-bdb7-78569be78b9c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:15.794264 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68f4f8-bad8-47a5-bdb7-78569be78b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:15.794545 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68f4f8-bad8-47a5-bdb7-78569be78b9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:15.795374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68f4f8-bad8-47a5-bdb7-78569be78b9c None admin] RBAC: Adding query filter params (role.id=5dfa34e7a4594751aed7c0495c9a2383, scope.project.id=05c1759b00f5454190f169209e57902a, user.id=7cf29fda299342b18335a64902c257b9) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:18:15.795691 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68f4f8-bad8-47a5-bdb7-78569be78b9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:15.797378 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68f4f8-bad8-47a5-bdb7-78569be78b9c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:15.803458 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 569/1146] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:18:15 2022] GET /identity/v3/role_assignments?user.id=7cf29fda299342b18335a64902c257b9&scope.project.id=05c1759b00f5454190f169209e57902a&role.id=5dfa34e7a4594751aed7c0495c9a2383 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:17.759549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990afe13-4944-4c1c-8a3a-a074df8950e9 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:17.760154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990afe13-4944-4c1c-8a3a-a074df8950e9 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:17.760154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990afe13-4944-4c1c-8a3a-a074df8950e9 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:17.761475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 578/1147] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:18:17.766788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28dab6-1497-41dc-aee6-29845a97c88d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:17.767167 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28dab6-1497-41dc-aee6-29845a97c88d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:17.767353 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28dab6-1497-41dc-aee6-29845a97c88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:17.784286 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-1e28dab6-1497-41dc-aee6-29845a97c88d None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:18:17.786135 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1e28dab6-1497-41dc-aee6-29845a97c88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:18:17.850000 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 570/1148] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:18:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:18:17.871710 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990afe13-4944-4c1c-8a3a-a074df8950e9 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:17.919125 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:17.976096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990afe13-4944-4c1c-8a3a-a074df8950e9 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:18.025895 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73da59-3e03-4328-89b9-b8f9cff285be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:18.026623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73da59-3e03-4328-89b9-b8f9cff285be None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:18.026912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73da59-3e03-4328-89b9-b8f9cff285be None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:18.027192 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73da59-3e03-4328-89b9-b8f9cff285be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:18.037862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73da59-3e03-4328-89b9-b8f9cff285be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:18:18.045411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-ab73da59-3e03-4328-89b9-b8f9cff285be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:18:18.045411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:18:18.045411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:18:18.045411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:18:18.045411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:18:18.045411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:18:18.045411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:18:18.045411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:18:18.045411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:18:18.045411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:18:18.045411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:18:18.045411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:18:18.045411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:18:18.045411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:18:18.045411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:18:18.045411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:18:18.046848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:18:18.046848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:18:18.046848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:18:18.046848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:18:18.046848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:18:18.046848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:18:18.046848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:18:18.046848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:18:18.046848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:18:18.046848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:18:18.046848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:18:18.046848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:18:18.046848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:18:18.046848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:18:18.046848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:18:18.046848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:18:18.047913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:18:18.047913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:18:18.047913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:18:18.047913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:18:18.047913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:18:18.047913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:18:18.047913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:18:18.047913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:18:18.047913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:18:18.047913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:18:18.047913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:18:18.047913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:18:18.047913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 579/1149] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:18:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:18:18.053569 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28dab6-1497-41dc-aee6-29845a97c88d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:18.126550 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:18.150893 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28dab6-1497-41dc-aee6-29845a97c88d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:18.185305 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35d405-6308-4711-9179-5dd20969682d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:18.186006 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35d405-6308-4711-9179-5dd20969682d None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:18.186290 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35d405-6308-4711-9179-5dd20969682d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:18.186566 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f35d405-6308-4711-9179-5dd20969682d None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:18.187307 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35d405-6308-4711-9179-5dd20969682d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:18:18.187615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35d405-6308-4711-9179-5dd20969682d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:18.188984 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f35d405-6308-4711-9179-5dd20969682d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:18.196774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 571/1150] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:18:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:18.202730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73da59-3e03-4328-89b9-b8f9cff285be None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:18.306879 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73da59-3e03-4328-89b9-b8f9cff285be None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:18.313540 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:18.359701 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a76df-79f9-466f-9a3d-2e56672e2684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:18.360582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a76df-79f9-466f-9a3d-2e56672e2684 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:18.360869 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a76df-79f9-466f-9a3d-2e56672e2684 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:18.361149 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a76df-79f9-466f-9a3d-2e56672e2684 None admin] PATH_INFO: `/v3/users/7cf29fda299342b18335a64902c257b9` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:18.362356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a76df-79f9-466f-9a3d-2e56672e2684 None admin] RBAC: Authorizing `identity:get_user(user_id=7cf29fda299342b18335a64902c257b9)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:18.363819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a76df-79f9-466f-9a3d-2e56672e2684 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:18.365463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 580/1151] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:18:18 2022] GET /identity/v3/users/7cf29fda299342b18335a64902c257b9 => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:18.371627 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35d405-6308-4711-9179-5dd20969682d None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:18.468681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f35d405-6308-4711-9179-5dd20969682d None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:18.500567 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eec75b-c3af-4826-9fe0-65c420be0fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:18.501409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eec75b-c3af-4826-9fe0-65c420be0fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:18.501689 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eec75b-c3af-4826-9fe0-65c420be0fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:18.501994 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eec75b-c3af-4826-9fe0-65c420be0fa8 None admin] PATH_INFO: `/v3/projects/05c1759b00f5454190f169209e57902a` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:18.503140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eec75b-c3af-4826-9fe0-65c420be0fa8 None admin] RBAC: Authorizing `identity:get_project(project_id=05c1759b00f5454190f169209e57902a)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:18.504597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eec75b-c3af-4826-9fe0-65c420be0fa8 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:18.506306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 572/1152] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:18:18 2022] GET /identity/v3/projects/05c1759b00f5454190f169209e57902a => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:18.512524 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a76df-79f9-466f-9a3d-2e56672e2684 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:18.609051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a76df-79f9-466f-9a3d-2e56672e2684 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:18.641288 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3e9d0-2c0d-469f-87a2-a84a0e56dffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:18.642182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3e9d0-2c0d-469f-87a2-a84a0e56dffa None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:18.642468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3e9d0-2c0d-469f-87a2-a84a0e56dffa None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:18.642741 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3e9d0-2c0d-469f-87a2-a84a0e56dffa None admin] PATH_INFO: `/v3/projects/05c1759b00f5454190f169209e57902a/users/7cf29fda299342b18335a64902c257b9/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:18.645277 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3e9d0-2c0d-469f-87a2-a84a0e56dffa None admin] RBAC: Authorizing `identity:create_grant(project_id=05c1759b00f5454190f169209e57902a, user_id=7cf29fda299342b18335a64902c257b9, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:18.646708 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3e9d0-2c0d-469f-87a2-a84a0e56dffa None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:18.755572 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 581/1153] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:18:18 2022] PUT /identity/v3/projects/05c1759b00f5454190f169209e57902a/users/7cf29fda299342b18335a64902c257b9/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:18:20.739993 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c080a7f-5d8c-4764-b6c3-67d5cb780275 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:20.740512 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c080a7f-5d8c-4764-b6c3-67d5cb780275 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:20.740604 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c080a7f-5d8c-4764-b6c3-67d5cb780275 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:20.741953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 573/1154] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:18:20.747239 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938abe0b-c3ea-4276-a02f-dfada1c2540a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:20.747616 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938abe0b-c3ea-4276-a02f-dfada1c2540a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:20.747813 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938abe0b-c3ea-4276-a02f-dfada1c2540a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:20.764784 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-938abe0b-c3ea-4276-a02f-dfada1c2540a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:18:20.766019 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-938abe0b-c3ea-4276-a02f-dfada1c2540a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:18:20.791609 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:20.831971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 582/1155] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:18:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:18:20.855711 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c080a7f-5d8c-4764-b6c3-67d5cb780275 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:20.859550 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:20.955474 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c080a7f-5d8c-4764-b6c3-67d5cb780275 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:20.988433 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff0ba6-1d63-4f49-8cfb-d86ea74fae87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:20.989213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff0ba6-1d63-4f49-8cfb-d86ea74fae87 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:20.989500 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff0ba6-1d63-4f49-8cfb-d86ea74fae87 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:20.989806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ff0ba6-1d63-4f49-8cfb-d86ea74fae87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:21.000058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ff0ba6-1d63-4f49-8cfb-d86ea74fae87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:18:21.007603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-69ff0ba6-1d63-4f49-8cfb-d86ea74fae87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:18:21.007603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:18:21.007603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:18:21.007603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:18:21.007603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:18:21.007603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:18:21.007603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:18:21.007603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:18:21.007603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:18:21.007603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:18:21.007603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:18:21.007603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:18:21.007603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:18:21.007603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:18:21.007603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:18:21.007603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:18:21.008667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:18:21.008667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:18:21.008667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:18:21.008667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:18:21.008667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:18:21.008667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:18:21.008667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:18:21.008667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:18:21.008667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:18:21.008667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:18:21.008667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:18:21.008667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:18:21.008667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:18:21.008667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:18:21.008667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:18:21.008667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:18:21.009547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:18:21.009547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:18:21.009547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:18:21.009547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:18:21.009547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:18:21.009547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:18:21.009547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:18:21.009547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:18:21.009547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:18:21.009547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:18:21.009547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:18:21.009547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:18:21.009547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 574/1156] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:18:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:18:21.014974 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938abe0b-c3ea-4276-a02f-dfada1c2540a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:21.110889 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938abe0b-c3ea-4276-a02f-dfada1c2540a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:21.144071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3f452-0901-445a-ba3a-2d0edad7e476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:21.144744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3f452-0901-445a-ba3a-2d0edad7e476 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:21.145031 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3f452-0901-445a-ba3a-2d0edad7e476 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:21.145310 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3f452-0901-445a-ba3a-2d0edad7e476 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:21.146087 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3f452-0901-445a-ba3a-2d0edad7e476 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:18:21.146397 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3f452-0901-445a-ba3a-2d0edad7e476 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:21.147759 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3f452-0901-445a-ba3a-2d0edad7e476 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:21.155937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 583/1157] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:18:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:21.162403 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff0ba6-1d63-4f49-8cfb-d86ea74fae87 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:21.223016 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:21.258688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ff0ba6-1d63-4f49-8cfb-d86ea74fae87 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:21.292439 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb0e0b-d7b7-480b-87b0-0b34462dbc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:21.293299 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb0e0b-d7b7-480b-87b0-0b34462dbc6e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:21.293583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb0e0b-d7b7-480b-87b0-0b34462dbc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:21.293893 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eb0e0b-d7b7-480b-87b0-0b34462dbc6e None admin] PATH_INFO: `/v3/users/7cf29fda299342b18335a64902c257b9` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:21.295066 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb0e0b-d7b7-480b-87b0-0b34462dbc6e None admin] RBAC: Authorizing `identity:get_user(user_id=7cf29fda299342b18335a64902c257b9)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:21.296743 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eb0e0b-d7b7-480b-87b0-0b34462dbc6e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:21.298408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 575/1158] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:18:21 2022] GET /identity/v3/users/7cf29fda299342b18335a64902c257b9 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:21.304179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3f452-0901-445a-ba3a-2d0edad7e476 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:21.331072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:21.401303 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3f452-0901-445a-ba3a-2d0edad7e476 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:21.434318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ea103-0e3d-4b28-9be9-5c2723e801bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:21.434962 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ea103-0e3d-4b28-9be9-5c2723e801bb None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:21.435249 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ea103-0e3d-4b28-9be9-5c2723e801bb None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:21.435528 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ea103-0e3d-4b28-9be9-5c2723e801bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:21.500139 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ea103-0e3d-4b28-9be9-5c2723e801bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:21.501578 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ea103-0e3d-4b28-9be9-5c2723e801bb None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:21.527356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:21.596741 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 584/1159] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:18:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 02:18:21.603361 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb0e0b-d7b7-480b-87b0-0b34462dbc6e None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:21.698396 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eb0e0b-d7b7-480b-87b0-0b34462dbc6e None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:21.726890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:21.731651 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4564d21-54a0-4f29-8bd4-ca10ef0eef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:21.732489 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4564d21-54a0-4f29-8bd4-ca10ef0eef33 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:21.732773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4564d21-54a0-4f29-8bd4-ca10ef0eef33 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:21.733046 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4564d21-54a0-4f29-8bd4-ca10ef0eef33 None admin] PATH_INFO: `/v3/projects/05c1759b00f5454190f169209e57902a` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:21.734237 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4564d21-54a0-4f29-8bd4-ca10ef0eef33 None admin] RBAC: Authorizing `identity:get_project(project_id=05c1759b00f5454190f169209e57902a)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:21.735659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4564d21-54a0-4f29-8bd4-ca10ef0eef33 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:21.737316 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 576/1160] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:18:21 2022] GET /identity/v3/projects/05c1759b00f5454190f169209e57902a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:21.743986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ea103-0e3d-4b28-9be9-5c2723e801bb None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:21.839188 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ea103-0e3d-4b28-9be9-5c2723e801bb None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:21.864098 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:21.872376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93293e0f-5eea-4ef2-85f4-2955bef5ec60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:21.880342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93293e0f-5eea-4ef2-85f4-2955bef5ec60 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:21.880342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93293e0f-5eea-4ef2-85f4-2955bef5ec60 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:21.880342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93293e0f-5eea-4ef2-85f4-2955bef5ec60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:21.880342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93293e0f-5eea-4ef2-85f4-2955bef5ec60 None admin] RBAC: Adding query filter params (role.id=5dfa34e7a4594751aed7c0495c9a2383, scope.project.id=05c1759b00f5454190f169209e57902a, user.id=7cf29fda299342b18335a64902c257b9) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:18:21.880342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93293e0f-5eea-4ef2-85f4-2955bef5ec60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:21.880342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93293e0f-5eea-4ef2-85f4-2955bef5ec60 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:21.881718 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 585/1161] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:18:21 2022] GET /identity/v3/role_assignments?user.id=7cf29fda299342b18335a64902c257b9&scope.project.id=05c1759b00f5454190f169209e57902a&role.id=5dfa34e7a4594751aed7c0495c9a2383 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:23.875537 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83b3c1-21be-49ea-b981-682c44d058c7 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:23.876089 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83b3c1-21be-49ea-b981-682c44d058c7 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:23.876089 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83b3c1-21be-49ea-b981-682c44d058c7 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:23.877457 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 577/1162] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:18:23.883235 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e9de7-6eef-431e-951f-23a8ee18b0e8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:23.883600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e9de7-6eef-431e-951f-23a8ee18b0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:23.883790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e9de7-6eef-431e-951f-23a8ee18b0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:23.900752 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1f8e9de7-6eef-431e-951f-23a8ee18b0e8 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:18:23.902042 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1f8e9de7-6eef-431e-951f-23a8ee18b0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:18:23.966437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 586/1163] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:18:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:18:23.988042 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83b3c1-21be-49ea-b981-682c44d058c7 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:24.094531 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83b3c1-21be-49ea-b981-682c44d058c7 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:24.129005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ccda7-f2d1-4a82-a28b-1130a8260511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:24.129597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ccda7-f2d1-4a82-a28b-1130a8260511 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:24.129914 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ccda7-f2d1-4a82-a28b-1130a8260511 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:24.130195 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ccda7-f2d1-4a82-a28b-1130a8260511 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:24.193628 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:24.195834 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ccda7-f2d1-4a82-a28b-1130a8260511 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:24.197286 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ccda7-f2d1-4a82-a28b-1130a8260511 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:24.296103 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 578/1164] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:18:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 02:18:24.303312 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e9de7-6eef-431e-951f-23a8ee18b0e8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:24.400621 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e9de7-6eef-431e-951f-23a8ee18b0e8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:24.420260 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:24.434535 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13334337-60f2-40de-ab52-f91a8b58d304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:24.435345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13334337-60f2-40de-ab52-f91a8b58d304 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:24.435633 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13334337-60f2-40de-ab52-f91a8b58d304 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:24.435914 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13334337-60f2-40de-ab52-f91a8b58d304 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:24.443075 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13334337-60f2-40de-ab52-f91a8b58d304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:24.444519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13334337-60f2-40de-ab52-f91a8b58d304 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:24.459590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-13334337-60f2-40de-ab52-f91a8b58d304 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 18 02:18:24.459590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:18:24.459590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 18 02:18:24.459590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 18 02:18:24.459590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:18:24.459590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:18:24.459590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:18:24.459590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:18:24.459590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 18 02:18:24.459590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:18:24.459590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:18:24.459590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:18:24.459590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:18:24.459590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:18:24.459590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:18:24.459590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:18:24.459590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:18:24.460753 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:18:24.460753 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:18:24.460753 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:18:24.460753 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:18:24.460753 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:18:24.460753 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:18:24.460753 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:18:24.460753 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:18:24.460753 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:18:24.460753 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:18:24.460753 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:18:24.460753 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:18:24.460753 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:18:24.460753 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:18:24.460753 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:18:24.460753 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:18:24.462034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:18:24.462034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:18:24.462034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:18:24.462034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:18:24.462034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:18:24.462034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:18:24.462034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:18:24.462034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:18:24.462034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:18:24.462034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:18:24.462034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 18 02:18:24.462034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:18:24.462034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 18 02:18:24.462034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:18:24.462034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 587/1165] 10.222.0.64 () {56 vars in 1117 bytes} [Mon Jul 18 02:18:24 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:18:24.466899 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ccda7-f2d1-4a82-a28b-1130a8260511 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:24.560477 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:24.563345 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ccda7-f2d1-4a82-a28b-1130a8260511 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:24.595762 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec8d0d-c699-4258-85ca-41e53c26ab8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:24.596447 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec8d0d-c699-4258-85ca-41e53c26ab8c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:24.597258 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec8d0d-c699-4258-85ca-41e53c26ab8c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:24.597537 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec8d0d-c699-4258-85ca-41e53c26ab8c None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:24.598281 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec8d0d-c699-4258-85ca-41e53c26ab8c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:18:24.598590 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec8d0d-c699-4258-85ca-41e53c26ab8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:24.599946 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec8d0d-c699-4258-85ca-41e53c26ab8c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:24.606802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 579/1166] 10.222.0.64 () {56 vars in 1115 bytes} [Mon Jul 18 02:18:24 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:26.620610 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376f6fb-fbbf-4c42-be66-35fbf89b8448 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:26.621145 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376f6fb-fbbf-4c42-be66-35fbf89b8448 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:26.621145 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376f6fb-fbbf-4c42-be66-35fbf89b8448 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:26.622578 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 588/1167] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:18:26.627968 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03a621-a856-4aac-83dd-23db03d0dc5b None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:26.628378 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03a621-a856-4aac-83dd-23db03d0dc5b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:26.628523 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03a621-a856-4aac-83dd-23db03d0dc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:26.645227 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0c03a621-a856-4aac-83dd-23db03d0dc5b None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:18:26.646447 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0c03a621-a856-4aac-83dd-23db03d0dc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:18:26.710417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 580/1168] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:18:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:18:26.732806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376f6fb-fbbf-4c42-be66-35fbf89b8448 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:26.830571 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376f6fb-fbbf-4c42-be66-35fbf89b8448 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:26.864065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c44dd4-e587-4a35-b1dc-5c4eb621ec1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:26.864711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c44dd4-e587-4a35-b1dc-5c4eb621ec1e None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:26.865001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c44dd4-e587-4a35-b1dc-5c4eb621ec1e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:26.865280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c44dd4-e587-4a35-b1dc-5c4eb621ec1e None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:26.866055 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c44dd4-e587-4a35-b1dc-5c4eb621ec1e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:26.867416 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c44dd4-e587-4a35-b1dc-5c4eb621ec1e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:26.958371 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 589/1169] 10.222.0.64 () {60 vars in 1138 bytes} [Mon Jul 18 02:18:26 2022] POST /identity/v3/domains => generated 267 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:18:28.974549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4898a82-f15c-4a1c-8723-30517976d684 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:28.975100 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4898a82-f15c-4a1c-8723-30517976d684 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:28.975100 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4898a82-f15c-4a1c-8723-30517976d684 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:28.976473 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 581/1170] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:18:28.981798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcf925-1138-43db-accf-6fb4132e498c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:28.982234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcf925-1138-43db-accf-6fb4132e498c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:28.982360 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcf925-1138-43db-accf-6fb4132e498c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:28.999153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b1bcf925-1138-43db-accf-6fb4132e498c None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:18:29.000338 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b1bcf925-1138-43db-accf-6fb4132e498c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:18:29.033624 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:29.066705 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 590/1171] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:18:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 02:18:29.089187 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4898a82-f15c-4a1c-8723-30517976d684 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:29.182491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:29.190005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4898a82-f15c-4a1c-8723-30517976d684 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:29.222741 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d25c72-84f7-4f0e-b69a-d1bd08afa98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:29.223594 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d25c72-84f7-4f0e-b69a-d1bd08afa98a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:29.223878 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d25c72-84f7-4f0e-b69a-d1bd08afa98a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:29.224154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d25c72-84f7-4f0e-b69a-d1bd08afa98a None admin] PATH_INFO: `/v3/domains/4032a0a5c0be4c1f90e3ec36c781f965` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:29.234294 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d25c72-84f7-4f0e-b69a-d1bd08afa98a None admin] RBAC: Authorizing `identity:get_domain(domain_id=4032a0a5c0be4c1f90e3ec36c781f965)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:29.235677 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d25c72-84f7-4f0e-b69a-d1bd08afa98a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:29.237934 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 582/1172] 10.222.0.64 () {56 vars in 1183 bytes} [Mon Jul 18 02:18:29 2022] GET /identity/v3/domains/4032a0a5c0be4c1f90e3ec36c781f965 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:29.243832 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcf925-1138-43db-accf-6fb4132e498c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:29.339119 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcf925-1138-43db-accf-6fb4132e498c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:29.372144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba040aa3-127f-46b9-95bf-8d4ce00026fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:29.372803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba040aa3-127f-46b9-95bf-8d4ce00026fd None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:29.373085 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba040aa3-127f-46b9-95bf-8d4ce00026fd None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:29.373361 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba040aa3-127f-46b9-95bf-8d4ce00026fd None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:29.374083 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba040aa3-127f-46b9-95bf-8d4ce00026fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:29.375498 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba040aa3-127f-46b9-95bf-8d4ce00026fd None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:29.457834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 591/1173] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jul 18 02:18:29 2022] POST /identity/v3/projects => generated 361 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:18:31.480776 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b02fea-ea22-46a5-80d0-a7def90534f4 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:31.481371 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b02fea-ea22-46a5-80d0-a7def90534f4 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:31.481371 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b02fea-ea22-46a5-80d0-a7def90534f4 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:31.482661 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 583/1174] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:18:31.487996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918e0b4-03fe-4403-8e7e-49e1eb7e94dd None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:31.488417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918e0b4-03fe-4403-8e7e-49e1eb7e94dd None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:31.488550 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918e0b4-03fe-4403-8e7e-49e1eb7e94dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:31.505414 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-9918e0b4-03fe-4403-8e7e-49e1eb7e94dd None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:18:31.506646 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9918e0b4-03fe-4403-8e7e-49e1eb7e94dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:18:31.523564 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:31.572088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 592/1175] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:18:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:18:31.596885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b02fea-ea22-46a5-80d0-a7def90534f4 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:31.694966 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b02fea-ea22-46a5-80d0-a7def90534f4 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:31.727065 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80ab34-3231-4db4-b450-14db1f02a15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:31.727921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80ab34-3231-4db4-b450-14db1f02a15f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:31.728206 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80ab34-3231-4db4-b450-14db1f02a15f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:31.728483 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80ab34-3231-4db4-b450-14db1f02a15f None admin] PATH_INFO: `/v3/domains/4032a0a5c0be4c1f90e3ec36c781f965` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:31.729723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80ab34-3231-4db4-b450-14db1f02a15f None admin] RBAC: Authorizing `identity:get_domain(domain_id=4032a0a5c0be4c1f90e3ec36c781f965)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:31.731205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80ab34-3231-4db4-b450-14db1f02a15f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:31.732763 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 584/1176] 10.222.0.64 () {56 vars in 1183 bytes} [Mon Jul 18 02:18:31 2022] GET /identity/v3/domains/4032a0a5c0be4c1f90e3ec36c781f965 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:31.738907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918e0b4-03fe-4403-8e7e-49e1eb7e94dd None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:31.834678 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918e0b4-03fe-4403-8e7e-49e1eb7e94dd None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:31.867213 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e8f5f-5eea-471e-8093-cfb155e9129c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:31.867887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e8f5f-5eea-471e-8093-cfb155e9129c None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:31.868176 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e8f5f-5eea-471e-8093-cfb155e9129c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:31.868459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e8f5f-5eea-471e-8093-cfb155e9129c None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:31.869175 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e8f5f-5eea-471e-8093-cfb155e9129c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:31.870647 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e8f5f-5eea-471e-8093-cfb155e9129c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:31.976143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 593/1177] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jul 18 02:18:31 2022] POST /identity/v3/users => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:18:34.046162 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a0369-6c0f-4dbe-8770-d77488aa74f0 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:34.046722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a0369-6c0f-4dbe-8770-d77488aa74f0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:34.046722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a0369-6c0f-4dbe-8770-d77488aa74f0 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:34.048077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 585/1178] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:18:34.053399 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcfdd5-f26c-44a6-8f19-b9bc54f5ff70 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:34.053858 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcfdd5-f26c-44a6-8f19-b9bc54f5ff70 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:34.053991 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddcfdd5-f26c-44a6-8f19-b9bc54f5ff70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:34.070395 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7ddcfdd5-f26c-44a6-8f19-b9bc54f5ff70 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:18:34.072309 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7ddcfdd5-f26c-44a6-8f19-b9bc54f5ff70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:18:34.073491 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:34.138275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 594/1179] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:18:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:18:34.162015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a0369-6c0f-4dbe-8770-d77488aa74f0 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:34.186303 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:34.259626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a0369-6c0f-4dbe-8770-d77488aa74f0 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:34.292021 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8076ec0-8e49-4960-b8ea-d6f760bfae18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:34.292801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8076ec0-8e49-4960-b8ea-d6f760bfae18 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:34.293084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8076ec0-8e49-4960-b8ea-d6f760bfae18 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:34.293358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8076ec0-8e49-4960-b8ea-d6f760bfae18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:34.304070 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8076ec0-8e49-4960-b8ea-d6f760bfae18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:18:34.311782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-b8076ec0-8e49-4960-b8ea-d6f760bfae18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:18:34.311782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:18:34.311782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:18:34.311782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:18:34.311782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:18:34.311782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:18:34.311782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:18:34.311782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:18:34.311782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:18:34.311782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:18:34.311782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:18:34.311782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:18:34.311782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:18:34.311782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:18:34.311782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:18:34.311782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:18:34.312956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:18:34.312956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:18:34.312956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:18:34.312956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:18:34.312956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:18:34.312956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:18:34.312956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:18:34.312956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:18:34.312956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:18:34.312956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:18:34.312956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:18:34.312956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:18:34.312956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:18:34.312956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:18:34.312956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:18:34.312956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:18:34.313953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:18:34.313953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:18:34.313953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:18:34.313953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:18:34.313953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:18:34.313953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:18:34.313953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:18:34.313953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:18:34.313953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:18:34.313953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:18:34.313953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:18:34.313953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:18:34.313953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 586/1180] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:18:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:18:34.319352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddcfdd5-f26c-44a6-8f19-b9bc54f5ff70 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:34.415720 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddcfdd5-f26c-44a6-8f19-b9bc54f5ff70 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:34.451052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a110d-0ee3-4ef2-931f-ea40ff70f3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:34.451713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a110d-0ee3-4ef2-931f-ea40ff70f3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:34.452001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a110d-0ee3-4ef2-931f-ea40ff70f3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:34.452282 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a110d-0ee3-4ef2-931f-ea40ff70f3d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:34.453018 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a110d-0ee3-4ef2-931f-ea40ff70f3d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:18:34.453329 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a110d-0ee3-4ef2-931f-ea40ff70f3d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:34.454723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a110d-0ee3-4ef2-931f-ea40ff70f3d8 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:34.460119 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:34.463402 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 595/1181] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:18:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:34.469345 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8076ec0-8e49-4960-b8ea-d6f760bfae18 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:34.547577 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:34.565439 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8076ec0-8e49-4960-b8ea-d6f760bfae18 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:34.599085 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734c237-b831-4e10-b6d9-e0c290028833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:34.599940 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734c237-b831-4e10-b6d9-e0c290028833 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:34.600224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734c237-b831-4e10-b6d9-e0c290028833 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:34.600499 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734c237-b831-4e10-b6d9-e0c290028833 None admin] PATH_INFO: `/v3/users/8449e142d88840088796d22af2a4a7a4` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:34.613066 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734c237-b831-4e10-b6d9-e0c290028833 None admin] RBAC: Authorizing `identity:get_user(user_id=8449e142d88840088796d22af2a4a7a4)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:34.614532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734c237-b831-4e10-b6d9-e0c290028833 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:34.616160 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 587/1182] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:18:34 2022] GET /identity/v3/users/8449e142d88840088796d22af2a4a7a4 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:34.621872 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a110d-0ee3-4ef2-931f-ea40ff70f3d8 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:34.719853 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a110d-0ee3-4ef2-931f-ea40ff70f3d8 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:34.752576 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aec62a-82b8-4233-8702-cdf824796ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:34.753209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aec62a-82b8-4233-8702-cdf824796ede None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:34.753493 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aec62a-82b8-4233-8702-cdf824796ede None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:34.753798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aec62a-82b8-4233-8702-cdf824796ede None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:34.816193 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:34.818458 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aec62a-82b8-4233-8702-cdf824796ede None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:34.819902 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aec62a-82b8-4233-8702-cdf824796ede None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:34.915738 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 596/1183] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:18:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 02:18:34.921950 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734c237-b831-4e10-b6d9-e0c290028833 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:35.018263 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734c237-b831-4e10-b6d9-e0c290028833 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:35.051428 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fac43e-30b0-4c4a-86f8-40d86652ed45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:35.052276 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fac43e-30b0-4c4a-86f8-40d86652ed45 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:35.052562 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fac43e-30b0-4c4a-86f8-40d86652ed45 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:35.052840 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fac43e-30b0-4c4a-86f8-40d86652ed45 None admin] PATH_INFO: `/v3/projects/f8f2ad9d85e94190a8744d2c7ac05b56` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:35.054032 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fac43e-30b0-4c4a-86f8-40d86652ed45 None admin] RBAC: Authorizing `identity:get_project(project_id=f8f2ad9d85e94190a8744d2c7ac05b56)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:35.055461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fac43e-30b0-4c4a-86f8-40d86652ed45 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:35.057141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 588/1184] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:18:34 2022] GET /identity/v3/projects/f8f2ad9d85e94190a8744d2c7ac05b56 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:35.063219 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aec62a-82b8-4233-8702-cdf824796ede None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:35.162469 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:35.165425 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aec62a-82b8-4233-8702-cdf824796ede None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:35.198665 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fddb3-8f16-430d-aa0e-f26255230e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:35.199310 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fddb3-8f16-430d-aa0e-f26255230e70 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:35.199599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fddb3-8f16-430d-aa0e-f26255230e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:35.199878 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fddb3-8f16-430d-aa0e-f26255230e70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:35.200693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fddb3-8f16-430d-aa0e-f26255230e70 None admin] RBAC: Adding query filter params (role.id=5dfa34e7a4594751aed7c0495c9a2383, scope.project.id=f8f2ad9d85e94190a8744d2c7ac05b56, user.id=8449e142d88840088796d22af2a4a7a4) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:18:35.201004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fddb3-8f16-430d-aa0e-f26255230e70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:35.202448 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fddb3-8f16-430d-aa0e-f26255230e70 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:35.208059 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 597/1185] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:18:35 2022] GET /identity/v3/role_assignments?user.id=8449e142d88840088796d22af2a4a7a4&scope.project.id=f8f2ad9d85e94190a8744d2c7ac05b56&role.id=5dfa34e7a4594751aed7c0495c9a2383 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:37.160248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948bd16-5994-4cd7-85a1-3b9916de24b5 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:37.160709 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948bd16-5994-4cd7-85a1-3b9916de24b5 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:37.160816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f948bd16-5994-4cd7-85a1-3b9916de24b5 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:37.162202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 589/1186] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:18:37.167504 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7228af5-7ae2-4aeb-97fa-e6c32cdcd36d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:37.167911 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7228af5-7ae2-4aeb-97fa-e6c32cdcd36d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:37.168065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7228af5-7ae2-4aeb-97fa-e6c32cdcd36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:37.185099 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a7228af5-7ae2-4aeb-97fa-e6c32cdcd36d None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:18:37.186307 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a7228af5-7ae2-4aeb-97fa-e6c32cdcd36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:18:37.250435 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 598/1187] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:18:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:18:37.273247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948bd16-5994-4cd7-85a1-3b9916de24b5 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:37.283826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:37.370823 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f948bd16-5994-4cd7-85a1-3b9916de24b5 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:37.405628 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e46885-9fd1-4a88-9edf-bea815322a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:37.406376 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e46885-9fd1-4a88-9edf-bea815322a37 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:37.406661 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e46885-9fd1-4a88-9edf-bea815322a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:37.406937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e46885-9fd1-4a88-9edf-bea815322a37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:37.416674 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e46885-9fd1-4a88-9edf-bea815322a37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:18:37.424597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-99e46885-9fd1-4a88-9edf-bea815322a37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:18:37.424597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:18:37.424597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:18:37.424597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:18:37.424597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:18:37.424597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:18:37.424597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:18:37.424597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:18:37.424597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:18:37.424597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:18:37.424597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:18:37.424597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:18:37.424597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:18:37.424597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:18:37.424597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:18:37.424597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:18:37.425694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:18:37.425694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:18:37.425694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:18:37.425694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:18:37.425694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:18:37.425694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:18:37.425694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:18:37.425694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:18:37.425694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:18:37.425694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:18:37.425694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:18:37.425694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:18:37.425694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:18:37.425694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:18:37.425694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:18:37.425694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:18:37.426696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:18:37.426696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:18:37.426696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:18:37.426696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:18:37.426696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:18:37.426696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:18:37.426696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:18:37.426696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:18:37.426696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:18:37.426696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:18:37.426696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:18:37.426696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:18:37.426696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 590/1188] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:18:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:18:37.431766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7228af5-7ae2-4aeb-97fa-e6c32cdcd36d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:37.521166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:37.527584 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7228af5-7ae2-4aeb-97fa-e6c32cdcd36d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:37.560261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ddbaa-426a-4393-9d30-8991a106ef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:37.560920 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ddbaa-426a-4393-9d30-8991a106ef3a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:37.561208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ddbaa-426a-4393-9d30-8991a106ef3a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:37.561491 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ddbaa-426a-4393-9d30-8991a106ef3a None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:37.562261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ddbaa-426a-4393-9d30-8991a106ef3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:18:37.562574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ddbaa-426a-4393-9d30-8991a106ef3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:37.564459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ddbaa-426a-4393-9d30-8991a106ef3a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:37.572280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 599/1189] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:18:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:37.577866 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e46885-9fd1-4a88-9edf-bea815322a37 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:37.642358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:37.675321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e46885-9fd1-4a88-9edf-bea815322a37 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:37.707871 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a454056-89a1-4e33-8685-45f588216cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:37.708732 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a454056-89a1-4e33-8685-45f588216cda None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:37.709020 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a454056-89a1-4e33-8685-45f588216cda None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:37.709301 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a454056-89a1-4e33-8685-45f588216cda None admin] PATH_INFO: `/v3/users/8449e142d88840088796d22af2a4a7a4` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:37.710496 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a454056-89a1-4e33-8685-45f588216cda None admin] RBAC: Authorizing `identity:get_user(user_id=8449e142d88840088796d22af2a4a7a4)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:37.711927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a454056-89a1-4e33-8685-45f588216cda None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:37.713572 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 591/1190] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:18:37 2022] GET /identity/v3/users/8449e142d88840088796d22af2a4a7a4 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:37.719126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ddbaa-426a-4393-9d30-8991a106ef3a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:37.815531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ddbaa-426a-4393-9d30-8991a106ef3a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:37.848619 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7686b819-cf8d-4a11-bd37-71b7e735e253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:37.849470 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686b819-cf8d-4a11-bd37-71b7e735e253 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:37.849787 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686b819-cf8d-4a11-bd37-71b7e735e253 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:37.850071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7686b819-cf8d-4a11-bd37-71b7e735e253 None admin] PATH_INFO: `/v3/projects/f8f2ad9d85e94190a8744d2c7ac05b56` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:37.851235 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686b819-cf8d-4a11-bd37-71b7e735e253 None admin] RBAC: Authorizing `identity:get_project(project_id=f8f2ad9d85e94190a8744d2c7ac05b56)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:37.852669 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7686b819-cf8d-4a11-bd37-71b7e735e253 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:37.854393 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 600/1191] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:18:37 2022] GET /identity/v3/projects/f8f2ad9d85e94190a8744d2c7ac05b56 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:37.860372 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a454056-89a1-4e33-8685-45f588216cda None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:37.957104 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a454056-89a1-4e33-8685-45f588216cda None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:37.989265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71e80b3-7ab9-4cde-97e5-9f8228b8378d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:37.990171 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e80b3-7ab9-4cde-97e5-9f8228b8378d None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:37.990460 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e80b3-7ab9-4cde-97e5-9f8228b8378d None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:37.990741 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71e80b3-7ab9-4cde-97e5-9f8228b8378d None admin] PATH_INFO: `/v3/projects/f8f2ad9d85e94190a8744d2c7ac05b56/users/8449e142d88840088796d22af2a4a7a4/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:37.992688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e80b3-7ab9-4cde-97e5-9f8228b8378d None admin] RBAC: Authorizing `identity:create_grant(project_id=f8f2ad9d85e94190a8744d2c7ac05b56, user_id=8449e142d88840088796d22af2a4a7a4, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:37.994213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71e80b3-7ab9-4cde-97e5-9f8228b8378d None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:37.997156 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:38.136332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 592/1192] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:18:37 2022] PUT /identity/v3/projects/f8f2ad9d85e94190a8744d2c7ac05b56/users/8449e142d88840088796d22af2a4a7a4/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:18:40.146900 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839907bb-7672-471b-b3bf-415667164fee None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:40.147303 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839907bb-7672-471b-b3bf-415667164fee None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:40.147468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839907bb-7672-471b-b3bf-415667164fee None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:40.148867 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 601/1193] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:18:40.154745 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f23104-d1f9-4bd6-b610-023d8c94de8e None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:40.155453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f23104-d1f9-4bd6-b610-023d8c94de8e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:40.155453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f23104-d1f9-4bd6-b610-023d8c94de8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:40.173629 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-35f23104-d1f9-4bd6-b610-023d8c94de8e None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:18:40.174886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-35f23104-d1f9-4bd6-b610-023d8c94de8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:18:40.240363 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 593/1194] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:18:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:18:40.263392 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839907bb-7672-471b-b3bf-415667164fee None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:40.290432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:40.364790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839907bb-7672-471b-b3bf-415667164fee None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:40.399455 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a29b7-39b2-44b3-b305-5c7d1a4a256e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:40.400171 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a29b7-39b2-44b3-b305-5c7d1a4a256e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:40.400456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a29b7-39b2-44b3-b305-5c7d1a4a256e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:40.400733 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4a29b7-39b2-44b3-b305-5c7d1a4a256e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:40.410721 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4a29b7-39b2-44b3-b305-5c7d1a4a256e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:18:40.418372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-1f4a29b7-39b2-44b3-b305-5c7d1a4a256e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:18:40.418372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:18:40.418372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:18:40.418372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:18:40.418372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:18:40.418372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:18:40.418372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:18:40.418372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:18:40.418372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:18:40.418372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:18:40.418372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:18:40.418372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:18:40.418372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:18:40.418372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:18:40.418372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:18:40.418372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:18:40.419751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:18:40.419751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:18:40.419751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:18:40.419751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:18:40.419751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:18:40.419751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:18:40.419751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:18:40.419751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:18:40.419751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:18:40.419751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:18:40.419751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:18:40.419751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:18:40.419751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:18:40.419751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:18:40.419751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:18:40.419751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:18:40.420819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:18:40.420819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:18:40.420819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:18:40.420819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:18:40.420819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:18:40.420819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:18:40.420819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:18:40.420819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:18:40.420819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:18:40.420819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:18:40.420819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:18:40.420819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:18:40.420819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 602/1195] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:18:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:18:40.425985 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f23104-d1f9-4bd6-b610-023d8c94de8e None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:40.523213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f23104-d1f9-4bd6-b610-023d8c94de8e None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:40.547505 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:40.555810 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568a3a4-63da-4411-8d91-087ad32485fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:40.556473 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568a3a4-63da-4411-8d91-087ad32485fd None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:40.556757 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568a3a4-63da-4411-8d91-087ad32485fd None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:40.557034 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568a3a4-63da-4411-8d91-087ad32485fd None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:40.557802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568a3a4-63da-4411-8d91-087ad32485fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:18:40.561627 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568a3a4-63da-4411-8d91-087ad32485fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:40.561627 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568a3a4-63da-4411-8d91-087ad32485fd None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:40.567633 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 594/1196] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:18:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:40.573434 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a29b7-39b2-44b3-b305-5c7d1a4a256e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:40.654960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:40.670128 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4a29b7-39b2-44b3-b305-5c7d1a4a256e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:40.702957 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde3b8f-a04d-4123-9899-f0d2c2796425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:40.703816 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde3b8f-a04d-4123-9899-f0d2c2796425 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:40.704142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde3b8f-a04d-4123-9899-f0d2c2796425 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:40.704918 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dde3b8f-a04d-4123-9899-f0d2c2796425 None admin] PATH_INFO: `/v3/users/8449e142d88840088796d22af2a4a7a4` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:40.706124 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde3b8f-a04d-4123-9899-f0d2c2796425 None admin] RBAC: Authorizing `identity:get_user(user_id=8449e142d88840088796d22af2a4a7a4)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:40.707555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dde3b8f-a04d-4123-9899-f0d2c2796425 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:40.709167 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 603/1197] 10.222.0.64 () {56 vars in 1177 bytes} [Mon Jul 18 02:18:40 2022] GET /identity/v3/users/8449e142d88840088796d22af2a4a7a4 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:40.714837 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568a3a4-63da-4411-8d91-087ad32485fd None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:40.811375 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568a3a4-63da-4411-8d91-087ad32485fd None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:40.843631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf9fa9-e1f1-49d0-a158-b4a265e37ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:40.844269 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf9fa9-e1f1-49d0-a158-b4a265e37ddc None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:40.844555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf9fa9-e1f1-49d0-a158-b4a265e37ddc None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:40.844862 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf9fa9-e1f1-49d0-a158-b4a265e37ddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:40.901848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:40.916141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf9fa9-e1f1-49d0-a158-b4a265e37ddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:40.916141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf9fa9-e1f1-49d0-a158-b4a265e37ddc None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:41.009609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 595/1198] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:18:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 02:18:41.015475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde3b8f-a04d-4123-9899-f0d2c2796425 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:41.112893 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dde3b8f-a04d-4123-9899-f0d2c2796425 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:41.146698 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb745176-d198-47fc-a25e-2ed902eb7404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:41.147561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb745176-d198-47fc-a25e-2ed902eb7404 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:41.148100 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb745176-d198-47fc-a25e-2ed902eb7404 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:41.148100 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb745176-d198-47fc-a25e-2ed902eb7404 None admin] PATH_INFO: `/v3/projects/f8f2ad9d85e94190a8744d2c7ac05b56` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:41.149279 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb745176-d198-47fc-a25e-2ed902eb7404 None admin] RBAC: Authorizing `identity:get_project(project_id=f8f2ad9d85e94190a8744d2c7ac05b56)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:41.150735 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb745176-d198-47fc-a25e-2ed902eb7404 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:41.152433 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 604/1199] 10.222.0.64 () {56 vars in 1186 bytes} [Mon Jul 18 02:18:41 2022] GET /identity/v3/projects/f8f2ad9d85e94190a8744d2c7ac05b56 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:41.158477 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf9fa9-e1f1-49d0-a158-b4a265e37ddc None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:18:41.243903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:41.255895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf9fa9-e1f1-49d0-a158-b4a265e37ddc None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:18:41.288611 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28bb901-20bc-4833-8724-328218bdd6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:18:41.289259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bb901-20bc-4833-8724-328218bdd6bb None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:18:41.289542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bb901-20bc-4833-8724-328218bdd6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:18:41.289916 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28bb901-20bc-4833-8724-328218bdd6bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:18:41.290781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28bb901-20bc-4833-8724-328218bdd6bb None admin] RBAC: Adding query filter params (role.id=5dfa34e7a4594751aed7c0495c9a2383, scope.project.id=f8f2ad9d85e94190a8744d2c7ac05b56, user.id=8449e142d88840088796d22af2a4a7a4) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:18:41.291094 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28bb901-20bc-4833-8724-328218bdd6bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:18:41.292519 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28bb901-20bc-4833-8724-328218bdd6bb None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:18:41.298445 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 596/1200] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:18:41 2022] GET /identity/v3/role_assignments?user.id=8449e142d88840088796d22af2a4a7a4&scope.project.id=f8f2ad9d85e94190a8744d2c7ac05b56&role.id=5dfa34e7a4594751aed7c0495c9a2383 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:18:51.141935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=90 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:18:51.295870 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=24 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:58.463452 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a83544-27cd-47e9-b124-fa1795b0ff65 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:19:58.464001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a83544-27cd-47e9-b124-fa1795b0ff65 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:19:58.464001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a83544-27cd-47e9-b124-fa1795b0ff65 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:19:58.465325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 605/1201] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:19:58.470483 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f25600-b9c3-4a2a-ba21-5051407aa3df None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:19:58.470881 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f25600-b9c3-4a2a-ba21-5051407aa3df None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:19:58.471051 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f25600-b9c3-4a2a-ba21-5051407aa3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:19:58.488081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b8f25600-b9c3-4a2a-ba21-5051407aa3df None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:19:58.489268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b8f25600-b9c3-4a2a-ba21-5051407aa3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:19:58.554596 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 597/1202] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:19:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:19:58.578481 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a83544-27cd-47e9-b124-fa1795b0ff65 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:19:58.699003 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a83544-27cd-47e9-b124-fa1795b0ff65 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:19:58.733561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cb0f3-92c2-4db9-a81e-9a3397b6444e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:19:58.734313 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cb0f3-92c2-4db9-a81e-9a3397b6444e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:19:58.734596 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cb0f3-92c2-4db9-a81e-9a3397b6444e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:19:58.734873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cb0f3-92c2-4db9-a81e-9a3397b6444e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:19:58.744889 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cb0f3-92c2-4db9-a81e-9a3397b6444e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:19:58.746376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cb0f3-92c2-4db9-a81e-9a3397b6444e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:19:58.764144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-749cb0f3-92c2-4db9-a81e-9a3397b6444e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:19:58.764144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:19:58.764144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:19:58.764144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:19:58.764144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:19:58.764144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:19:58.764144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:19:58.764144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:19:58.764144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:19:58.764144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:19:58.764144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:19:58.764144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:19:58.764144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:19:58.764144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:19:58.764144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:19:58.768415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:19:58.768415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:19:58.768415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:19:58.768415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:19:58.768415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:19:58.768415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:19:58.768415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:19:58.768415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:19:58.768415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:19:58.768415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:19:58.768415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:19:58.768415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:19:58.768415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:19:58.768415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:19:58.768415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:19:58.768415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:19:58.768415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:19:58.769611 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:19:58.769611 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:19:58.769611 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:19:58.769611 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:19:58.769611 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 606/1203] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:19:58.772328 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f25600-b9c3-4a2a-ba21-5051407aa3df None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:19:58.868686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f25600-b9c3-4a2a-ba21-5051407aa3df None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:19:58.897789 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:58.903498 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416a847-c0b1-4bcb-b628-772e32f59426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:19:58.904985 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416a847-c0b1-4bcb-b628-772e32f59426 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:19:58.904985 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416a847-c0b1-4bcb-b628-772e32f59426 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:19:58.904985 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416a847-c0b1-4bcb-b628-772e32f59426 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:19:58.905472 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416a847-c0b1-4bcb-b628-772e32f59426 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:19:58.905820 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416a847-c0b1-4bcb-b628-772e32f59426 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:19:58.907193 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416a847-c0b1-4bcb-b628-772e32f59426 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:19:58.918437 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 598/1204] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:19:58.924229 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cb0f3-92c2-4db9-a81e-9a3397b6444e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:19:58.976859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:19:59.040169 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cb0f3-92c2-4db9-a81e-9a3397b6444e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:19:59.075110 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da6b26-97a7-4004-87cf-b979b9ae2eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:19:59.075819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da6b26-97a7-4004-87cf-b979b9ae2eda None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:19:59.076094 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da6b26-97a7-4004-87cf-b979b9ae2eda None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:19:59.076364 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da6b26-97a7-4004-87cf-b979b9ae2eda None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:19:59.077064 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da6b26-97a7-4004-87cf-b979b9ae2eda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:19:59.078508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da6b26-97a7-4004-87cf-b979b9ae2eda None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:19:59.191822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 607/1205] 10.222.0.64 () {60 vars in 1132 bytes} [Mon Jul 18 02:19:58 2022] POST /identity/v3/users => generated 251 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:20:01.236199 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bc9ac-2fed-4a0b-a112-3403caa7dc2c None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:01.236723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bc9ac-2fed-4a0b-a112-3403caa7dc2c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:01.236723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bc9ac-2fed-4a0b-a112-3403caa7dc2c None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:01.238171 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 599/1206] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:20:01.243531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da713425-0718-40ca-add4-cb93331906ee None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:01.246413 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da713425-0718-40ca-add4-cb93331906ee None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:01.246413 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da713425-0718-40ca-add4-cb93331906ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:01.261432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-da713425-0718-40ca-add4-cb93331906ee None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:20:01.262672 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-da713425-0718-40ca-add4-cb93331906ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:20:01.327934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 608/1207] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:20:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:20:01.351448 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bc9ac-2fed-4a0b-a112-3403caa7dc2c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:01.454354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bc9ac-2fed-4a0b-a112-3403caa7dc2c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:01.486745 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585e468-fdf3-4204-bcd1-6714bede27ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:01.487587 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585e468-fdf3-4204-bcd1-6714bede27ac None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:01.487874 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585e468-fdf3-4204-bcd1-6714bede27ac None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:01.488149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585e468-fdf3-4204-bcd1-6714bede27ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:01.499064 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5585e468-fdf3-4204-bcd1-6714bede27ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:20:01.507369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-5585e468-fdf3-4204-bcd1-6714bede27ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:20:01.507369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:01.507369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:01.507369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:01.507369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:01.507369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:01.507369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:01.507369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:01.507369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:01.507369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:01.507369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:01.507369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:01.507369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:20:01.507369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:20:01.507369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:20:01.507369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:20:01.509002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:20:01.509002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:20:01.509002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:20:01.509002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:20:01.509002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:01.509002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:01.509002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:01.509002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:01.509002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:01.509002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:01.509002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:01.509002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:01.509002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:01.509002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:01.509002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:01.509002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:01.509930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:01.509930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:01.509930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:01.509930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:01.509930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:20:01.509930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:20:01.509930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:20:01.509930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:20:01.509930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:20:01.509930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:20:01.509930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:20:01.509930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:01.509930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 600/1208] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:20:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:01.514674 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da713425-0718-40ca-add4-cb93331906ee None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:01.554490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:01.611460 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da713425-0718-40ca-add4-cb93331906ee None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:01.644814 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5e918-b6d9-4e28-b60d-230367562ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:01.645503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5e918-b6d9-4e28-b60d-230367562ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:01.645827 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5e918-b6d9-4e28-b60d-230367562ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:01.646108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5e918-b6d9-4e28-b60d-230367562ec3 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:01.646853 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5e918-b6d9-4e28-b60d-230367562ec3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:01.647162 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5e918-b6d9-4e28-b60d-230367562ec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:01.648525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5e918-b6d9-4e28-b60d-230367562ec3 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:01.656166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 609/1209] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jul 18 02:20:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:01.662067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585e468-fdf3-4204-bcd1-6714bede27ac None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:01.711491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:01.762413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5585e468-fdf3-4204-bcd1-6714bede27ac None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:01.796306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162717de-3acd-4d77-ac1d-69f0e36e14e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:01.797097 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162717de-3acd-4d77-ac1d-69f0e36e14e7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:01.797421 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162717de-3acd-4d77-ac1d-69f0e36e14e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:01.797663 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162717de-3acd-4d77-ac1d-69f0e36e14e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:01.808179 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162717de-3acd-4d77-ac1d-69f0e36e14e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:01.809657 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162717de-3acd-4d77-ac1d-69f0e36e14e7 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:01.826749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-162717de-3acd-4d77-ac1d-69f0e36e14e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:01.826749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:01.826749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:01.826749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:01.826749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:01.826749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:01.826749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:01.826749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:01.826749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:01.826749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:01.826749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:01.826749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:01.826749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:20:01.826749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:20:01.826749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:20:01.836919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:20:01.836919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:01.836919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:01.836919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:01.836919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:01.836919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:01.836919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:01.836919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:01.836919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:01.836919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:01.836919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:01.836919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:01.836919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:01.836919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:01.836919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:01.836919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:01.836919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:01.838069 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:20:01.838069 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:20:01.838069 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:01.838069 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:01.838069 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 601/1210] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:20:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:01.838415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5e918-b6d9-4e28-b60d-230367562ec3 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:01.929395 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:01.932282 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5e918-b6d9-4e28-b60d-230367562ec3 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:01.964166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49168d3e-0e3d-4602-b043-ed33a569395c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:01.964754 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49168d3e-0e3d-4602-b043-ed33a569395c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:01.965043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49168d3e-0e3d-4602-b043-ed33a569395c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:01.965322 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49168d3e-0e3d-4602-b043-ed33a569395c None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:01.966070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49168d3e-0e3d-4602-b043-ed33a569395c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:01.966378 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49168d3e-0e3d-4602-b043-ed33a569395c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:01.967735 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49168d3e-0e3d-4602-b043-ed33a569395c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:01.979073 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 610/1211] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:01.984723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162717de-3acd-4d77-ac1d-69f0e36e14e7 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:02.082297 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162717de-3acd-4d77-ac1d-69f0e36e14e7 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:02.083883 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:02.115680 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0a977-6dc9-4ab6-b143-d7bc7e3be077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:02.116475 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0a977-6dc9-4ab6-b143-d7bc7e3be077 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:02.116756 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0a977-6dc9-4ab6-b143-d7bc7e3be077 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:02.117031 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0a977-6dc9-4ab6-b143-d7bc7e3be077 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:02.124236 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0a977-6dc9-4ab6-b143-d7bc7e3be077 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:02.125657 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0a977-6dc9-4ab6-b143-d7bc7e3be077 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:02.139670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-c3f0a977-6dc9-4ab6-b143-d7bc7e3be077 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 02:20:02.139670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:02.139670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:02.139670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:02.139670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:02.139670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:02.139670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:02.139670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:02.139670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:02.139670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:02.139670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:02.139670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:02.139670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:20:02.139670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:20:02.139670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:20:02.139670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:20:02.140839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:02.140839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:02.140839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:20:02.140839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:20:02.140839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:20:02.140839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:20:02.140839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:02.140839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:02.140839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:02.140839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:02.140839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:02.140839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:02.140839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:02.140839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:02.140839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:02.140839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:02.140839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:02.140839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:02.159826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:02.159826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:02.159826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:20:02.159826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:20:02.159826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:20:02.159826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:20:02.159826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:20:02.159826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:20:02.159826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 02:20:02.159826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:02.159826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 602/1212] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:20:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:02.161011 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49168d3e-0e3d-4602-b043-ed33a569395c None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:02.247399 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49168d3e-0e3d-4602-b043-ed33a569395c None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:02.280322 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6971e2-fc8f-4b0c-9c60-fc420aab8d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:02.280986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6971e2-fc8f-4b0c-9c60-fc420aab8d68 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:02.281272 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6971e2-fc8f-4b0c-9c60-fc420aab8d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:02.281549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6971e2-fc8f-4b0c-9c60-fc420aab8d68 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:02.282416 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6971e2-fc8f-4b0c-9c60-fc420aab8d68 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:02.282727 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6971e2-fc8f-4b0c-9c60-fc420aab8d68 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:02.284151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6971e2-fc8f-4b0c-9c60-fc420aab8d68 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:02.301513 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 611/1213] 10.222.0.64 () {56 vars in 1143 bytes} [Mon Jul 18 02:20:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:02.307830 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0a977-6dc9-4ab6-b143-d7bc7e3be077 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:02.404460 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0a977-6dc9-4ab6-b143-d7bc7e3be077 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:02.438067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666a6f0-0a0d-4499-9595-54501a03a300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:02.438714 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666a6f0-0a0d-4499-9595-54501a03a300 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:02.438996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666a6f0-0a0d-4499-9595-54501a03a300 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:02.439280 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666a6f0-0a0d-4499-9595-54501a03a300 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:02.470552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:02.507426 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666a6f0-0a0d-4499-9595-54501a03a300 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:02.508808 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666a6f0-0a0d-4499-9595-54501a03a300 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:02.603971 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 603/1214] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:20:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 02:20:02.609916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6971e2-fc8f-4b0c-9c60-fc420aab8d68 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:02.628422 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:02.706041 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6971e2-fc8f-4b0c-9c60-fc420aab8d68 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:02.739951 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d14c1-d55b-4622-bbd5-a418fcf89044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:02.740736 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d14c1-d55b-4622-bbd5-a418fcf89044 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:02.741017 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d14c1-d55b-4622-bbd5-a418fcf89044 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:02.741301 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d14c1-d55b-4622-bbd5-a418fcf89044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:02.751116 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d14c1-d55b-4622-bbd5-a418fcf89044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:02.752556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d14c1-d55b-4622-bbd5-a418fcf89044 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:02.770165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-692d14c1-d55b-4622-bbd5-a418fcf89044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:02.770165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:02.770165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:02.770165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:02.770165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:02.770165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:02.770165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:02.770165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:02.770165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:02.770165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:02.770165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:02.770165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:02.770165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:20:02.770165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:20:02.770165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:20:02.771591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:20:02.771591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:02.771591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:02.771591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:02.771591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:02.771591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:02.771591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:02.771591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:02.771591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:02.771591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:02.771591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:02.771591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:02.771591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:02.771591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:02.771591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:02.771591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:02.771591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:02.772515 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:20:02.772515 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:20:02.772515 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:02.772515 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:20:02.772515 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 612/1215] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:02.777750 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666a6f0-0a0d-4499-9595-54501a03a300 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:02.836632 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:02.872624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666a6f0-0a0d-4499-9595-54501a03a300 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:02.905926 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc6135-74b6-400c-a7ed-0acc44fdbf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:02.906579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc6135-74b6-400c-a7ed-0acc44fdbf44 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:02.906864 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc6135-74b6-400c-a7ed-0acc44fdbf44 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:02.907142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abc6135-74b6-400c-a7ed-0acc44fdbf44 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:02.907849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc6135-74b6-400c-a7ed-0acc44fdbf44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:02.908157 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc6135-74b6-400c-a7ed-0acc44fdbf44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:02.909532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abc6135-74b6-400c-a7ed-0acc44fdbf44 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:02.920702 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 604/1216] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:02.926314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d14c1-d55b-4622-bbd5-a418fcf89044 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:02.997504 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:03.027555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d14c1-d55b-4622-bbd5-a418fcf89044 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:03.059817 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538feaa6-cbb7-47fe-80e6-3a1114b7b860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:03.060596 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538feaa6-cbb7-47fe-80e6-3a1114b7b860 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:03.060881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538feaa6-cbb7-47fe-80e6-3a1114b7b860 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:03.061159 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538feaa6-cbb7-47fe-80e6-3a1114b7b860 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:03.068180 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538feaa6-cbb7-47fe-80e6-3a1114b7b860 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:03.069597 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538feaa6-cbb7-47fe-80e6-3a1114b7b860 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:03.083773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-538feaa6-cbb7-47fe-80e6-3a1114b7b860 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:20:03.083773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:03.083773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:03.083773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:03.083773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:03.083773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:03.083773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:03.083773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:03.083773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:03.083773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:03.083773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:03.083773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:03.083773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:20:03.083773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:20:03.083773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:20:03.084826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:20:03.084826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:03.084826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:03.084826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:03.084826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:03.084826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:03.084826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:03.084826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:03.084826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:03.084826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:03.084826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:03.084826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:03.084826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:03.084826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:03.084826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:03.084826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:03.084826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:03.085903 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:20:03.085903 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:20:03.085903 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:20:03.085903 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:20:03.085903 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:20:03.085903 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:20:03.085903 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:20:03.085903 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:20:03.085903 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 613/1217] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:20:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:03.093037 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc6135-74b6-400c-a7ed-0acc44fdbf44 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:03.190925 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abc6135-74b6-400c-a7ed-0acc44fdbf44 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:03.212923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:03.224377 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b665d75-59d2-4447-a8ac-976b5a49ef9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:03.225576 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b665d75-59d2-4447-a8ac-976b5a49ef9c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:03.225576 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b665d75-59d2-4447-a8ac-976b5a49ef9c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:03.225576 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b665d75-59d2-4447-a8ac-976b5a49ef9c None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:03.226363 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b665d75-59d2-4447-a8ac-976b5a49ef9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:03.226672 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b665d75-59d2-4447-a8ac-976b5a49ef9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:03.228084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b665d75-59d2-4447-a8ac-976b5a49ef9c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:03.240242 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 605/1218] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:20:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:03.246269 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538feaa6-cbb7-47fe-80e6-3a1114b7b860 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:03.347913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538feaa6-cbb7-47fe-80e6-3a1114b7b860 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:03.376002 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:03.381299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37a4c2b-3425-4b6d-af81-b47da98eeb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:03.381982 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a4c2b-3425-4b6d-af81-b47da98eeb1c None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:03.382263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a4c2b-3425-4b6d-af81-b47da98eeb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:03.382540 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37a4c2b-3425-4b6d-af81-b47da98eeb1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:03.383357 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a4c2b-3425-4b6d-af81-b47da98eeb1c None admin] RBAC: Adding query filter params (role.id=1f864eb92c9545bfb36cb24aff0401e4, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=213ba948a3f34c39bce3f6db093479eb) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:03.383672 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a4c2b-3425-4b6d-af81-b47da98eeb1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:03.385083 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37a4c2b-3425-4b6d-af81-b47da98eeb1c None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:03.392968 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 614/1219] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:20:03 2022] GET /identity/v3/role_assignments?user.id=213ba948a3f34c39bce3f6db093479eb&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=1f864eb92c9545bfb36cb24aff0401e4 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:05.372616 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106398a-1374-4bd5-9456-5d2b57abd8ee None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:05.373201 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106398a-1374-4bd5-9456-5d2b57abd8ee None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:05.373201 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106398a-1374-4bd5-9456-5d2b57abd8ee None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:05.374591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 606/1220] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:20:05.379954 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6e66c-939c-4cb3-8d47-efed04906e5f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:05.380377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6e66c-939c-4cb3-8d47-efed04906e5f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:05.380515 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6e66c-939c-4cb3-8d47-efed04906e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:05.397366 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-dae6e66c-939c-4cb3-8d47-efed04906e5f None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:20:05.398537 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-dae6e66c-939c-4cb3-8d47-efed04906e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:20:05.467208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 615/1221] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:20:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:20:05.490278 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106398a-1374-4bd5-9456-5d2b57abd8ee None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:05.589105 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106398a-1374-4bd5-9456-5d2b57abd8ee None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:05.621312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbce706-1eaf-49a7-b3c3-f59a25d076f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:05.622132 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbce706-1eaf-49a7-b3c3-f59a25d076f9 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:05.622422 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbce706-1eaf-49a7-b3c3-f59a25d076f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:05.622696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbce706-1eaf-49a7-b3c3-f59a25d076f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:05.632951 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbce706-1eaf-49a7-b3c3-f59a25d076f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:20:05.640666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-8bbce706-1eaf-49a7-b3c3-f59a25d076f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:20:05.640666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:05.640666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:05.640666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:05.640666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:05.640666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:05.640666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:05.640666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:05.640666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:05.640666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:05.640666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:05.640666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:05.640666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:20:05.640666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:20:05.640666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:20:05.640666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:20:05.641849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:20:05.641849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:20:05.641849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:20:05.641849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:20:05.641849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:05.641849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:05.641849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:05.641849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:05.641849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:05.641849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:05.641849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:05.641849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:05.641849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:05.641849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:05.641849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:05.641849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:05.642774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:05.642774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:05.642774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:05.642774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:05.642774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:20:05.642774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:20:05.642774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:20:05.642774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:20:05.642774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:20:05.642774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:20:05.642774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:20:05.642774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:05.642774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 607/1222] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:20:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:05.648784 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6e66c-939c-4cb3-8d47-efed04906e5f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:05.745291 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6e66c-939c-4cb3-8d47-efed04906e5f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:05.768649 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:05.780078 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d1ecd-2cc2-4d35-a639-c2e1f4bc3570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:05.780741 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d1ecd-2cc2-4d35-a639-c2e1f4bc3570 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:05.781088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d1ecd-2cc2-4d35-a639-c2e1f4bc3570 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:05.781412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d1ecd-2cc2-4d35-a639-c2e1f4bc3570 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:05.782190 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d1ecd-2cc2-4d35-a639-c2e1f4bc3570 None admin] RBAC: Adding query filter params (name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:05.786267 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d1ecd-2cc2-4d35-a639-c2e1f4bc3570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:05.786267 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d1ecd-2cc2-4d35-a639-c2e1f4bc3570 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:05.792992 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 616/1223] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jul 18 02:20:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:05.798889 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbce706-1eaf-49a7-b3c3-f59a25d076f9 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:05.840695 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:05.897628 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbce706-1eaf-49a7-b3c3-f59a25d076f9 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:05.930645 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72daea-ec88-42fd-8225-16e94eaa152c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:05.931377 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72daea-ec88-42fd-8225-16e94eaa152c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:05.931664 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72daea-ec88-42fd-8225-16e94eaa152c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:05.931942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72daea-ec88-42fd-8225-16e94eaa152c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:05.943274 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72daea-ec88-42fd-8225-16e94eaa152c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:05.944814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72daea-ec88-42fd-8225-16e94eaa152c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:05.962324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-6b72daea-ec88-42fd-8225-16e94eaa152c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:05.962324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:05.962324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:05.962324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:05.962324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:05.962324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:05.962324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:05.962324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:05.962324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:05.962324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:05.962324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:05.962324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:05.962324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:20:05.962324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:20:05.962324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:20:05.963413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:20:05.963413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:05.963413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:05.963413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:05.963413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:05.963413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:05.963413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:05.963413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:05.963413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:05.963413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:05.963413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:05.963413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:05.963413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:05.963413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:05.963413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:05.963413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:05.963413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:05.964753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:20:05.964753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:20:05.964753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:05.964753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:05.964753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 608/1224] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:20:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:20:05.969280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d1ecd-2cc2-4d35-a639-c2e1f4bc3570 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:06.070465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d1ecd-2cc2-4d35-a639-c2e1f4bc3570 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:06.111929 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe1852-3cc2-4e70-bd59-08ce3b2e9f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:06.112600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe1852-3cc2-4e70-bd59-08ce3b2e9f99 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:06.112888 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe1852-3cc2-4e70-bd59-08ce3b2e9f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:06.113170 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe1852-3cc2-4e70-bd59-08ce3b2e9f99 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:06.113944 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe1852-3cc2-4e70-bd59-08ce3b2e9f99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:06.114254 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe1852-3cc2-4e70-bd59-08ce3b2e9f99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:06.115706 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe1852-3cc2-4e70-bd59-08ce3b2e9f99 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:06.127843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 617/1225] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:06.133630 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72daea-ec88-42fd-8225-16e94eaa152c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:06.225804 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:06.232115 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72daea-ec88-42fd-8225-16e94eaa152c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:06.263911 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db5974-2faf-4991-8c88-944547a730c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:06.266118 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db5974-2faf-4991-8c88-944547a730c7 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:06.266118 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db5974-2faf-4991-8c88-944547a730c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:06.266118 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db5974-2faf-4991-8c88-944547a730c7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:06.273109 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db5974-2faf-4991-8c88-944547a730c7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:06.274569 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db5974-2faf-4991-8c88-944547a730c7 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:06.289247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-e1db5974-2faf-4991-8c88-944547a730c7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 02:20:06.289247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:06.289247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:06.289247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:06.289247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:06.289247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:06.289247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:06.289247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:06.289247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:06.289247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:06.289247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:06.289247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:06.289247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:20:06.289247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:20:06.289247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:20:06.289247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:20:06.290243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:06.290243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:06.290243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:20:06.290243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:20:06.290243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:20:06.290243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:20:06.290243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:06.290243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:06.290243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:06.290243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:06.290243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:06.290243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:06.290243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:06.290243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:06.290243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:06.290243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:06.290243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:06.290243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:06.291335 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:06.291335 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:06.291335 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:20:06.291335 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:20:06.291335 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:20:06.291335 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:20:06.291335 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:20:06.291335 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:20:06.291335 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 02:20:06.291335 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:06.291335 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 609/1226] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:20:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:06.296535 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe1852-3cc2-4e70-bd59-08ce3b2e9f99 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:06.342823 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:06.394753 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe1852-3cc2-4e70-bd59-08ce3b2e9f99 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:06.429050 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a7728-13b9-4362-95ae-db5d5cfdc90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:06.434108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a7728-13b9-4362-95ae-db5d5cfdc90d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:06.434108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a7728-13b9-4362-95ae-db5d5cfdc90d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:06.434108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a7728-13b9-4362-95ae-db5d5cfdc90d None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:06.434108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a7728-13b9-4362-95ae-db5d5cfdc90d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:06.434108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a7728-13b9-4362-95ae-db5d5cfdc90d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:06.435544 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a7728-13b9-4362-95ae-db5d5cfdc90d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:06.454466 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 618/1227] 10.222.0.64 () {56 vars in 1143 bytes} [Mon Jul 18 02:20:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:06.460967 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db5974-2faf-4991-8c88-944547a730c7 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:06.558911 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db5974-2faf-4991-8c88-944547a730c7 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:06.593121 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e27fc-8e57-4ad7-bb25-4b8f00062d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:06.593955 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e27fc-8e57-4ad7-bb25-4b8f00062d7b None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:06.594242 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e27fc-8e57-4ad7-bb25-4b8f00062d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:06.594517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e27fc-8e57-4ad7-bb25-4b8f00062d7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:06.604789 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e27fc-8e57-4ad7-bb25-4b8f00062d7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:06.606265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e27fc-8e57-4ad7-bb25-4b8f00062d7b None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:06.622909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-e65e27fc-8e57-4ad7-bb25-4b8f00062d7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:06.622909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:06.622909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:06.622909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:06.622909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:06.622909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:06.622909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:06.622909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:06.622909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:06.622909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:06.622909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:06.622909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:06.622909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:20:06.622909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:20:06.622909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:20:06.624067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:20:06.624067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:06.624067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:06.624067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:06.624067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:06.624067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:06.624067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:06.624067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:06.624067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:06.624067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:06.624067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:06.624067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:06.624067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:06.624067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:06.624067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:06.624067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:06.624067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:06.625362 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:20:06.625362 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:20:06.625362 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:06.625362 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:06.625362 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 610/1228] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:20:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:06.630613 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a7728-13b9-4362-95ae-db5d5cfdc90d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:06.729305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a7728-13b9-4362-95ae-db5d5cfdc90d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:06.731592 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:06.763182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3f1c4-8927-46b7-94ce-6f16cbd51a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:06.764211 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3f1c4-8927-46b7-94ce-6f16cbd51a1d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:06.764211 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3f1c4-8927-46b7-94ce-6f16cbd51a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:06.764463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3f1c4-8927-46b7-94ce-6f16cbd51a1d None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:06.765148 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3f1c4-8927-46b7-94ce-6f16cbd51a1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:06.765458 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3f1c4-8927-46b7-94ce-6f16cbd51a1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:06.766872 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3f1c4-8927-46b7-94ce-6f16cbd51a1d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:06.778233 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 619/1229] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:06.785433 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e27fc-8e57-4ad7-bb25-4b8f00062d7b None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:06.795443 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:06.884341 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e27fc-8e57-4ad7-bb25-4b8f00062d7b None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:06.916735 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3031409-9e81-4af0-8af7-dd02d9869948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:06.917535 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3031409-9e81-4af0-8af7-dd02d9869948 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:06.917857 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3031409-9e81-4af0-8af7-dd02d9869948 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:06.918145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3031409-9e81-4af0-8af7-dd02d9869948 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:06.924731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3031409-9e81-4af0-8af7-dd02d9869948 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:06.926740 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3031409-9e81-4af0-8af7-dd02d9869948 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:06.940551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-c3031409-9e81-4af0-8af7-dd02d9869948 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:20:06.940551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:06.940551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:06.940551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:06.940551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:06.940551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:06.940551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:06.940551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:06.940551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:06.940551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:06.940551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:06.940551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:06.940551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:20:06.940551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:20:06.940551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:20:06.941581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:20:06.941581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:06.941581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:06.941581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:06.941581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:06.941581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:06.941581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:06.941581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:06.941581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:06.941581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:06.941581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:06.941581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:06.941581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:06.941581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:06.941581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:06.941581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:06.941581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:06.943284 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:20:06.943284 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:20:06.943284 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:20:06.943284 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:20:06.943284 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:20:06.943284 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:20:06.943284 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:20:06.943284 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:06.943284 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 611/1230] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:20:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 02:20:06.948098 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3f1c4-8927-46b7-94ce-6f16cbd51a1d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:07.045108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3f1c4-8927-46b7-94ce-6f16cbd51a1d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:07.078502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216ec73-ed51-4d08-a77b-01bc9f09ca11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:07.079151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216ec73-ed51-4d08-a77b-01bc9f09ca11 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:07.079434 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216ec73-ed51-4d08-a77b-01bc9f09ca11 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:07.079709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216ec73-ed51-4d08-a77b-01bc9f09ca11 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:07.080474 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216ec73-ed51-4d08-a77b-01bc9f09ca11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:07.080781 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216ec73-ed51-4d08-a77b-01bc9f09ca11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:07.082215 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216ec73-ed51-4d08-a77b-01bc9f09ca11 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:07.096040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 620/1231] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:20:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:07.102671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3031409-9e81-4af0-8af7-dd02d9869948 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:07.168832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:07.201269 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3031409-9e81-4af0-8af7-dd02d9869948 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:07.234415 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675480d-514f-4896-9b79-2dea40096075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:07.235306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675480d-514f-4896-9b79-2dea40096075 None admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:07.235590 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675480d-514f-4896-9b79-2dea40096075 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:07.235866 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675480d-514f-4896-9b79-2dea40096075 None admin] PATH_INFO: `/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/213ba948a3f34c39bce3f6db093479eb/roles/1f864eb92c9545bfb36cb24aff0401e4` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:07.251086 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675480d-514f-4896-9b79-2dea40096075 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f6f840feba049ee9eeaf7bf0b300730, user_id=213ba948a3f34c39bce3f6db093479eb, role_id=1f864eb92c9545bfb36cb24aff0401e4)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:07.252527 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675480d-514f-4896-9b79-2dea40096075 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:07.330784 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 612/1232] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:20:07 2022] PUT /identity/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/213ba948a3f34c39bce3f6db093479eb/roles/1f864eb92c9545bfb36cb24aff0401e4 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:20:09.320533 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe9428-38c6-4c33-a162-61d749662b3e None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:09.321088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe9428-38c6-4c33-a162-61d749662b3e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:09.321088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe9428-38c6-4c33-a162-61d749662b3e None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:09.322573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 621/1233] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:20:09.327727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b66eb-7c83-4e9b-b91d-b6047705e46e None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:09.328139 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b66eb-7c83-4e9b-b91d-b6047705e46e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:09.328283 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801b66eb-7c83-4e9b-b91d-b6047705e46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:09.349064 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-801b66eb-7c83-4e9b-b91d-b6047705e46e None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:20:09.350323 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-801b66eb-7c83-4e9b-b91d-b6047705e46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:20:09.415560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 613/1234] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:20:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:20:09.438489 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe9428-38c6-4c33-a162-61d749662b3e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:09.479120 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:09.554508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe9428-38c6-4c33-a162-61d749662b3e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:09.588390 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101f55d-2458-4368-9b03-5612dabf73af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:09.589184 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101f55d-2458-4368-9b03-5612dabf73af None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:09.589474 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101f55d-2458-4368-9b03-5612dabf73af None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:09.589787 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101f55d-2458-4368-9b03-5612dabf73af None admin] PATH_INFO: `/v3/roles/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:09.599717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101f55d-2458-4368-9b03-5612dabf73af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:20:09.607374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-b101f55d-2458-4368-9b03-5612dabf73af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:20:09.607374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:09.607374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:09.607374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:09.607374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:09.607374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:09.607374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:09.607374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:09.607374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:09.607374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:09.607374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:09.607374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:09.607374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:20:09.607374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:20:09.607374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:20:09.607374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:20:09.608426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:20:09.608426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:20:09.608426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:20:09.608426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:20:09.608426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:09.608426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:09.608426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:09.608426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:09.608426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:09.608426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:09.608426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:09.608426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:09.608426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:09.608426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:09.608426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:09.608426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:09.609603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:09.609603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:09.609603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:09.609603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:09.609603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:20:09.609603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:20:09.609603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:20:09.609603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:20:09.609603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:20:09.609603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:20:09.609603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 02:20:09.609603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:20:09.609603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 622/1235] 10.222.0.64 () {56 vars in 1102 bytes} [Mon Jul 18 02:20:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:09.614874 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b66eb-7c83-4e9b-b91d-b6047705e46e None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:09.660369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:09.712265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801b66eb-7c83-4e9b-b91d-b6047705e46e None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:09.744292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d520978-a023-4818-878d-f5cee0ab9850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:09.744959 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d520978-a023-4818-878d-f5cee0ab9850 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:09.745245 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d520978-a023-4818-878d-f5cee0ab9850 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:09.745528 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d520978-a023-4818-878d-f5cee0ab9850 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:09.746303 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d520978-a023-4818-878d-f5cee0ab9850 None admin] RBAC: Adding query filter params (name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:09.746609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d520978-a023-4818-878d-f5cee0ab9850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:09.747972 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d520978-a023-4818-878d-f5cee0ab9850 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:09.756634 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 614/1236] 10.222.0.64 () {56 vars in 1103 bytes} [Mon Jul 18 02:20:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:09.762430 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101f55d-2458-4368-9b03-5612dabf73af None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:09.846057 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:09.861212 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101f55d-2458-4368-9b03-5612dabf73af None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:09.894306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b980580-aaf3-4eb1-82ca-cfaae0b7dc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:09.895140 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b980580-aaf3-4eb1-82ca-cfaae0b7dc2a None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:09.895450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b980580-aaf3-4eb1-82ca-cfaae0b7dc2a None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:09.895730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b980580-aaf3-4eb1-82ca-cfaae0b7dc2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:09.905520 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b980580-aaf3-4eb1-82ca-cfaae0b7dc2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:09.907004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b980580-aaf3-4eb1-82ca-cfaae0b7dc2a None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:09.924365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-8b980580-aaf3-4eb1-82ca-cfaae0b7dc2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:09.924365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:09.924365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:09.924365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:09.924365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:09.924365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:09.924365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:09.924365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:09.924365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:09.924365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:09.924365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:09.924365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:09.924365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:20:09.924365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:20:09.924365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:20:09.925518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:20:09.925518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:09.925518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:09.925518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:09.925518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:09.925518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:09.925518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:09.925518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:09.925518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:09.925518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:09.925518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:09.925518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:09.925518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:09.925518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:09.925518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:09.925518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:09.925518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:09.930666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:20:09.930666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:20:09.930666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:09.930666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:20:09.930666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 623/1237] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:20:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:09.931969 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d520978-a023-4818-878d-f5cee0ab9850 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:10.028486 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d520978-a023-4818-878d-f5cee0ab9850 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:10.038096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:10.062663 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeae27a-7489-4686-b36c-75f86458edd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:10.063319 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeae27a-7489-4686-b36c-75f86458edd1 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:10.063599 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeae27a-7489-4686-b36c-75f86458edd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:10.063872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeae27a-7489-4686-b36c-75f86458edd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:10.064579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeae27a-7489-4686-b36c-75f86458edd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:10.064883 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeae27a-7489-4686-b36c-75f86458edd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:10.066282 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeae27a-7489-4686-b36c-75f86458edd1 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:10.077094 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 615/1238] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:20:10.082843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b980580-aaf3-4eb1-82ca-cfaae0b7dc2a None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:10.181487 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b980580-aaf3-4eb1-82ca-cfaae0b7dc2a None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:10.213663 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080ae26-a55e-4abb-add1-44b6b66cf16d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:10.214482 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080ae26-a55e-4abb-add1-44b6b66cf16d None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:10.214763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080ae26-a55e-4abb-add1-44b6b66cf16d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:10.215034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080ae26-a55e-4abb-add1-44b6b66cf16d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:10.217633 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:10.222022 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080ae26-a55e-4abb-add1-44b6b66cf16d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:10.223974 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080ae26-a55e-4abb-add1-44b6b66cf16d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:10.238912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-2080ae26-a55e-4abb-add1-44b6b66cf16d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 02:20:10.238912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:10.238912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:10.238912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:10.238912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:10.238912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:10.238912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:10.238912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:10.238912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:10.238912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:10.238912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:10.238912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:10.238912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:20:10.238912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:20:10.238912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:20:10.238912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:20:10.240025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:10.240025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:10.240025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:20:10.240025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:20:10.240025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:20:10.240025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:20:10.240025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:10.240025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:10.240025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:10.240025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:10.240025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:10.240025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:10.240025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:10.240025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:10.240025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:10.240025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:10.240025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:10.240025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:10.241041 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:10.241041 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:10.241041 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:20:10.241041 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:20:10.241041 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:20:10.241041 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:20:10.241041 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:20:10.241041 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:20:10.241041 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 02:20:10.241041 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:20:10.241041 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 624/1239] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:20:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:10.245979 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeae27a-7489-4686-b36c-75f86458edd1 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:10.344023 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeae27a-7489-4686-b36c-75f86458edd1 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:10.377311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d39fa-1942-4c60-bc5f-a105af381386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:10.378010 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d39fa-1942-4c60-bc5f-a105af381386 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:10.378298 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d39fa-1942-4c60-bc5f-a105af381386 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:10.378637 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d39fa-1942-4c60-bc5f-a105af381386 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:10.379485 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d39fa-1942-4c60-bc5f-a105af381386 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:10.379800 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d39fa-1942-4c60-bc5f-a105af381386 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:10.381228 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d39fa-1942-4c60-bc5f-a105af381386 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:10.398377 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 616/1240] 10.222.0.64 () {56 vars in 1143 bytes} [Mon Jul 18 02:20:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:10.404109 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080ae26-a55e-4abb-add1-44b6b66cf16d None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:10.502597 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080ae26-a55e-4abb-add1-44b6b66cf16d None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:10.536638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4563d-9e7b-4311-a445-62c670ae42db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:10.537285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4563d-9e7b-4311-a445-62c670ae42db None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:10.537571 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4563d-9e7b-4311-a445-62c670ae42db None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:10.537883 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f4563d-9e7b-4311-a445-62c670ae42db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:10.596061 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:10.602764 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4563d-9e7b-4311-a445-62c670ae42db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:10.604217 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f4563d-9e7b-4311-a445-62c670ae42db None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:10.698236 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 625/1241] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:20:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 02:20:10.704164 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d39fa-1942-4c60-bc5f-a105af381386 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:10.731414 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:10.800801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d39fa-1942-4c60-bc5f-a105af381386 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:10.833934 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fb4a4-3373-43e5-b30d-5ba7372b84e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:10.834724 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fb4a4-3373-43e5-b30d-5ba7372b84e4 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:10.835006 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fb4a4-3373-43e5-b30d-5ba7372b84e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:10.835282 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fb4a4-3373-43e5-b30d-5ba7372b84e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:10.847388 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fb4a4-3373-43e5-b30d-5ba7372b84e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:10.847840 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fb4a4-3373-43e5-b30d-5ba7372b84e4 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:10.866127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-1a3fb4a4-3373-43e5-b30d-5ba7372b84e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:10.866127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:10.866127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:10.866127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:10.866127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:10.866127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:10.866127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:10.866127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:10.866127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:10.866127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:10.866127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:10.866127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:10.866127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:20:10.866127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:20:10.866127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:20:10.867234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:20:10.867234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:10.867234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:10.867234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:10.867234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:10.867234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:10.867234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:10.867234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:10.867234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:10.867234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:10.867234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:10.867234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:10.867234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:10.867234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:10.867234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:10.867234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:10.867234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:10.868356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:20:10.868356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:20:10.868356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:10.868356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:10.868356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 617/1242] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:20:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:10.874681 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4563d-9e7b-4311-a445-62c670ae42db None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:10.967795 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:10.973653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f4563d-9e7b-4311-a445-62c670ae42db None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:11.007172 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4d289-a541-49a0-81bd-afad45b390f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:11.007832 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4d289-a541-49a0-81bd-afad45b390f6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:11.008115 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4d289-a541-49a0-81bd-afad45b390f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:11.008389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4d289-a541-49a0-81bd-afad45b390f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:11.009096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4d289-a541-49a0-81bd-afad45b390f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:11.009399 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4d289-a541-49a0-81bd-afad45b390f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:11.010794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4d289-a541-49a0-81bd-afad45b390f6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:11.022298 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 626/1243] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:20:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:11.028129 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fb4a4-3373-43e5-b30d-5ba7372b84e4 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:11.104887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:11.125016 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fb4a4-3373-43e5-b30d-5ba7372b84e4 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:11.158664 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655dac2-e70a-47e6-ad19-bfbec32a898a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:11.159459 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655dac2-e70a-47e6-ad19-bfbec32a898a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:11.159741 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655dac2-e70a-47e6-ad19-bfbec32a898a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:11.160046 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b655dac2-e70a-47e6-ad19-bfbec32a898a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:11.166979 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655dac2-e70a-47e6-ad19-bfbec32a898a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:11.168462 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b655dac2-e70a-47e6-ad19-bfbec32a898a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:11.182524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-b655dac2-e70a-47e6-ad19-bfbec32a898a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:20:11.182524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:11.182524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:11.182524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:11.182524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:11.182524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:11.182524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:11.182524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:11.182524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:11.182524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:11.182524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:11.182524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:11.182524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:20:11.182524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:20:11.182524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:20:11.183580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:20:11.183580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:11.183580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:11.183580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:11.183580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:11.183580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:11.183580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:11.183580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:11.183580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:11.183580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:11.183580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:11.183580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:11.183580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:11.183580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:11.183580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:11.183580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:11.183580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:11.184770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:20:11.184770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:20:11.184770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:20:11.184770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:20:11.184770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:20:11.184770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:20:11.184770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:20:11.184770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:11.184770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 618/1244] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:20:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:11.189693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4d289-a541-49a0-81bd-afad45b390f6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:11.288281 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4d289-a541-49a0-81bd-afad45b390f6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:11.322092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde410f2-4eb3-45aa-b3e6-c6d7c237d987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:11.322746 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde410f2-4eb3-45aa-b3e6-c6d7c237d987 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:11.323031 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde410f2-4eb3-45aa-b3e6-c6d7c237d987 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:11.323312 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde410f2-4eb3-45aa-b3e6-c6d7c237d987 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:11.324093 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde410f2-4eb3-45aa-b3e6-c6d7c237d987 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:11.324403 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde410f2-4eb3-45aa-b3e6-c6d7c237d987 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:11.325861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde410f2-4eb3-45aa-b3e6-c6d7c237d987 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:11.337781 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 627/1245] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:20:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:11.343755 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655dac2-e70a-47e6-ad19-bfbec32a898a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:11.445918 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b655dac2-e70a-47e6-ad19-bfbec32a898a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:11.478187 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd81273f-76a6-492b-b605-49fa85b6ca5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:11.478847 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81273f-76a6-492b-b605-49fa85b6ca5e None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:11.487661 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81273f-76a6-492b-b605-49fa85b6ca5e None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:11.487661 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd81273f-76a6-492b-b605-49fa85b6ca5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:11.487661 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81273f-76a6-492b-b605-49fa85b6ca5e None admin] RBAC: Adding query filter params (role.id=1f864eb92c9545bfb36cb24aff0401e4, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=213ba948a3f34c39bce3f6db093479eb) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:11.487661 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81273f-76a6-492b-b605-49fa85b6ca5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:11.487661 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd81273f-76a6-492b-b605-49fa85b6ca5e None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:11.488573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 619/1246] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:20:11 2022] GET /identity/v3/role_assignments?user.id=213ba948a3f34c39bce3f6db093479eb&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=1f864eb92c9545bfb36cb24aff0401e4 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:13.562077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54668b63-7244-43f1-a149-e492084cc72e None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:13.562598 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54668b63-7244-43f1-a149-e492084cc72e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:13.562598 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54668b63-7244-43f1-a149-e492084cc72e None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:13.563933 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 628/1247] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:20:13.569221 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929500e-748e-4457-94e4-8336f0a45f6a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:13.569600 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929500e-748e-4457-94e4-8336f0a45f6a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:13.569823 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929500e-748e-4457-94e4-8336f0a45f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:13.579804 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:13.587853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b929500e-748e-4457-94e4-8336f0a45f6a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:20:13.589047 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b929500e-748e-4457-94e4-8336f0a45f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:20:13.654172 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 620/1248] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:20:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:20:13.678009 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54668b63-7244-43f1-a149-e492084cc72e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:13.696099 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:13.777940 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54668b63-7244-43f1-a149-e492084cc72e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:13.811531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342956a-061c-45d6-8be6-2c0ab7927c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:13.812368 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342956a-061c-45d6-8be6-2c0ab7927c82 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:13.812607 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342956a-061c-45d6-8be6-2c0ab7927c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:13.812883 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342956a-061c-45d6-8be6-2c0ab7927c82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:13.823559 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342956a-061c-45d6-8be6-2c0ab7927c82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:20:13.831179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-1342956a-061c-45d6-8be6-2c0ab7927c82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:20:13.831179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:13.831179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:13.831179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:13.831179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:13.831179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:13.831179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:13.831179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:13.831179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:13.831179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:13.831179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:13.831179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:13.831179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:20:13.831179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:20:13.831179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:20:13.831179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:20:13.832934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:20:13.832934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:20:13.832934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:20:13.832934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:20:13.832934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:13.832934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:13.832934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:13.832934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:13.832934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:13.832934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:13.832934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:13.832934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:13.832934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:13.832934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:13.832934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:13.832934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:13.834004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:13.834004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:13.834004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:13.834004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:13.834004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:20:13.834004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:20:13.834004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:20:13.834004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:20:13.834004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:20:13.834004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:20:13.834004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:20:13.834004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:20:13.834004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 629/1249] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:20:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:13.839002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929500e-748e-4457-94e4-8336f0a45f6a None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:13.937281 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929500e-748e-4457-94e4-8336f0a45f6a None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:13.966755 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:13.971557 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfeee0-03a2-4191-8e98-4821efca8171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:13.972261 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfeee0-03a2-4191-8e98-4821efca8171 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:13.972552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfeee0-03a2-4191-8e98-4821efca8171 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:13.972835 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfeee0-03a2-4191-8e98-4821efca8171 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:13.973584 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfeee0-03a2-4191-8e98-4821efca8171 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:13.973925 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfeee0-03a2-4191-8e98-4821efca8171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:13.975301 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decfeee0-03a2-4191-8e98-4821efca8171 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:13.983282 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 621/1250] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:20:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:13.989051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342956a-061c-45d6-8be6-2c0ab7927c82 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:14.065012 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:14.087593 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342956a-061c-45d6-8be6-2c0ab7927c82 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:14.119368 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd54a9-a446-4b40-9ca4-9e4e56af68ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:14.120233 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd54a9-a446-4b40-9ca4-9e4e56af68ef None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:14.120520 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd54a9-a446-4b40-9ca4-9e4e56af68ef None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:14.120801 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd54a9-a446-4b40-9ca4-9e4e56af68ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:14.131745 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd54a9-a446-4b40-9ca4-9e4e56af68ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:14.133194 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd54a9-a446-4b40-9ca4-9e4e56af68ef None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:14.150546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-55dd54a9-a446-4b40-9ca4-9e4e56af68ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:14.150546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:14.150546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:14.150546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:14.150546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:14.150546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:14.150546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:14.150546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:14.150546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:14.150546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:14.150546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:14.150546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:14.150546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:20:14.150546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:20:14.150546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:20:14.151586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:20:14.151586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:14.151586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:14.151586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:14.151586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:14.151586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:14.151586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:14.151586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:14.151586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:14.151586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:14.151586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:14.151586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:14.151586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:14.151586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:14.151586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:14.151586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:14.151586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:14.152600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:20:14.152600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:20:14.152600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:14.152600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:20:14.152600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 630/1251] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:20:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:14.157487 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfeee0-03a2-4191-8e98-4821efca8171 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:14.261683 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfeee0-03a2-4191-8e98-4821efca8171 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:14.295488 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a2936-2fd5-4608-ab6d-973e4d88925f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:14.296146 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a2936-2fd5-4608-ab6d-973e4d88925f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:14.296428 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a2936-2fd5-4608-ab6d-973e4d88925f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:14.296730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a2936-2fd5-4608-ab6d-973e4d88925f None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:14.297441 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a2936-2fd5-4608-ab6d-973e4d88925f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:14.297772 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a2936-2fd5-4608-ab6d-973e4d88925f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:14.299129 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a2936-2fd5-4608-ab6d-973e4d88925f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:14.310387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 622/1252] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:20:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:14.316250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd54a9-a446-4b40-9ca4-9e4e56af68ef None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:14.413924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd54a9-a446-4b40-9ca4-9e4e56af68ef None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:14.438951 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:14.446626 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55770a24-c8ec-48a5-b923-5e64d560fca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:14.447419 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55770a24-c8ec-48a5-b923-5e64d560fca6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:14.447706 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55770a24-c8ec-48a5-b923-5e64d560fca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:14.447983 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55770a24-c8ec-48a5-b923-5e64d560fca6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:14.456095 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55770a24-c8ec-48a5-b923-5e64d560fca6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:14.458220 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55770a24-c8ec-48a5-b923-5e64d560fca6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:14.472943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-55770a24-c8ec-48a5-b923-5e64d560fca6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 02:20:14.472943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:14.472943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:14.472943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:14.472943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:14.472943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:14.472943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:14.472943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:14.472943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:14.472943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:14.472943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:14.472943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:14.472943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:20:14.472943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:20:14.472943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:20:14.472943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:20:14.475495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:14.475495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:14.475495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:20:14.475495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:20:14.475495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:20:14.475495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:20:14.475495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:14.475495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:14.475495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:14.475495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:14.475495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:14.475495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:14.475495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:14.475495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:14.475495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:14.475495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:14.475495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:14.475495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:14.476432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:14.476432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:14.476432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:20:14.476432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:20:14.476432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:20:14.476432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:20:14.476432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:20:14.476432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:20:14.476432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 02:20:14.476432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:20:14.476432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 631/1253] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:20:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:14.479974 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a2936-2fd5-4608-ab6d-973e4d88925f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:14.535584 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:14.582613 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a2936-2fd5-4608-ab6d-973e4d88925f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:14.619425 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5c196-e33c-4024-acdd-e279c2b7b475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:14.620108 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5c196-e33c-4024-acdd-e279c2b7b475 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:14.620393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5c196-e33c-4024-acdd-e279c2b7b475 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:14.620672 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5c196-e33c-4024-acdd-e279c2b7b475 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:14.621507 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5c196-e33c-4024-acdd-e279c2b7b475 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:14.621856 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5c196-e33c-4024-acdd-e279c2b7b475 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:14.623304 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5c196-e33c-4024-acdd-e279c2b7b475 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:14.640892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 623/1254] 10.222.0.64 () {56 vars in 1143 bytes} [Mon Jul 18 02:20:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:14.647356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55770a24-c8ec-48a5-b923-5e64d560fca6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:14.744615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55770a24-c8ec-48a5-b923-5e64d560fca6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:14.777450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998a06c-601e-403b-b61a-c55ce69998b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:14.778121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998a06c-601e-403b-b61a-c55ce69998b6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:14.778409 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998a06c-601e-403b-b61a-c55ce69998b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:14.778688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998a06c-601e-403b-b61a-c55ce69998b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:14.832362 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:14.844177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998a06c-601e-403b-b61a-c55ce69998b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:14.845563 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998a06c-601e-403b-b61a-c55ce69998b6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:14.955126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 632/1255] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:20:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 02:20:14.960957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5c196-e33c-4024-acdd-e279c2b7b475 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:15.057587 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5c196-e33c-4024-acdd-e279c2b7b475 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:15.070679 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:15.090393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005521fa-b4c2-45a3-9162-48068d54696a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:15.091249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005521fa-b4c2-45a3-9162-48068d54696a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:15.091564 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005521fa-b4c2-45a3-9162-48068d54696a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:15.091847 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005521fa-b4c2-45a3-9162-48068d54696a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:15.101693 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005521fa-b4c2-45a3-9162-48068d54696a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:15.103114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005521fa-b4c2-45a3-9162-48068d54696a None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:15.120588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-005521fa-b4c2-45a3-9162-48068d54696a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:15.120588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:15.120588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:15.120588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:15.120588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:15.120588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:15.120588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:15.120588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:15.120588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:15.120588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:15.120588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:15.120588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:15.120588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:20:15.120588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:20:15.120588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:20:15.121635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:20:15.121635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:15.121635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:15.121635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:15.121635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:15.121635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:15.121635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:15.121635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:15.121635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:15.121635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:15.121635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:15.121635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:15.121635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:15.121635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:15.121635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:15.121635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:15.121635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:15.122929 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:20:15.122929 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:20:15.122929 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:15.122929 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:15.122929 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 624/1256] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:20:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:15.127465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998a06c-601e-403b-b61a-c55ce69998b6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:15.214575 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:15.226106 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998a06c-601e-403b-b61a-c55ce69998b6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:15.259203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db79cd-d336-4442-8b8f-990a1c80b531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:15.259863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db79cd-d336-4442-8b8f-990a1c80b531 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:15.260149 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db79cd-d336-4442-8b8f-990a1c80b531 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:15.260426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db79cd-d336-4442-8b8f-990a1c80b531 None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:15.261136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db79cd-d336-4442-8b8f-990a1c80b531 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:15.261443 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db79cd-d336-4442-8b8f-990a1c80b531 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:15.262821 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db79cd-d336-4442-8b8f-990a1c80b531 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:15.274969 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 633/1257] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:15.280274 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005521fa-b4c2-45a3-9162-48068d54696a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:15.379736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005521fa-b4c2-45a3-9162-48068d54696a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:15.419384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b17620-a0cb-4bc3-9301-6599f2b69ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:15.422938 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b17620-a0cb-4bc3-9301-6599f2b69ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:15.422938 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b17620-a0cb-4bc3-9301-6599f2b69ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:15.422938 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b17620-a0cb-4bc3-9301-6599f2b69ec1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:15.429723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b17620-a0cb-4bc3-9301-6599f2b69ec1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:15.431167 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b17620-a0cb-4bc3-9301-6599f2b69ec1 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:15.444471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-f5b17620-a0cb-4bc3-9301-6599f2b69ec1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:20:15.444471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:15.444471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:15.444471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:15.444471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:15.444471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:15.444471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:15.444471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:15.444471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:15.444471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:15.444471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:15.444471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:15.444471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:20:15.444471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:20:15.444471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:20:15.446822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:20:15.446822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:15.446822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:15.446822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:15.446822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:15.446822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:15.446822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:15.446822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:15.446822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:15.446822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:15.446822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:15.446822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:15.446822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:15.446822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:15.446822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:15.446822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:15.446822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:15.447911 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:20:15.447911 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:20:15.447911 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:20:15.447911 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:20:15.447911 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:20:15.447911 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:20:15.447911 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:20:15.447911 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:15.447911 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 625/1258] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:20:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:15.451642 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db79cd-d336-4442-8b8f-990a1c80b531 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:15.553994 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db79cd-d336-4442-8b8f-990a1c80b531 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:15.586904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276628a4-7be2-4599-b01a-fc333489af58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:15.587560 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276628a4-7be2-4599-b01a-fc333489af58 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:15.587846 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276628a4-7be2-4599-b01a-fc333489af58 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:15.588123 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276628a4-7be2-4599-b01a-fc333489af58 None admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:15.588900 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276628a4-7be2-4599-b01a-fc333489af58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:15.589212 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276628a4-7be2-4599-b01a-fc333489af58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:15.590661 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276628a4-7be2-4599-b01a-fc333489af58 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:15.602944 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 634/1259] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:20:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:15.608998 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b17620-a0cb-4bc3-9301-6599f2b69ec1 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:15.635784 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:15.709394 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b17620-a0cb-4bc3-9301-6599f2b69ec1 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:15.742323 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59207985-bb19-4805-921c-1f2f28c038dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:15.742975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59207985-bb19-4805-921c-1f2f28c038dc None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:15.743266 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59207985-bb19-4805-921c-1f2f28c038dc None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:15.743543 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59207985-bb19-4805-921c-1f2f28c038dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:15.744374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59207985-bb19-4805-921c-1f2f28c038dc None admin] RBAC: Adding query filter params (role.id=5dfa34e7a4594751aed7c0495c9a2383, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=213ba948a3f34c39bce3f6db093479eb) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:15.744690 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59207985-bb19-4805-921c-1f2f28c038dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:15.746156 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59207985-bb19-4805-921c-1f2f28c038dc None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:15.751544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 626/1260] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:20:15 2022] GET /identity/v3/role_assignments?user.id=213ba948a3f34c39bce3f6db093479eb&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=5dfa34e7a4594751aed7c0495c9a2383 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:17.698780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b57fe-53c0-457f-9608-30da481b37c8 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:17.699307 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b57fe-53c0-457f-9608-30da481b37c8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:17.699307 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775b57fe-53c0-457f-9608-30da481b37c8 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:17.700695 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 635/1261] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:20:17.705788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3cf2a-29d3-46fc-8717-9e9aa641f48b None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:17.706796 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3cf2a-29d3-46fc-8717-9e9aa641f48b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:17.706982 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3cf2a-29d3-46fc-8717-9e9aa641f48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:17.723416 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-e2f3cf2a-29d3-46fc-8717-9e9aa641f48b None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:20:17.724609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e2f3cf2a-29d3-46fc-8717-9e9aa641f48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:20:17.789497 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 627/1262] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:20:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:20:17.811528 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b57fe-53c0-457f-9608-30da481b37c8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:17.822722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:17.910868 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775b57fe-53c0-457f-9608-30da481b37c8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:17.945923 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fbbd1-f1c9-4889-998c-8970d2faad42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:17.946707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fbbd1-f1c9-4889-998c-8970d2faad42 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:17.947026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fbbd1-f1c9-4889-998c-8970d2faad42 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:17.947302 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fbbd1-f1c9-4889-998c-8970d2faad42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:17.958313 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511fbbd1-f1c9-4889-998c-8970d2faad42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:20:17.964788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-511fbbd1-f1c9-4889-998c-8970d2faad42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:20:17.964788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:17.964788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:17.964788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:17.964788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:17.964788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:17.964788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:17.964788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:17.964788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:17.964788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:17.964788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:17.964788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:17.964788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:20:17.964788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:20:17.964788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:20:17.964788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:20:17.965893 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:20:17.965893 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:20:17.965893 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:20:17.965893 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:20:17.965893 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:17.965893 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:17.965893 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:17.965893 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:17.965893 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:17.965893 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:17.965893 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:17.965893 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:17.965893 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:17.965893 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:17.965893 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:17.965893 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:17.966759 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:17.966759 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:17.966759 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:17.966759 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:17.966759 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:20:17.966759 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:20:17.966759 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:20:17.966759 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:20:17.966759 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:20:17.966759 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:20:17.966759 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:20:17.966759 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:20:17.966759 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 636/1263] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:20:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:17.972229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3cf2a-29d3-46fc-8717-9e9aa641f48b None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:17.991847 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:18.072964 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3cf2a-29d3-46fc-8717-9e9aa641f48b None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:18.105368 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e5c55-87b5-44e1-8b02-8be668781d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:18.106138 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e5c55-87b5-44e1-8b02-8be668781d02 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:18.106419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e5c55-87b5-44e1-8b02-8be668781d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:18.106695 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e5c55-87b5-44e1-8b02-8be668781d02 None admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:18.107429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e5c55-87b5-44e1-8b02-8be668781d02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:18.107733 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e5c55-87b5-44e1-8b02-8be668781d02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:18.109094 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e5c55-87b5-44e1-8b02-8be668781d02 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:18.117399 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 628/1264] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:20:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:18.123437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fbbd1-f1c9-4889-998c-8970d2faad42 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:18.188516 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:18.220706 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511fbbd1-f1c9-4889-998c-8970d2faad42 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:18.252458 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbe1aa-29f8-4b3c-8e22-be7ca428c38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:18.253844 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbe1aa-29f8-4b3c-8e22-be7ca428c38f None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:18.254127 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbe1aa-29f8-4b3c-8e22-be7ca428c38f None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:18.254399 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbe1aa-29f8-4b3c-8e22-be7ca428c38f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:18.264778 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbe1aa-29f8-4b3c-8e22-be7ca428c38f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:18.266247 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbe1aa-29f8-4b3c-8e22-be7ca428c38f None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:18.285937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-d6bbe1aa-29f8-4b3c-8e22-be7ca428c38f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:18.285937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:18.285937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:18.285937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:18.285937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:18.285937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:18.285937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:18.285937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:18.285937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:18.285937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:18.285937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:18.285937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:18.285937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:20:18.285937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:20:18.285937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:20:18.287023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:20:18.287023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:18.287023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:18.287023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:18.287023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:18.287023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:18.287023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:18.287023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:18.287023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:18.287023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:18.287023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:18.287023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:18.287023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:18.287023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:18.287023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:18.287023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:18.287023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:18.288202 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:20:18.288202 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:20:18.288202 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:18.288202 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:20:18.288202 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 637/1265] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:18.294355 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e5c55-87b5-44e1-8b02-8be668781d02 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:18.375448 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:18.393347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e5c55-87b5-44e1-8b02-8be668781d02 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:18.426560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d0b77-d8e6-4ff8-9b31-f1b53b952b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:18.427217 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d0b77-d8e6-4ff8-9b31-f1b53b952b4c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:18.427499 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d0b77-d8e6-4ff8-9b31-f1b53b952b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:18.427772 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d0b77-d8e6-4ff8-9b31-f1b53b952b4c None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:18.428478 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d0b77-d8e6-4ff8-9b31-f1b53b952b4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:18.428780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d0b77-d8e6-4ff8-9b31-f1b53b952b4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:18.430167 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d0b77-d8e6-4ff8-9b31-f1b53b952b4c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:18.441854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 629/1266] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:18.447719 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbe1aa-29f8-4b3c-8e22-be7ca428c38f None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:18.545956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbe1aa-29f8-4b3c-8e22-be7ca428c38f None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:18.565226 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:18.578606 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22506895-bb0a-4114-a0df-1fc12e658cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:18.579401 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22506895-bb0a-4114-a0df-1fc12e658cfe None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:18.579688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22506895-bb0a-4114-a0df-1fc12e658cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:18.579959 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22506895-bb0a-4114-a0df-1fc12e658cfe None admin] PATH_INFO: `/v3/users/placement` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:18.587097 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22506895-bb0a-4114-a0df-1fc12e658cfe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:18.588537 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22506895-bb0a-4114-a0df-1fc12e658cfe None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:18.602936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-22506895-bb0a-4114-a0df-1fc12e658cfe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 02:20:18.602936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:18.602936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:18.602936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:18.602936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:18.602936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:18.602936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:18.602936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:18.602936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:18.602936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:18.602936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:18.602936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:18.602936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:20:18.602936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:20:18.602936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:20:18.602936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:20:18.606713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:18.606713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:18.606713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:20:18.606713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:20:18.606713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:20:18.606713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:20:18.606713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:18.606713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:18.606713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:18.606713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:18.606713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:18.606713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:18.606713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:18.606713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:18.606713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:18.606713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:18.606713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:18.606713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:18.607975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:18.607975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:18.607975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:20:18.607975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:20:18.607975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:20:18.607975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:20:18.607975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:20:18.607975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:20:18.607975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 02:20:18.607975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:20:18.607975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 638/1267] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:20:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:18.610084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d0b77-d8e6-4ff8-9b31-f1b53b952b4c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:18.708383 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d0b77-d8e6-4ff8-9b31-f1b53b952b4c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:18.741204 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a770dc-9280-4aa2-bbea-74865b77f504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:18.741903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a770dc-9280-4aa2-bbea-74865b77f504 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:18.742191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a770dc-9280-4aa2-bbea-74865b77f504 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:18.742473 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a770dc-9280-4aa2-bbea-74865b77f504 None admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:18.743304 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a770dc-9280-4aa2-bbea-74865b77f504 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:18.743619 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a770dc-9280-4aa2-bbea-74865b77f504 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:18.745041 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a770dc-9280-4aa2-bbea-74865b77f504 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:18.753474 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:18.761517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 630/1268] 10.222.0.64 () {56 vars in 1143 bytes} [Mon Jul 18 02:20:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:18.767463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22506895-bb0a-4114-a0df-1fc12e658cfe None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:18.866477 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22506895-bb0a-4114-a0df-1fc12e658cfe None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:18.898926 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7502417-9529-4a99-9b62-73c3bc4ff6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:18.917411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7502417-9529-4a99-9b62-73c3bc4ff6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:18.917411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7502417-9529-4a99-9b62-73c3bc4ff6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:18.917411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7502417-9529-4a99-9b62-73c3bc4ff6d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:18.917411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7502417-9529-4a99-9b62-73c3bc4ff6d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:18.917411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7502417-9529-4a99-9b62-73c3bc4ff6d6 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:18.929507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-e7502417-9529-4a99-9b62-73c3bc4ff6d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:18.929507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:18.929507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:18.929507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:18.929507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:18.929507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:18.929507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:18.929507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:18.929507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:18.929507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:18.929507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:18.929507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:18.929507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:20:18.929507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:20:18.929507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:20:18.930531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:20:18.930531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:18.930531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:18.930531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:18.930531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:18.930531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:18.930531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:18.930531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:18.930531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:18.930531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:18.930531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:18.930531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:18.930531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:18.930531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:18.930531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:18.930531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:18.930531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:18.931488 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:20:18.931488 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:20:18.931488 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:18.931488 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:20:18.931488 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 639/1269] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:20:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:18.936459 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a770dc-9280-4aa2-bbea-74865b77f504 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:19.033577 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a770dc-9280-4aa2-bbea-74865b77f504 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:19.066817 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb42e8-bd76-4b72-986a-0f2c3bdb24c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:19.067471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb42e8-bd76-4b72-986a-0f2c3bdb24c4 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:19.067751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb42e8-bd76-4b72-986a-0f2c3bdb24c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:19.068023 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb42e8-bd76-4b72-986a-0f2c3bdb24c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:19.068731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb42e8-bd76-4b72-986a-0f2c3bdb24c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:19.069035 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb42e8-bd76-4b72-986a-0f2c3bdb24c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:19.070433 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb42e8-bd76-4b72-986a-0f2c3bdb24c4 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:19.081891 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 631/1270] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:20:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:19.087635 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7502417-9529-4a99-9b62-73c3bc4ff6d6 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:19.134823 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:19.184756 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7502417-9529-4a99-9b62-73c3bc4ff6d6 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:19.217985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e07a7-0cfc-46a3-ae69-f17efc5a2abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:19.218765 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e07a7-0cfc-46a3-ae69-f17efc5a2abf None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:19.219050 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e07a7-0cfc-46a3-ae69-f17efc5a2abf None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:19.219327 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12e07a7-0cfc-46a3-ae69-f17efc5a2abf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:19.225940 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e07a7-0cfc-46a3-ae69-f17efc5a2abf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:19.227195 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12e07a7-0cfc-46a3-ae69-f17efc5a2abf None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:19.240555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-b12e07a7-0cfc-46a3-ae69-f17efc5a2abf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:20:19.240555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:19.240555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:19.240555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:19.240555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:19.240555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:19.240555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:19.240555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:19.240555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:19.240555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:19.240555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:19.240555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:19.240555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:20:19.240555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:20:19.240555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:20:19.250404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:20:19.250404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:19.250404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:19.250404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:19.250404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:19.250404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:19.250404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:19.250404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:19.250404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:19.250404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:19.250404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:19.250404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:19.250404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:19.250404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:19.250404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:19.250404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:19.250404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:19.251513 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:20:19.251513 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:20:19.251513 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:20:19.251513 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:20:19.251513 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:20:19.251513 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:20:19.251513 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:20:19.251513 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:20:19.251513 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 640/1271] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:20:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:19.252183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb42e8-bd76-4b72-986a-0f2c3bdb24c4 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:19.304493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:19.345815 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb42e8-bd76-4b72-986a-0f2c3bdb24c4 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:19.377545 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a94825-4018-4a87-9c97-a797ca33fcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:19.378747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a94825-4018-4a87-9c97-a797ca33fcb1 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:19.379032 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a94825-4018-4a87-9c97-a797ca33fcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:19.379313 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a94825-4018-4a87-9c97-a797ca33fcb1 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:19.380092 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a94825-4018-4a87-9c97-a797ca33fcb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:19.380438 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a94825-4018-4a87-9c97-a797ca33fcb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:19.381931 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a94825-4018-4a87-9c97-a797ca33fcb1 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:19.395393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 632/1272] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:20:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:19.401361 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e07a7-0cfc-46a3-ae69-f17efc5a2abf None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:19.496289 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:19.505328 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12e07a7-0cfc-46a3-ae69-f17efc5a2abf None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:19.538386 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3269a-39da-4cba-aa50-c211fc561fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:19.539268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3269a-39da-4cba-aa50-c211fc561fe0 None admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:19.539549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3269a-39da-4cba-aa50-c211fc561fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:19.539826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3269a-39da-4cba-aa50-c211fc561fe0 None admin] PATH_INFO: `/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/213ba948a3f34c39bce3f6db093479eb/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:19.541789 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3269a-39da-4cba-aa50-c211fc561fe0 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f6f840feba049ee9eeaf7bf0b300730, user_id=213ba948a3f34c39bce3f6db093479eb, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:19.543207 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3269a-39da-4cba-aa50-c211fc561fe0 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:19.639313 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 641/1273] 10.222.0.64 () {58 vars in 1439 bytes} [Mon Jul 18 02:20:19 2022] PUT /identity/v3/projects/1f6f840feba049ee9eeaf7bf0b300730/users/213ba948a3f34c39bce3f6db093479eb/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:20:21.610607 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94d9c8-0a2c-400c-bbed-06c8b4a4f45f None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:21.613464 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94d9c8-0a2c-400c-bbed-06c8b4a4f45f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:21.613775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94d9c8-0a2c-400c-bbed-06c8b4a4f45f None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:21.615180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 633/1274] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:20:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:20:21.623020 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a36a2-6d44-4f0d-a888-f6bc59ba73e3 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:21.623557 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a36a2-6d44-4f0d-a888-f6bc59ba73e3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:21.624071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a36a2-6d44-4f0d-a888-f6bc59ba73e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:21.645829 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c77a36a2-6d44-4f0d-a888-f6bc59ba73e3 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:20:21.647027 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c77a36a2-6d44-4f0d-a888-f6bc59ba73e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:20:21.713651 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 642/1275] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:20:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:20:21.736507 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94d9c8-0a2c-400c-bbed-06c8b4a4f45f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:21.836838 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94d9c8-0a2c-400c-bbed-06c8b4a4f45f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:21.854188 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:21.870802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d31a78-d074-412f-9c19-4f2edab85f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:21.871589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d31a78-d074-412f-9c19-4f2edab85f0a None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:21.871875 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d31a78-d074-412f-9c19-4f2edab85f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:21.872151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d31a78-d074-412f-9c19-4f2edab85f0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:21.881775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d31a78-d074-412f-9c19-4f2edab85f0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 02:20:21.889420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-d6d31a78-d074-412f-9c19-4f2edab85f0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:20:21.889420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:21.889420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:21.889420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:21.889420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:21.889420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:21.889420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:21.889420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:21.889420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:21.889420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:21.889420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:21.889420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:21.889420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 02:20:21.889420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 02:20:21.889420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 02:20:21.889420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 02:20:21.890541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 02:20:21.890541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 02:20:21.890541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 02:20:21.890541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 02:20:21.890541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:21.890541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:21.890541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:21.890541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:21.890541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:21.890541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:21.890541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:21.890541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:21.890541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:21.890541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:21.890541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:21.890541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:21.891589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:21.891589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:21.891589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:21.891589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:21.891589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 02:20:21.891589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 02:20:21.891589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 02:20:21.891589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 02:20:21.891589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 02:20:21.891589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 02:20:21.891589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 02:20:21.891589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:21.891589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 634/1276] 10.222.0.64 () {56 vars in 1096 bytes} [Mon Jul 18 02:20:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:21.896697 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a36a2-6d44-4f0d-a888-f6bc59ba73e3 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:21.980515 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:22.001494 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a36a2-6d44-4f0d-a888-f6bc59ba73e3 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:22.035798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8c08c-9794-4556-ac78-7f20df185d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:22.036477 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8c08c-9794-4556-ac78-7f20df185d56 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:22.036768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8c08c-9794-4556-ac78-7f20df185d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:22.037051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b8c08c-9794-4556-ac78-7f20df185d56 None admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:22.038080 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8c08c-9794-4556-ac78-7f20df185d56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:22.038400 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8c08c-9794-4556-ac78-7f20df185d56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:22.039805 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b8c08c-9794-4556-ac78-7f20df185d56 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:22.047903 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 643/1277] 10.222.0.64 () {56 vars in 1099 bytes} [Mon Jul 18 02:20:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:22.053901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d31a78-d074-412f-9c19-4f2edab85f0a None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:22.154753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d31a78-d074-412f-9c19-4f2edab85f0a None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:22.188560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7acca1-cda0-49bf-b73f-7e1fed8cb5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:22.189350 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7acca1-cda0-49bf-b73f-7e1fed8cb5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:22.189638 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7acca1-cda0-49bf-b73f-7e1fed8cb5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:22.189974 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7acca1-cda0-49bf-b73f-7e1fed8cb5b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:22.200354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7acca1-cda0-49bf-b73f-7e1fed8cb5b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:22.201855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7acca1-cda0-49bf-b73f-7e1fed8cb5b1 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:22.219542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-ba7acca1-cda0-49bf-b73f-7e1fed8cb5b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:22.219542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:22.219542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:22.219542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:22.219542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:22.219542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:22.219542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:22.219542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:22.219542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:22.219542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:22.219542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:22.219542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:22.219542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:20:22.219542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:20:22.219542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:20:22.220570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:20:22.220570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:22.220570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:22.220570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:22.220570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:22.220570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:22.220570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:22.220570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:22.220570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:22.220570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:22.220570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:22.220570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:22.220570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:22.220570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:22.220570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:22.220570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:22.220570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:22.222195 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:20:22.222195 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:20:22.222195 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:22.222195 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:22.222195 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 635/1278] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:20:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:22.227116 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8c08c-9794-4556-ac78-7f20df185d56 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:22.333672 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b8c08c-9794-4556-ac78-7f20df185d56 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:22.373210 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261c306-50cb-4e4f-a9b6-7077d609957e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:22.373994 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261c306-50cb-4e4f-a9b6-7077d609957e None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:22.374764 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261c306-50cb-4e4f-a9b6-7077d609957e None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:22.374764 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261c306-50cb-4e4f-a9b6-7077d609957e None admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:22.375554 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261c306-50cb-4e4f-a9b6-7077d609957e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:22.375554 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261c306-50cb-4e4f-a9b6-7077d609957e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:22.376824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261c306-50cb-4e4f-a9b6-7077d609957e None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:22.388480 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 644/1279] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:22.394867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7acca1-cda0-49bf-b73f-7e1fed8cb5b1 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:22.426840 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:22.492659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7acca1-cda0-49bf-b73f-7e1fed8cb5b1 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:22.525491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fff8c-6985-4f8c-ac11-2bac284ffd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:22.526326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fff8c-6985-4f8c-ac11-2bac284ffd44 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:22.526603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fff8c-6985-4f8c-ac11-2bac284ffd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:22.526872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fff8c-6985-4f8c-ac11-2bac284ffd44 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:22.534192 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fff8c-6985-4f8c-ac11-2bac284ffd44 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:22.535671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fff8c-6985-4f8c-ac11-2bac284ffd44 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:22.549832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-7a8fff8c-6985-4f8c-ac11-2bac284ffd44 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 02:20:22.549832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:22.549832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:22.549832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:22.549832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:22.549832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:22.549832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:22.549832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:22.549832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:22.549832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:22.549832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:22.549832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:22.549832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 02:20:22.549832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 02:20:22.549832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 02:20:22.549832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 02:20:22.550806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:22.550806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:22.550806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 02:20:22.550806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:20:22.550806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 02:20:22.550806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 02:20:22.550806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:22.550806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:22.550806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:22.550806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:22.550806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:22.550806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:22.550806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:22.550806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:22.550806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:22.550806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:22.550806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:22.550806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:22.551872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:22.551872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:22.551872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 02:20:22.551872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 02:20:22.551872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 02:20:22.551872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 02:20:22.551872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 02:20:22.551872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 02:20:22.551872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 02:20:22.551872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:22.551872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 636/1280] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:20:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:22.556811 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261c306-50cb-4e4f-a9b6-7077d609957e None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:22.565498 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:22.662425 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261c306-50cb-4e4f-a9b6-7077d609957e None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:22.703395 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161c414-7220-41a3-94ee-373a80c8f7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:22.704334 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161c414-7220-41a3-94ee-373a80c8f7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:22.704760 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161c414-7220-41a3-94ee-373a80c8f7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:22.705068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161c414-7220-41a3-94ee-373a80c8f7f9 None admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:22.706533 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161c414-7220-41a3-94ee-373a80c8f7f9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:22.706841 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161c414-7220-41a3-94ee-373a80c8f7f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:22.708321 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161c414-7220-41a3-94ee-373a80c8f7f9 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:22.730421 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 645/1281] 10.222.0.64 () {56 vars in 1143 bytes} [Mon Jul 18 02:20:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:22.736230 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fff8c-6985-4f8c-ac11-2bac284ffd44 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:22.826368 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:22.835649 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fff8c-6985-4f8c-ac11-2bac284ffd44 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:22.867934 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d559b-136c-4741-9679-ccb72248542f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:22.868588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d559b-136c-4741-9679-ccb72248542f None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:22.868871 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d559b-136c-4741-9679-ccb72248542f None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:22.869150 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d559b-136c-4741-9679-ccb72248542f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:22.934405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d559b-136c-4741-9679-ccb72248542f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:22.935854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d559b-136c-4741-9679-ccb72248542f None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:23.033778 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:23.045764 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 637/1282] 10.222.0.64 () {58 vars in 1282 bytes} [Mon Jul 18 02:20:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 02:20:23.052260 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161c414-7220-41a3-94ee-373a80c8f7f9 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:23.117353 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:23.155367 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161c414-7220-41a3-94ee-373a80c8f7f9 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:23.188938 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a5b7e-3013-4b42-9d14-24c3ce9fdbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:23.192437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a5b7e-3013-4b42-9d14-24c3ce9fdbd5 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:23.192437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a5b7e-3013-4b42-9d14-24c3ce9fdbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:23.192437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8a5b7e-3013-4b42-9d14-24c3ce9fdbd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:23.200842 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a5b7e-3013-4b42-9d14-24c3ce9fdbd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:23.202393 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8a5b7e-3013-4b42-9d14-24c3ce9fdbd5 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:23.219873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-de8a5b7e-3013-4b42-9d14-24c3ce9fdbd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:23.219873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:23.219873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:23.219873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:23.219873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:23.219873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:23.219873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:23.219873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:23.219873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:23.219873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:23.219873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:23.219873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:23.219873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 02:20:23.219873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 02:20:23.219873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 02:20:23.223591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 02:20:23.223591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:23.223591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:23.223591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:23.223591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:23.223591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:23.223591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:23.223591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:23.223591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:23.223591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:23.223591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:23.223591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:23.223591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:23.223591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:23.223591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:23.223591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:23.223591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:23.224661 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 02:20:23.224661 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 02:20:23.224661 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 02:20:23.224661 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:20:23.224661 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 646/1283] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:20:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:23.227456 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d559b-136c-4741-9679-ccb72248542f None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:23.323697 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d559b-136c-4741-9679-ccb72248542f None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:23.357344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bea61-c988-48b1-be92-6377d581425c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:23.358044 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bea61-c988-48b1-be92-6377d581425c None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:23.358335 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bea61-c988-48b1-be92-6377d581425c None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:23.358616 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bea61-c988-48b1-be92-6377d581425c None admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:23.359338 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bea61-c988-48b1-be92-6377d581425c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:23.359648 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bea61-c988-48b1-be92-6377d581425c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:23.361039 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bea61-c988-48b1-be92-6377d581425c None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:23.373534 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 638/1284] 10.222.0.64 () {56 vars in 1109 bytes} [Mon Jul 18 02:20:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:23.379808 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a5b7e-3013-4b42-9d14-24c3ce9fdbd5 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:23.478536 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8a5b7e-3013-4b42-9d14-24c3ce9fdbd5 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:23.492800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:23.515835 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7b9cf-5a66-4806-affd-9f365959cb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:23.516631 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7b9cf-5a66-4806-affd-9f365959cb76 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:23.516917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7b9cf-5a66-4806-affd-9f365959cb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:23.517194 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7b9cf-5a66-4806-affd-9f365959cb76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:23.524315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7b9cf-5a66-4806-affd-9f365959cb76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:23.525802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7b9cf-5a66-4806-affd-9f365959cb76 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:23.540915 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application [None req-fdc7b9cf-5a66-4806-affd-9f365959cb76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:20:23.540915 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:23.540915 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:23.540915 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:23.540915 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:23.540915 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:23.540915 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:23.540915 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:23.540915 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:23.540915 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:23.540915 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:23.540915 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:23.540915 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 02:20:23.540915 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 02:20:23.540915 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 02:20:23.542001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 02:20:23.542001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:23.542001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:23.542001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:23.542001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:23.542001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:23.542001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:23.542001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:23.542001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:23.542001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:23.542001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:23.542001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:23.542001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:23.542001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:23.542001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:23.542001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:23.542001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:23.542896 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 02:20:23.542896 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 02:20:23.542896 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 02:20:23.542896 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 02:20:23.542896 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 02:20:23.542896 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 02:20:23.542896 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 02:20:23.542896 dv-cinder-850015-3-smb devstack@keystone.service[80358]: ERROR keystone.server.flask.application Jul 18 02:20:23.542896 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 647/1285] 10.222.0.64 () {56 vars in 1111 bytes} [Mon Jul 18 02:20:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:23.548141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bea61-c988-48b1-be92-6377d581425c None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:23.598168 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:23.646318 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bea61-c988-48b1-be92-6377d581425c None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:23.679189 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd13e2-ac40-4fad-aed3-afc78e88fb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:23.679847 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd13e2-ac40-4fad-aed3-afc78e88fb22 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:23.680131 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd13e2-ac40-4fad-aed3-afc78e88fb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:23.680405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd13e2-ac40-4fad-aed3-afc78e88fb22 None admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:23.681187 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd13e2-ac40-4fad-aed3-afc78e88fb22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:23.681499 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd13e2-ac40-4fad-aed3-afc78e88fb22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:23.682954 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd13e2-ac40-4fad-aed3-afc78e88fb22 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:23.695409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 639/1286] 10.222.0.64 () {56 vars in 1148 bytes} [Mon Jul 18 02:20:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:23.701811 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7b9cf-5a66-4806-affd-9f365959cb76 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:23.799762 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7b9cf-5a66-4806-affd-9f365959cb76 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:23.832556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f1e99-c534-4e57-badc-b1d956e65d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:23.833194 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f1e99-c534-4e57-badc-b1d956e65d3b None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:23.833476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f1e99-c534-4e57-badc-b1d956e65d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:23.833897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f1e99-c534-4e57-badc-b1d956e65d3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:23.834626 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f1e99-c534-4e57-badc-b1d956e65d3b None admin] RBAC: Adding query filter params (role.id=5dfa34e7a4594751aed7c0495c9a2383, scope.project.id=1f6f840feba049ee9eeaf7bf0b300730, user.id=213ba948a3f34c39bce3f6db093479eb) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:23.834936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f1e99-c534-4e57-badc-b1d956e65d3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:23.836346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f1e99-c534-4e57-badc-b1d956e65d3b None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:23.842051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 648/1287] 10.222.0.64 () {56 vars in 1374 bytes} [Mon Jul 18 02:20:23 2022] GET /identity/v3/role_assignments?user.id=213ba948a3f34c39bce3f6db093479eb&scope.project.id=1f6f840feba049ee9eeaf7bf0b300730&role.id=5dfa34e7a4594751aed7c0495c9a2383 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:25.850195 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde90017-1374-41ab-8f93-ff581b457dc2 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:25.850821 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde90017-1374-41ab-8f93-ff581b457dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:25.850821 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde90017-1374-41ab-8f93-ff581b457dc2 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:25.852158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 640/1288] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:20:25.857296 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c56294-b00f-47e6-83b0-4db2cc8c213b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:25.857735 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c56294-b00f-47e6-83b0-4db2cc8c213b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:25.858708 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c56294-b00f-47e6-83b0-4db2cc8c213b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:25.874649 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-02c56294-b00f-47e6-83b0-4db2cc8c213b None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:20:25.875875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-02c56294-b00f-47e6-83b0-4db2cc8c213b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:20:25.905627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:25.941676 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 649/1289] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:20:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:20:25.964006 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde90017-1374-41ab-8f93-ff581b457dc2 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:26.062614 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde90017-1374-41ab-8f93-ff581b457dc2 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:26.072841 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:26.095452 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568c1e2-81ac-4265-bfae-c4286fabb1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:26.096797 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568c1e2-81ac-4265-bfae-c4286fabb1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:26.097085 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568c1e2-81ac-4265-bfae-c4286fabb1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:26.097363 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4568c1e2-81ac-4265-bfae-c4286fabb1d4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:26.098043 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568c1e2-81ac-4265-bfae-c4286fabb1d4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:26.099416 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4568c1e2-81ac-4265-bfae-c4286fabb1d4 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:26.111050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-4568c1e2-81ac-4265-bfae-c4286fabb1d4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 02:20:26.111050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:26.111050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:20:26.111050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:20:26.111050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:20:26.111050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:20:26.111050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:20:26.111050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:20:26.111050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 02:20:26.111050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:26.111050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:20:26.111050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:26.111050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:26.111050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:26.111050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:26.111050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:26.111050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:26.112091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:26.112091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:26.112091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:26.112091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:26.112091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:26.112091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:26.112091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:20:26.112091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:20:26.112091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:20:26.112091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:20:26.112091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:26.112091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:26.112091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:26.112091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:26.112091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:26.112091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:26.112975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:26.112975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:26.112975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:26.112975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:26.112975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:26.112975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:26.112975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:26.112975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:26.112975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:26.112975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:26.112975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:20:26.112975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:20:26.112975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 02:20:26.112975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:26.112975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 641/1290] 10.222.0.64 () {56 vars in 1117 bytes} [Mon Jul 18 02:20:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:26.118230 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c56294-b00f-47e6-83b0-4db2cc8c213b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:26.217595 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c56294-b00f-47e6-83b0-4db2cc8c213b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:26.250073 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae0499-bd00-4800-8cb0-2e469efa88be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:26.250746 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae0499-bd00-4800-8cb0-2e469efa88be None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:26.251034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae0499-bd00-4800-8cb0-2e469efa88be None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:26.251315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae0499-bd00-4800-8cb0-2e469efa88be None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:26.252531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae0499-bd00-4800-8cb0-2e469efa88be None admin] RBAC: Adding query filter params (name=placement) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:26.252843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae0499-bd00-4800-8cb0-2e469efa88be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:26.254254 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae0499-bd00-4800-8cb0-2e469efa88be None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:26.259131 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 650/1291] 10.222.0.64 () {56 vars in 1116 bytes} [Mon Jul 18 02:20:26 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:26.264860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568c1e2-81ac-4265-bfae-c4286fabb1d4 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:26.365210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4568c1e2-81ac-4265-bfae-c4286fabb1d4 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:26.397684 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af00b26c-e8c9-43c4-a8ba-312542001198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:26.398381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00b26c-e8c9-43c4-a8ba-312542001198 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:26.398685 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00b26c-e8c9-43c4-a8ba-312542001198 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:26.398960 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af00b26c-e8c9-43c4-a8ba-312542001198 None admin] PATH_INFO: `/v3/services` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:26.399688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00b26c-e8c9-43c4-a8ba-312542001198 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:26.399992 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00b26c-e8c9-43c4-a8ba-312542001198 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:26.401354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af00b26c-e8c9-43c4-a8ba-312542001198 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:26.405809 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 642/1292] 10.222.0.64 () {56 vars in 1116 bytes} [Mon Jul 18 02:20:26 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:28.410617 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fe7b2-847d-40ce-a4f5-4a4e445ba38f None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:28.411140 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fe7b2-847d-40ce-a4f5-4a4e445ba38f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:28.411140 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7fe7b2-847d-40ce-a4f5-4a4e445ba38f None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:28.412724 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 651/1293] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:20:28.418125 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50d5ee-14fb-4720-91e8-f915313b2eed None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:28.418561 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50d5ee-14fb-4720-91e8-f915313b2eed None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:28.418714 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd50d5ee-14fb-4720-91e8-f915313b2eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:28.435254 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-dd50d5ee-14fb-4720-91e8-f915313b2eed None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:20:28.438220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-dd50d5ee-14fb-4720-91e8-f915313b2eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:20:28.470143 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:28.506835 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 643/1294] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:20:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:20:28.530023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fe7b2-847d-40ce-a4f5-4a4e445ba38f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:28.560634 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:28.627761 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7fe7b2-847d-40ce-a4f5-4a4e445ba38f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:28.661494 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf55452-1298-42a2-b733-115213f98d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:28.662128 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf55452-1298-42a2-b733-115213f98d7d None admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:28.662668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf55452-1298-42a2-b733-115213f98d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:28.662946 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf55452-1298-42a2-b733-115213f98d7d None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:28.663653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf55452-1298-42a2-b733-115213f98d7d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:28.665072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf55452-1298-42a2-b733-115213f98d7d None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:28.821245 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 652/1295] 10.222.0.64 () {60 vars in 1141 bytes} [Mon Jul 18 02:20:28 2022] POST /identity/v3/services => generated 246 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:20:30.850437 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9679216-d998-4282-af98-2ac975846ca5 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:30.850967 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9679216-d998-4282-af98-2ac975846ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:30.850967 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9679216-d998-4282-af98-2ac975846ca5 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:30.852361 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 644/1296] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:20:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:20:30.857496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5f468-5a46-429a-b8e8-03175fdaec0e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:30.857972 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5f468-5a46-429a-b8e8-03175fdaec0e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:30.858100 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b5f468-5a46-429a-b8e8-03175fdaec0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:30.875118 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-11b5f468-5a46-429a-b8e8-03175fdaec0e None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:20:30.876321 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-11b5f468-5a46-429a-b8e8-03175fdaec0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:20:30.947468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 653/1297] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:20:30 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:20:30.969471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9679216-d998-4282-af98-2ac975846ca5 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:31.068367 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9679216-d998-4282-af98-2ac975846ca5 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:31.102044 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201a9d7-c6bf-488e-9717-01570e856645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:31.102770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201a9d7-c6bf-488e-9717-01570e856645 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:31.103053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201a9d7-c6bf-488e-9717-01570e856645 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:31.103330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b201a9d7-c6bf-488e-9717-01570e856645 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:31.103969 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201a9d7-c6bf-488e-9717-01570e856645 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:31.105388 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b201a9d7-c6bf-488e-9717-01570e856645 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:31.117180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-b201a9d7-c6bf-488e-9717-01570e856645 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 02:20:31.117180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:31.117180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:20:31.117180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:20:31.117180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:20:31.117180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:20:31.117180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:20:31.117180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:20:31.117180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 02:20:31.117180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:31.117180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:20:31.117180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:31.117180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:31.117180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:31.117180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:31.117180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:31.117180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:31.118409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:31.118409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:31.118409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:31.118409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:31.118409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:31.118409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:31.118409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:20:31.118409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:20:31.118409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:20:31.118409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:20:31.118409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:31.118409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:31.118409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:31.118409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:31.118409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:31.118409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:31.119671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:31.119671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:31.119671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:31.119671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:31.119671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:31.119671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:31.119671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:31.119671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:31.119671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:31.119671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:31.119671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:20:31.119671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:20:31.119671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 02:20:31.119671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:31.119671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 645/1298] 10.222.0.64 () {56 vars in 1117 bytes} [Mon Jul 18 02:20:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:31.124429 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5f468-5a46-429a-b8e8-03175fdaec0e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:31.143411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:31.221888 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b5f468-5a46-429a-b8e8-03175fdaec0e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:31.254751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d4a50-db34-40c8-b50b-a30230cfa403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:31.255406 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d4a50-db34-40c8-b50b-a30230cfa403 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:31.255687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d4a50-db34-40c8-b50b-a30230cfa403 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:31.255961 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418d4a50-db34-40c8-b50b-a30230cfa403 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:31.256655 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d4a50-db34-40c8-b50b-a30230cfa403 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:31.256960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d4a50-db34-40c8-b50b-a30230cfa403 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:31.258342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418d4a50-db34-40c8-b50b-a30230cfa403 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:31.263380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 654/1299] 10.222.0.64 () {56 vars in 1116 bytes} [Mon Jul 18 02:20:31 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:31.270182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201a9d7-c6bf-488e-9717-01570e856645 None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:31.301930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:31.368539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b201a9d7-c6bf-488e-9717-01570e856645 None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:31.400714 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cf45f-7d1e-42b3-979b-93b148cc65d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:31.401368 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cf45f-7d1e-42b3-979b-93b148cc65d6 None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:31.401655 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cf45f-7d1e-42b3-979b-93b148cc65d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:31.401965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cf45f-7d1e-42b3-979b-93b148cc65d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:31.402755 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5cf45f-7d1e-42b3-979b-93b148cc65d6 None admin] RBAC: Adding query filter params (interface=public, service_id=2511fc16472b47faa3afd11512baa460, region_id=RegionOne) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:31.403069 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5cf45f-7d1e-42b3-979b-93b148cc65d6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:31.404445 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5cf45f-7d1e-42b3-979b-93b148cc65d6 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:31.409895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 646/1300] 10.222.0.64 () {56 vars in 1251 bytes} [Mon Jul 18 02:20:31 2022] GET /identity/v3/endpoints?service_id=2511fc16472b47faa3afd11512baa460&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:31.415737 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d4a50-db34-40c8-b50b-a30230cfa403 None admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:31.498704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:31.519579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418d4a50-db34-40c8-b50b-a30230cfa403 None admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:31.555569 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf8c79b-d6f7-4546-866e-895c44519d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:31.556242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8c79b-d6f7-4546-866e-895c44519d85 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:31.556523 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8c79b-d6f7-4546-866e-895c44519d85 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:31.556795 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf8c79b-d6f7-4546-866e-895c44519d85 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:31.557473 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8c79b-d6f7-4546-866e-895c44519d85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:31.558912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf8c79b-d6f7-4546-866e-895c44519d85 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:31.566993 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 655/1301] 10.222.0.64 () {56 vars in 1087 bytes} [Mon Jul 18 02:20:31 2022] GET /identity/v3/services => generated 2191 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:20:33.605956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d4159-c28e-4e58-b485-d658c2f2713b None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:33.606502 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d4159-c28e-4e58-b485-d658c2f2713b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:33.606502 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d4159-c28e-4e58-b485-d658c2f2713b None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:33.607870 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 647/1302] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:20:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:20:33.613635 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58fc0c-317f-4a27-b827-74a62eda84be None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:33.614124 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58fc0c-317f-4a27-b827-74a62eda84be None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:33.614220 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58fc0c-317f-4a27-b827-74a62eda84be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:33.632222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6d58fc0c-317f-4a27-b827-74a62eda84be None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:20:33.633414 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6d58fc0c-317f-4a27-b827-74a62eda84be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:20:33.698468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 656/1303] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:20:33 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 02:20:33.721474 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d4159-c28e-4e58-b485-d658c2f2713b None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:33.819329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:33.825910 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d4159-c28e-4e58-b485-d658c2f2713b None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:33.862213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421edb3-866d-48bc-8511-54eb2d7062ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:33.862982 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421edb3-866d-48bc-8511-54eb2d7062ab None admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:33.863270 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421edb3-866d-48bc-8511-54eb2d7062ab None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:33.863544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421edb3-866d-48bc-8511-54eb2d7062ab None admin] PATH_INFO: `/v3/services/placement` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:33.864233 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421edb3-866d-48bc-8511-54eb2d7062ab None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:33.865606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421edb3-866d-48bc-8511-54eb2d7062ab None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:33.877490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application [None req-f421edb3-866d-48bc-8511-54eb2d7062ab None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 02:20:33.877490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:33.877490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 02:20:33.877490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 02:20:33.877490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 02:20:33.877490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 02:20:33.877490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 02:20:33.877490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:20:33.877490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 02:20:33.877490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:33.877490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 02:20:33.877490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:33.877490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 02:20:33.877490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 02:20:33.877490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 02:20:33.877490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 02:20:33.877490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 02:20:33.878682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 02:20:33.878682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 02:20:33.878682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 02:20:33.878682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 02:20:33.878682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 02:20:33.878682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 02:20:33.878682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 02:20:33.878682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 02:20:33.878682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 02:20:33.878682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 02:20:33.878682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 02:20:33.878682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 02:20:33.878682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 02:20:33.878682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 02:20:33.878682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 02:20:33.878682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 02:20:33.879892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 02:20:33.879892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application with Lock( Jul 18 02:20:33.879892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 02:20:33.879892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self._enter() Jul 18 02:20:33.879892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 02:20:33.879892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 02:20:33.879892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 02:20:33.879892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application return self.creator() Jul 18 02:20:33.879892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 02:20:33.879892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application created_value = creator( Jul 18 02:20:33.879892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 02:20:33.879892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 02:20:33.879892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 02:20:33.879892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: ERROR keystone.server.flask.application Jul 18 02:20:33.879892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 648/1304] 10.222.0.64 () {56 vars in 1117 bytes} [Mon Jul 18 02:20:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 02:20:33.884864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58fc0c-317f-4a27-b827-74a62eda84be None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:33.960695 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:33.982771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58fc0c-317f-4a27-b827-74a62eda84be None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:34.016575 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7996e-23f6-4916-9d08-185f22da0ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:34.017824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7996e-23f6-4916-9d08-185f22da0ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:34.018114 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7996e-23f6-4916-9d08-185f22da0ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:34.018396 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7996e-23f6-4916-9d08-185f22da0ea2 None admin] PATH_INFO: `/v3/services` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:34.019202 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7996e-23f6-4916-9d08-185f22da0ea2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:20:34.019520 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7996e-23f6-4916-9d08-185f22da0ea2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:34.020897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7996e-23f6-4916-9d08-185f22da0ea2 None admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:34.026032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 657/1305] 10.222.0.64 () {56 vars in 1116 bytes} [Mon Jul 18 02:20:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:20:34.031841 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421edb3-866d-48bc-8511-54eb2d7062ab None admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:20:34.130232 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421edb3-866d-48bc-8511-54eb2d7062ab None admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:20:34.165875 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81062fe-0f0a-4695-a115-3dc033cacd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:20:34.166533 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81062fe-0f0a-4695-a115-3dc033cacd03 None admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:20:34.166821 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81062fe-0f0a-4695-a115-3dc033cacd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:20:34.167092 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81062fe-0f0a-4695-a115-3dc033cacd03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:20:34.167829 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81062fe-0f0a-4695-a115-3dc033cacd03 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:20:34.169196 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81062fe-0f0a-4695-a115-3dc033cacd03 None admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:20:34.303164 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 649/1306] 10.222.0.64 () {60 vars in 1144 bytes} [Mon Jul 18 02:20:34 2022] POST /identity/v3/endpoints => generated 331 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:20:44.031877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=30 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:20:44.298626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:54.355679 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73362c-9750-4a64-a114-df2aa1277a7f None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:27:54.356247 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73362c-9750-4a64-a114-df2aa1277a7f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:27:54.356247 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73362c-9750-4a64-a114-df2aa1277a7f None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:27:54.362940 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306f4ac-2522-4cd9-b84d-a36f7937856d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:27:54.363415 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306f4ac-2522-4cd9-b84d-a36f7937856d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:27:54.363513 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306f4ac-2522-4cd9-b84d-a36f7937856d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:27:54.366875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 658/1307] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:27:54 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:27:54.451563 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-4306f4ac-2522-4cd9-b84d-a36f7937856d None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:27:54.452915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4306f4ac-2522-4cd9-b84d-a36f7937856d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:27:54.557527 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 650/1308] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:27:54.610252 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38b907-ae20-4e0a-9d5c-9856a8d511e5 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:27:54.610600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38b907-ae20-4e0a-9d5c-9856a8d511e5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:27:54.610799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c38b907-ae20-4e0a-9d5c-9856a8d511e5 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:27:54.612478 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 659/1309] 10.222.0.64 () {54 vars in 965 bytes} [Mon Jul 18 02:27:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:27:54.621565 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f433a2-9efe-41b6-8110-c3b2db470a01 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:27:54.621994 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f433a2-9efe-41b6-8110-c3b2db470a01 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:27:54.622185 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f433a2-9efe-41b6-8110-c3b2db470a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:27:54.729771 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-84f433a2-9efe-41b6-8110-c3b2db470a01 None None] MFA Rules not processed for user `fa9e6d3fe3e740e6aedab33d727ec478`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:27:54.731591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-84f433a2-9efe-41b6-8110-c3b2db470a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:27:54.757990 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:54.819798 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 651/1310] 10.222.0.64 () {58 vars in 1062 bytes} [Mon Jul 18 02:27:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:27:54.834081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38b907-ae20-4e0a-9d5c-9856a8d511e5 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:27:54.835791 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6c38b907-ae20-4e0a-9d5c-9856a8d511e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:27:54.971611 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c38b907-ae20-4e0a-9d5c-9856a8d511e5 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:27:55.051959 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fc373-d18a-4390-8c47-33d24ed882b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:27:55.052720 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fc373-d18a-4390-8c47-33d24ed882b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:27:55.053096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fc373-d18a-4390-8c47-33d24ed882b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:27:55.053448 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fc373-d18a-4390-8c47-33d24ed882b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:27:55.055198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-600fc373-d18a-4390-8c47-33d24ed882b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:27:55.114086 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:55.187188 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600fc373-d18a-4390-8c47-33d24ed882b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:27:55.188649 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600fc373-d18a-4390-8c47-33d24ed882b6 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:27:55.208390 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 660/1311] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:27:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:27:57.553739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c53bc-3373-4969-bb3e-b3525c0df616 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:27:57.554254 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c53bc-3373-4969-bb3e-b3525c0df616 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:27:57.554254 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c53bc-3373-4969-bb3e-b3525c0df616 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:27:57.555795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 652/1312] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:27:57.560858 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73f1c7-4eba-441f-821a-a2ee9dde10f4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:27:57.561278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73f1c7-4eba-441f-821a-a2ee9dde10f4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:27:57.561479 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73f1c7-4eba-441f-821a-a2ee9dde10f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:27:57.644061 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7b73f1c7-4eba-441f-821a-a2ee9dde10f4 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:27:57.645288 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7b73f1c7-4eba-441f-821a-a2ee9dde10f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:27:57.758834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 661/1313] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:27:57.799870 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c53bc-3373-4969-bb3e-b3525c0df616 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:27:57.802053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-567c53bc-3373-4969-bb3e-b3525c0df616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:27:57.927027 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c53bc-3373-4969-bb3e-b3525c0df616 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:27:58.016637 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:27:58.019315 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c676bd2-57da-4a20-9a6a-db13fad030ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:27:58.019991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c676bd2-57da-4a20-9a6a-db13fad030ab service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:27:58.020281 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c676bd2-57da-4a20-9a6a-db13fad030ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:27:58.020562 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c676bd2-57da-4a20-9a6a-db13fad030ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:27:58.022440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1c676bd2-57da-4a20-9a6a-db13fad030ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:27:58.149594 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c676bd2-57da-4a20-9a6a-db13fad030ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:27:58.151078 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c676bd2-57da-4a20-9a6a-db13fad030ab service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:27:58.173110 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 653/1314] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:27:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:28:00.695864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d47f71-03ed-447f-a575-39a032189f90 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:00.696392 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d47f71-03ed-447f-a575-39a032189f90 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:00.696508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d47f71-03ed-447f-a575-39a032189f90 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:00.697809 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 662/1315] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:28:00.702933 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a887d-d376-40a0-af7a-325dfd8b4916 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:00.703350 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a887d-d376-40a0-af7a-325dfd8b4916 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:00.703454 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a887d-d376-40a0-af7a-325dfd8b4916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:00.767571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c78a887d-d376-40a0-af7a-325dfd8b4916 None None] MFA Rules not processed for user `9757b88abf7e4e979b2025f40c29fca2`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:28:00.768798 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c78a887d-d376-40a0-af7a-325dfd8b4916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:00.820873 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:00.865262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 654/1316] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:28:00 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:28:00.904966 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d47f71-03ed-447f-a575-39a032189f90 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:28:00.906518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-37d47f71-03ed-447f-a575-39a032189f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:00.916229 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:01.009146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d47f71-03ed-447f-a575-39a032189f90 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:28:01.082415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb2e9b-a678-4780-8649-21fdb94bcaf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:28:01.083066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb2e9b-a678-4780-8649-21fdb94bcaf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:01.083348 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb2e9b-a678-4780-8649-21fdb94bcaf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:01.083622 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb2e9b-a678-4780-8649-21fdb94bcaf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:01.085262 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-15eb2e9b-a678-4780-8649-21fdb94bcaf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:01.146999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:01.193770 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb2e9b-a678-4780-8649-21fdb94bcaf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:28:01.195216 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb2e9b-a678-4780-8649-21fdb94bcaf2 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:28:01.212998 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 663/1317] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:28:00 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:28:04.011167 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa21e75-d647-4dae-a2b2-7b4d07643111 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:04.011707 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa21e75-d647-4dae-a2b2-7b4d07643111 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:04.011707 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa21e75-d647-4dae-a2b2-7b4d07643111 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:04.013102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 655/1318] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:28:04.018305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9c550-3ac3-4b7a-8b51-cd6cc45e23da None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:04.018726 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9c550-3ac3-4b7a-8b51-cd6cc45e23da None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:04.018868 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9c550-3ac3-4b7a-8b51-cd6cc45e23da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:04.084377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-89b9c550-3ac3-4b7a-8b51-cd6cc45e23da None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:28:04.085601 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-89b9c550-3ac3-4b7a-8b51-cd6cc45e23da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:04.190370 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 664/1319] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:28:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:28:04.229147 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa21e75-d647-4dae-a2b2-7b4d07643111 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:28:04.230738 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7aa21e75-d647-4dae-a2b2-7b4d07643111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:04.331606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa21e75-d647-4dae-a2b2-7b4d07643111 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:28:04.402625 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e866fa4-944c-41b3-bf14-890ed415ff4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:28:04.403265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e866fa4-944c-41b3-bf14-890ed415ff4e service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:04.403543 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e866fa4-944c-41b3-bf14-890ed415ff4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:04.403814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e866fa4-944c-41b3-bf14-890ed415ff4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:04.405426 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6e866fa4-944c-41b3-bf14-890ed415ff4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:04.412580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:04.516231 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e866fa4-944c-41b3-bf14-890ed415ff4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:28:04.517659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e866fa4-944c-41b3-bf14-890ed415ff4e service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:28:04.538062 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 656/1320] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:28:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:28:07.837206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f76f4-f79a-439a-b215-12e2050712a8 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:07.837855 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f76f4-f79a-439a-b215-12e2050712a8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:07.837855 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f76f4-f79a-439a-b215-12e2050712a8 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:07.839823 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 665/1321] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:28:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:28:07.845136 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901827e-0d10-4b6f-b1ec-b48a9edd3e27 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:07.845520 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901827e-0d10-4b6f-b1ec-b48a9edd3e27 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:07.845731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0901827e-0d10-4b6f-b1ec-b48a9edd3e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:07.914268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0901827e-0d10-4b6f-b1ec-b48a9edd3e27 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:28:07.915985 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0901827e-0d10-4b6f-b1ec-b48a9edd3e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:07.981878 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:08.021224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 657/1322] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:28:08.058769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f76f4-f79a-439a-b215-12e2050712a8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:28:08.060307 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2d1f76f4-f79a-439a-b215-12e2050712a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:08.081815 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:08.173978 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f76f4-f79a-439a-b215-12e2050712a8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:28:08.253489 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b0d84-47ec-4836-92e5-b0ab0fb82204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:28:08.254180 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b0d84-47ec-4836-92e5-b0ab0fb82204 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:08.254461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b0d84-47ec-4836-92e5-b0ab0fb82204 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:08.254733 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b0d84-47ec-4836-92e5-b0ab0fb82204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:08.256405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-403b0d84-47ec-4836-92e5-b0ab0fb82204 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:08.335967 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:08.373919 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b0d84-47ec-4836-92e5-b0ab0fb82204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:28:08.375364 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b0d84-47ec-4836-92e5-b0ab0fb82204 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:28:08.394386 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 666/1323] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:28:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:28:10.483288 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10423d83-9ee3-4295-86af-b47e44ab7fa2 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:10.483841 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10423d83-9ee3-4295-86af-b47e44ab7fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:10.483841 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10423d83-9ee3-4295-86af-b47e44ab7fa2 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:10.485159 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 658/1324] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:28:10.490391 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39683d0b-dc2d-4385-8e00-3df63c202063 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:10.490818 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39683d0b-dc2d-4385-8e00-3df63c202063 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:10.490957 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39683d0b-dc2d-4385-8e00-3df63c202063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:10.558306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-39683d0b-dc2d-4385-8e00-3df63c202063 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:28:10.559456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-39683d0b-dc2d-4385-8e00-3df63c202063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:10.660302 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 667/1325] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:28:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:28:10.709563 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfbb58-55e6-4254-9f07-0604e7c70717 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:10.709881 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfbb58-55e6-4254-9f07-0604e7c70717 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:10.710164 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfbb58-55e6-4254-9f07-0604e7c70717 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:10.711557 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 659/1326] 10.222.0.64 () {54 vars in 965 bytes} [Mon Jul 18 02:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:28:10.718139 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef712d-f1b9-4c4b-8ce5-49a09f79bd0f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:10.718432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef712d-f1b9-4c4b-8ce5-49a09f79bd0f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:10.718714 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef712d-f1b9-4c4b-8ce5-49a09f79bd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:10.748987 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:10.794095 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-79ef712d-f1b9-4c4b-8ce5-49a09f79bd0f None None] MFA Rules not processed for user `fa9e6d3fe3e740e6aedab33d727ec478`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:28:10.795342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-79ef712d-f1b9-4c4b-8ce5-49a09f79bd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:10.871281 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 668/1327] 10.222.0.64 () {58 vars in 1062 bytes} [Mon Jul 18 02:28:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:28:10.880797 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfbb58-55e6-4254-9f07-0604e7c70717 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:28:10.882378 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-61bfbb58-55e6-4254-9f07-0604e7c70717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:10.996529 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfbb58-55e6-4254-9f07-0604e7c70717 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:28:11.068252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca71345-c253-4265-b2a8-39f9d4fd4df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:28:11.068823 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca71345-c253-4265-b2a8-39f9d4fd4df4 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:11.069104 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca71345-c253-4265-b2a8-39f9d4fd4df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:11.069376 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca71345-c253-4265-b2a8-39f9d4fd4df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:11.071035 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-dca71345-c253-4265-b2a8-39f9d4fd4df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:11.087707 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:11.190298 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca71345-c253-4265-b2a8-39f9d4fd4df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:28:11.191818 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca71345-c253-4265-b2a8-39f9d4fd4df4 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:28:11.214237 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 660/1328] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:28:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:28:13.559906 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286fd26-e494-4065-8689-aa005cd1cca6 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:13.560404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286fd26-e494-4065-8689-aa005cd1cca6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:13.560404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286fd26-e494-4065-8689-aa005cd1cca6 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:13.561906 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 669/1329] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:28:13.567251 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0c055-6e53-4412-aaf8-e02a66a4cdd6 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:13.567768 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0c055-6e53-4412-aaf8-e02a66a4cdd6 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:13.567983 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0c055-6e53-4412-aaf8-e02a66a4cdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:13.632116 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c3b0c055-6e53-4412-aaf8-e02a66a4cdd6 None None] MFA Rules not processed for user `9757b88abf7e4e979b2025f40c29fca2`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:28:13.633354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c3b0c055-6e53-4412-aaf8-e02a66a4cdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:13.698466 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:13.732916 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 661/1330] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:28:13 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:28:13.770859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286fd26-e494-4065-8689-aa005cd1cca6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:28:13.772392 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9286fd26-e494-4065-8689-aa005cd1cca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:13.885346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286fd26-e494-4065-8689-aa005cd1cca6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:28:13.905164 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:13.959081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9761b41d-ce8c-4d42-9fe6-5332fb4b0fdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:28:13.959738 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761b41d-ce8c-4d42-9fe6-5332fb4b0fdb service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:13.960030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761b41d-ce8c-4d42-9fe6-5332fb4b0fdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:13.960314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761b41d-ce8c-4d42-9fe6-5332fb4b0fdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:13.962056 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9761b41d-ce8c-4d42-9fe6-5332fb4b0fdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:14.071777 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9761b41d-ce8c-4d42-9fe6-5332fb4b0fdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:28:14.073156 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9761b41d-ce8c-4d42-9fe6-5332fb4b0fdb service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:28:14.091126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 670/1331] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:28:13 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:28:16.722782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07345120-556c-4114-a77d-aa1fbc886200 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:16.723346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07345120-556c-4114-a77d-aa1fbc886200 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:16.723346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07345120-556c-4114-a77d-aa1fbc886200 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:16.724616 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 662/1332] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:28:16.729819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df711a-5f22-43da-b680-9664d4a86876 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:16.730233 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df711a-5f22-43da-b680-9664d4a86876 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:16.730387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df711a-5f22-43da-b680-9664d4a86876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:16.793447 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:16.796384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e0df711a-5f22-43da-b680-9664d4a86876 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:28:16.797896 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e0df711a-5f22-43da-b680-9664d4a86876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:16.893300 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 671/1333] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:28:16.929752 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07345120-556c-4114-a77d-aa1fbc886200 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:28:16.931291 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-07345120-556c-4114-a77d-aa1fbc886200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:17.032421 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07345120-556c-4114-a77d-aa1fbc886200 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:28:17.103876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea45c7f-6647-46ab-b757-baba15b61058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:28:17.104523 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea45c7f-6647-46ab-b757-baba15b61058 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:17.104808 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea45c7f-6647-46ab-b757-baba15b61058 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:17.105085 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea45c7f-6647-46ab-b757-baba15b61058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:17.106761 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7ea45c7f-6647-46ab-b757-baba15b61058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:17.133576 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:17.216392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea45c7f-6647-46ab-b757-baba15b61058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:28:17.217864 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea45c7f-6647-46ab-b757-baba15b61058 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:28:17.236404 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 663/1334] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:28:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:28:19.269878 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725b50b-cc41-4b92-98fe-1f55ea44b81a None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:19.270432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725b50b-cc41-4b92-98fe-1f55ea44b81a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:19.270432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7725b50b-cc41-4b92-98fe-1f55ea44b81a None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:19.271821 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 672/1335] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:28:19.277163 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae915171-0003-4c35-84f1-3b327af4bed0 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:19.277559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae915171-0003-4c35-84f1-3b327af4bed0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:19.277754 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae915171-0003-4c35-84f1-3b327af4bed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:19.340975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-ae915171-0003-4c35-84f1-3b327af4bed0 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:28:19.342205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ae915171-0003-4c35-84f1-3b327af4bed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:19.414605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:19.437741 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 664/1336] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:28:19.484905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725b50b-cc41-4b92-98fe-1f55ea44b81a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:28:19.486463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7725b50b-cc41-4b92-98fe-1f55ea44b81a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:19.588699 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7725b50b-cc41-4b92-98fe-1f55ea44b81a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:28:19.616405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:19.661782 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136767c-868d-4594-b335-26c9d2f50ede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:28:19.662433 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136767c-868d-4594-b335-26c9d2f50ede service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:19.662722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136767c-868d-4594-b335-26c9d2f50ede service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:19.663001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136767c-868d-4594-b335-26c9d2f50ede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:19.664710 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d136767c-868d-4594-b335-26c9d2f50ede service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:19.771405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136767c-868d-4594-b335-26c9d2f50ede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:28:19.772831 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136767c-868d-4594-b335-26c9d2f50ede service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:28:19.792110 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 673/1337] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:28:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:28:22.372974 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ea381-10a6-45b1-bccc-c270396d4f46 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:22.373487 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ea381-10a6-45b1-bccc-c270396d4f46 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:22.373682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ea381-10a6-45b1-bccc-c270396d4f46 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:22.374936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 665/1338] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:28:22.380176 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743793c1-5cc5-4e41-8979-1380d05756f7 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:22.380618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743793c1-5cc5-4e41-8979-1380d05756f7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:22.380723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743793c1-5cc5-4e41-8979-1380d05756f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:22.445101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-743793c1-5cc5-4e41-8979-1380d05756f7 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:28:22.446264 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-743793c1-5cc5-4e41-8979-1380d05756f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:22.454841 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:22.542884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 674/1339] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:28:22 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:28:22.578913 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ea381-10a6-45b1-bccc-c270396d4f46 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:28:22.580439 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b62ea381-10a6-45b1-bccc-c270396d4f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:22.682886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ea381-10a6-45b1-bccc-c270396d4f46 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:28:22.754199 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b591a9-3df8-4848-b338-7c537da4d50b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:28:22.754774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b591a9-3df8-4848-b338-7c537da4d50b service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:22.755058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b591a9-3df8-4848-b338-7c537da4d50b service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:22.755331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b591a9-3df8-4848-b338-7c537da4d50b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:22.756965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-60b591a9-3df8-4848-b338-7c537da4d50b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:22.791856 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:22.868414 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b591a9-3df8-4848-b338-7c537da4d50b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:28:22.869888 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b591a9-3df8-4848-b338-7c537da4d50b service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:28:22.888348 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 666/1340] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:28:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:28:27.099754 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcc149-56ec-47d4-9616-bcaa4613ebf1 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:27.100307 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcc149-56ec-47d4-9616-bcaa4613ebf1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:27.100307 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdcc149-56ec-47d4-9616-bcaa4613ebf1 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:27.102225 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 675/1341] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:28:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:28:27.107601 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8897b-9e4e-46e7-b4aa-36699dea9097 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:27.108012 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8897b-9e4e-46e7-b4aa-36699dea9097 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:27.108255 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8897b-9e4e-46e7-b4aa-36699dea9097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:27.192384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b3b8897b-9e4e-46e7-b4aa-36699dea9097 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:28:27.194665 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b3b8897b-9e4e-46e7-b4aa-36699dea9097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:27.292343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:27.303850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 667/1342] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:28:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:28:27.343392 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcc149-56ec-47d4-9616-bcaa4613ebf1 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:28:27.344953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fcdcc149-56ec-47d4-9616-bcaa4613ebf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:27.447501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdcc149-56ec-47d4-9616-bcaa4613ebf1 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:28:27.484472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:27.520652 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d342f8f5-9ff4-40c5-ba39-5c17db0ecbc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:28:27.521311 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342f8f5-9ff4-40c5-ba39-5c17db0ecbc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:27.521596 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342f8f5-9ff4-40c5-ba39-5c17db0ecbc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:27.521912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d342f8f5-9ff4-40c5-ba39-5c17db0ecbc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:27.523545 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d342f8f5-9ff4-40c5-ba39-5c17db0ecbc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:27.639105 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342f8f5-9ff4-40c5-ba39-5c17db0ecbc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:28:27.640539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d342f8f5-9ff4-40c5-ba39-5c17db0ecbc5 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:28:27.659356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 676/1343] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:28:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:28:30.603490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9b567-ee57-4b79-ac25-0a8d038d5dd2 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:30.604038 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9b567-ee57-4b79-ac25-0a8d038d5dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:30.604038 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9b567-ee57-4b79-ac25-0a8d038d5dd2 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:30.605605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 668/1344] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:28:30.610622 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6c662-39bd-432b-b8b3-ed22743dee25 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:30.611010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6c662-39bd-432b-b8b3-ed22743dee25 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:30.611189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6c662-39bd-432b-b8b3-ed22743dee25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:30.676902 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f1f6c662-39bd-432b-b8b3-ed22743dee25 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:28:30.678178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f1f6c662-39bd-432b-b8b3-ed22743dee25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:30.697071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:30.776842 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 677/1345] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:28:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:28:30.815090 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9b567-ee57-4b79-ac25-0a8d038d5dd2 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:28:30.816828 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-59a9b567-ee57-4b79-ac25-0a8d038d5dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:30.921484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9b567-ee57-4b79-ac25-0a8d038d5dd2 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:28:30.993457 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f29c1f-c83a-4b50-af10-5b72824ea054 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:28:30.994142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f29c1f-c83a-4b50-af10-5b72824ea054 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:30.994422 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f29c1f-c83a-4b50-af10-5b72824ea054 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:30.994693 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f29c1f-c83a-4b50-af10-5b72824ea054 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:30.996347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-73f29c1f-c83a-4b50-af10-5b72824ea054 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:31.038739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:31.105046 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f29c1f-c83a-4b50-af10-5b72824ea054 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:28:31.106519 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f29c1f-c83a-4b50-af10-5b72824ea054 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:28:31.125822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 669/1346] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:28:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:28:35.412492 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76e21c-e370-4538-9c43-e5bc7c2e8872 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:35.412967 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76e21c-e370-4538-9c43-e5bc7c2e8872 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:35.413064 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a76e21c-e370-4538-9c43-e5bc7c2e8872 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:35.414510 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 678/1347] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:28:35.419681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae852dd-b1a6-4fca-9f3f-d03cb1377c62 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:35.420104 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae852dd-b1a6-4fca-9f3f-d03cb1377c62 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:35.420283 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae852dd-b1a6-4fca-9f3f-d03cb1377c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:35.493772 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-fae852dd-b1a6-4fca-9f3f-d03cb1377c62 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:28:35.495008 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-fae852dd-b1a6-4fca-9f3f-d03cb1377c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:35.597816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:35.600420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 670/1348] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:28:35.640432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76e21c-e370-4538-9c43-e5bc7c2e8872 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:28:35.642076 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0a76e21c-e370-4538-9c43-e5bc7c2e8872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:35.750660 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a76e21c-e370-4538-9c43-e5bc7c2e8872 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:28:35.801668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:35.829891 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08fdd9-4815-4fa7-89f6-bfd0e3f04ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:28:35.830660 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08fdd9-4815-4fa7-89f6-bfd0e3f04ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:35.830945 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08fdd9-4815-4fa7-89f6-bfd0e3f04ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:35.831224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08fdd9-4815-4fa7-89f6-bfd0e3f04ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:35.832890 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-aa08fdd9-4815-4fa7-89f6-bfd0e3f04ae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:35.946038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08fdd9-4815-4fa7-89f6-bfd0e3f04ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:28:35.947394 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08fdd9-4815-4fa7-89f6-bfd0e3f04ae0 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:28:35.966690 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 679/1349] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:28:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:28:40.913110 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79304677-4dab-44dd-bb60-c357c11a2ec3 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:40.913601 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79304677-4dab-44dd-bb60-c357c11a2ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:40.913601 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79304677-4dab-44dd-bb60-c357c11a2ec3 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:40.916865 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 671/1350] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jul 18 02:28:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:28:40.927246 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca355f-8e4e-47e1-bcf3-aa6078106e22 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:40.928326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca355f-8e4e-47e1-bcf3-aa6078106e22 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:40.928744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca355f-8e4e-47e1-bcf3-aa6078106e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:41.021628 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-9fca355f-8e4e-47e1-bcf3-aa6078106e22 None None] MFA Rules not processed for user `213ba948a3f34c39bce3f6db093479eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:28:41.022940 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9fca355f-8e4e-47e1-bcf3-aa6078106e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:41.042706 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:41.143557 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 680/1351] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jul 18 02:28:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:28:45.322768 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9b28e-67a9-40cc-bd88-b910e66145a2 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:45.323624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9b28e-67a9-40cc-bd88-b910e66145a2 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:45.323919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9b28e-67a9-40cc-bd88-b910e66145a2 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:45.325512 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 672/1352] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jul 18 02:28:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:28:45.330671 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfd474-009e-4f44-b84f-6bfdbf4c9b15 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:45.331105 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfd474-009e-4f44-b84f-6bfdbf4c9b15 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:45.331454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfd474-009e-4f44-b84f-6bfdbf4c9b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:45.407681 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-cfdfd474-009e-4f44-b84f-6bfdbf4c9b15 None None] MFA Rules not processed for user `213ba948a3f34c39bce3f6db093479eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:28:45.408998 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cfdfd474-009e-4f44-b84f-6bfdbf4c9b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:45.482170 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:45.519346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 681/1353] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jul 18 02:28:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:28:46.898195 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70170ec9-2192-4a67-b3e6-7b1ecbceda50 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:46.898782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70170ec9-2192-4a67-b3e6-7b1ecbceda50 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:46.898782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70170ec9-2192-4a67-b3e6-7b1ecbceda50 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:46.900122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 673/1354] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jul 18 02:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:28:46.904999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682099e-5c4e-4986-a9d4-8d018f353109 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:46.905444 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682099e-5c4e-4986-a9d4-8d018f353109 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:46.905574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682099e-5c4e-4986-a9d4-8d018f353109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:46.984417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5682099e-5c4e-4986-a9d4-8d018f353109 None None] MFA Rules not processed for user `213ba948a3f34c39bce3f6db093479eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:28:46.985632 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5682099e-5c4e-4986-a9d4-8d018f353109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:47.096628 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 682/1355] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jul 18 02:28:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:28:50.505467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301ef1d-d462-4417-9059-874d20a969ea None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:50.505995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301ef1d-d462-4417-9059-874d20a969ea None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:50.506392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301ef1d-d462-4417-9059-874d20a969ea None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:50.508247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 674/1356] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:28:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:28:50.513510 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a986fa-feca-4de4-bebb-d3c05cd3259c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:50.514486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a986fa-feca-4de4-bebb-d3c05cd3259c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:50.514929 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a986fa-feca-4de4-bebb-d3c05cd3259c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:50.556966 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:50.595474 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-72a986fa-feca-4de4-bebb-d3c05cd3259c None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:28:50.596999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-72a986fa-feca-4de4-bebb-d3c05cd3259c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:50.700448 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 683/1357] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:28:50.756566 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45931f9-9b68-4fd8-9c81-63deabda0f56 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:50.758168 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45931f9-9b68-4fd8-9c81-63deabda0f56 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:50.758991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45931f9-9b68-4fd8-9c81-63deabda0f56 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:50.761001 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 675/1358] 10.222.0.64 () {54 vars in 962 bytes} [Mon Jul 18 02:28:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:28:50.769984 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577e2f7-080f-4d9c-a350-2f3300d80e13 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:50.770684 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577e2f7-080f-4d9c-a350-2f3300d80e13 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:50.771089 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4577e2f7-080f-4d9c-a350-2f3300d80e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:50.854731 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-4577e2f7-080f-4d9c-a350-2f3300d80e13 None None] MFA Rules not processed for user `6f51aae36f0b42868567840fa957ffe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:28:50.856103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4577e2f7-080f-4d9c-a350-2f3300d80e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:50.913342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:50.990737 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 684/1359] 10.222.0.64 () {58 vars in 1059 bytes} [Mon Jul 18 02:28:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:28:50.998293 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45931f9-9b68-4fd8-9c81-63deabda0f56 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:28:50.999987 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e45931f9-9b68-4fd8-9c81-63deabda0f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:51.156630 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45931f9-9b68-4fd8-9c81-63deabda0f56 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:28:51.235270 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:51.278480 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58261362-c64d-4e76-a018-cf0033377549 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:28:51.279053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58261362-c64d-4e76-a018-cf0033377549 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:51.279333 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58261362-c64d-4e76-a018-cf0033377549 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:51.279609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58261362-c64d-4e76-a018-cf0033377549 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:51.281259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-58261362-c64d-4e76-a018-cf0033377549 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:51.377638 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58261362-c64d-4e76-a018-cf0033377549 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:28:51.379375 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58261362-c64d-4e76-a018-cf0033377549 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:28:51.398024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 676/1360] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:28:53.639618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda786e6-eda5-4f53-afc4-4113245b9105 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:53.640122 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda786e6-eda5-4f53-afc4-4113245b9105 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:53.640122 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda786e6-eda5-4f53-afc4-4113245b9105 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:53.641800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 685/1361] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:28:53.647177 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fb9c3-c6da-4d7d-9949-7ec504984779 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:53.647635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fb9c3-c6da-4d7d-9949-7ec504984779 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:53.648318 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fb9c3-c6da-4d7d-9949-7ec504984779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:53.718505 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-7c1fb9c3-c6da-4d7d-9949-7ec504984779 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:28:53.720019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7c1fb9c3-c6da-4d7d-9949-7ec504984779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:53.765406 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:53.835407 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 677/1362] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:28:53.872583 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda786e6-eda5-4f53-afc4-4113245b9105 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:28:53.879046 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-eda786e6-eda5-4f53-afc4-4113245b9105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:54.040076 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda786e6-eda5-4f53-afc4-4113245b9105 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:28:54.050334 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:54.194259 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c165c3a-19fa-450e-b7c2-be22129f6f37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:28:54.195016 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c165c3a-19fa-450e-b7c2-be22129f6f37 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:54.195575 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c165c3a-19fa-450e-b7c2-be22129f6f37 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:54.196214 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c165c3a-19fa-450e-b7c2-be22129f6f37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:54.197989 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3c165c3a-19fa-450e-b7c2-be22129f6f37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:54.299858 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c165c3a-19fa-450e-b7c2-be22129f6f37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:28:54.301476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c165c3a-19fa-450e-b7c2-be22129f6f37 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:28:54.321166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 686/1363] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:28:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:28:56.799954 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeff34b-475a-4d78-8405-babfa26f5f45 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:56.800487 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeff34b-475a-4d78-8405-babfa26f5f45 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:56.800818 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeff34b-475a-4d78-8405-babfa26f5f45 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:56.802709 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 678/1364] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:28:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:28:56.808483 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83780dc-8650-4bfe-8fef-d55b5ba915e0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:56.808939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83780dc-8650-4bfe-8fef-d55b5ba915e0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:56.809081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83780dc-8650-4bfe-8fef-d55b5ba915e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:56.825009 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:56.883006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b83780dc-8650-4bfe-8fef-d55b5ba915e0 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:28:56.884207 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b83780dc-8650-4bfe-8fef-d55b5ba915e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:56.986258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 687/1365] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:28:57.033053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658129a5-e3af-4371-9551-ada460fc38b9 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:57.033418 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658129a5-e3af-4371-9551-ada460fc38b9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:57.033809 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658129a5-e3af-4371-9551-ada460fc38b9 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:57.035263 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 679/1366] 10.222.0.64 () {54 vars in 962 bytes} [Mon Jul 18 02:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:28:57.040805 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a65475-a1b7-4b90-a6c8-007e1e95a313 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:57.041091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a65475-a1b7-4b90-a6c8-007e1e95a313 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:57.041377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a65475-a1b7-4b90-a6c8-007e1e95a313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:57.121441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d9a65475-a1b7-4b90-a6c8-007e1e95a313 None None] MFA Rules not processed for user `6f51aae36f0b42868567840fa957ffe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:28:57.122916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d9a65475-a1b7-4b90-a6c8-007e1e95a313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:57.166105 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:57.253442 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 688/1367] 10.222.0.64 () {58 vars in 1059 bytes} [Mon Jul 18 02:28:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:28:57.261195 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658129a5-e3af-4371-9551-ada460fc38b9 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:28:57.262826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-658129a5-e3af-4371-9551-ada460fc38b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:57.424769 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658129a5-e3af-4371-9551-ada460fc38b9 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:28:57.445859 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:57.544180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295f7fa-bbef-4cd4-8ed7-4a11164bf5f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:28:57.544822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295f7fa-bbef-4cd4-8ed7-4a11164bf5f5 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:57.545173 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295f7fa-bbef-4cd4-8ed7-4a11164bf5f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:57.545520 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295f7fa-bbef-4cd4-8ed7-4a11164bf5f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:57.547513 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5295f7fa-bbef-4cd4-8ed7-4a11164bf5f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:57.640788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295f7fa-bbef-4cd4-8ed7-4a11164bf5f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:28:57.642459 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295f7fa-bbef-4cd4-8ed7-4a11164bf5f5 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:28:57.662671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 680/1368] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:28:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:28:58.621184 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526434a-a082-4624-b9ea-24d24c4110d9 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:58.621966 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526434a-a082-4624-b9ea-24d24c4110d9 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:58.621966 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526434a-a082-4624-b9ea-24d24c4110d9 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:58.623336 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 689/1369] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:28:58.628580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb11c70-1dbd-4e94-a6af-36aba61094aa None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:58.628992 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb11c70-1dbd-4e94-a6af-36aba61094aa None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:58.629192 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb11c70-1dbd-4e94-a6af-36aba61094aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:58.662021 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:58.699575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-dcb11c70-1dbd-4e94-a6af-36aba61094aa None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:28:58.701036 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-dcb11c70-1dbd-4e94-a6af-36aba61094aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:58.814056 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 681/1370] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:28:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:28:59.175171 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e154b15-4352-427f-9137-139363fef2ac None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:59.175171 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e154b15-4352-427f-9137-139363fef2ac None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:59.175171 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e154b15-4352-427f-9137-139363fef2ac None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:59.176825 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 690/1371] 10.222.0.64 () {54 vars in 964 bytes} [Mon Jul 18 02:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:28:59.182047 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79167a08-6b7d-48f9-80f2-60c9bc25f1be None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:59.182343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79167a08-6b7d-48f9-80f2-60c9bc25f1be None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:59.182942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79167a08-6b7d-48f9-80f2-60c9bc25f1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:59.260971 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-79167a08-6b7d-48f9-80f2-60c9bc25f1be None None] MFA Rules not processed for user `bdb0a04d568e4b14b07cd6d6092bc49f`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:28:59.262233 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-79167a08-6b7d-48f9-80f2-60c9bc25f1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:59.311550 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:59.343369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 682/1372] 10.222.0.64 () {58 vars in 1061 bytes} [Mon Jul 18 02:28:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:28:59.350872 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e154b15-4352-427f-9137-139363fef2ac None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:28:59.352388 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8e154b15-4352-427f-9137-139363fef2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:59.463119 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e154b15-4352-427f-9137-139363fef2ac None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:28:59.512305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:28:59.554370 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efcb19-2465-4b11-8ea9-b1a0814e20fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:28:59.555336 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efcb19-2465-4b11-8ea9-b1a0814e20fe service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:59.555632 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efcb19-2465-4b11-8ea9-b1a0814e20fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:59.557077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efcb19-2465-4b11-8ea9-b1a0814e20fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:59.558794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f5efcb19-2465-4b11-8ea9-b1a0814e20fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:28:59.676755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efcb19-2465-4b11-8ea9-b1a0814e20fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:28:59.678243 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5efcb19-2465-4b11-8ea9-b1a0814e20fe service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:28:59.698496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 691/1373] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:28:59.983673 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62850337-14a1-4c4c-b623-530d073cdf30 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:59.984100 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62850337-14a1-4c4c-b623-530d073cdf30 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:59.984578 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62850337-14a1-4c4c-b623-530d073cdf30 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:28:59.987322 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 683/1374] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:28:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:28:59.992234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9853d-7218-4e48-8f84-f8287180e830 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:28:59.992623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9853d-7218-4e48-8f84-f8287180e830 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:28:59.992802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9853d-7218-4e48-8f84-f8287180e830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:00.058985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-aad9853d-7218-4e48-8f84-f8287180e830 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:00.060406 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-aad9853d-7218-4e48-8f84-f8287180e830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:00.081321 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:00.160488 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 692/1375] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:29:00.204901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62850337-14a1-4c4c-b623-530d073cdf30 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:29:00.206695 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-62850337-14a1-4c4c-b623-530d073cdf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:00.355542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62850337-14a1-4c4c-b623-530d073cdf30 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:29:00.406492 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:00.469647 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223fa05-3d66-4cd0-9109-b5160024f0f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:29:00.470334 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223fa05-3d66-4cd0-9109-b5160024f0f0 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:00.470625 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223fa05-3d66-4cd0-9109-b5160024f0f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:00.470904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223fa05-3d66-4cd0-9109-b5160024f0f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:00.472546 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5223fa05-3d66-4cd0-9109-b5160024f0f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:00.561093 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223fa05-3d66-4cd0-9109-b5160024f0f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:29:00.562652 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223fa05-3d66-4cd0-9109-b5160024f0f0 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:29:00.580839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 684/1376] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:29:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:29:02.746268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437f45f-b321-4d73-8b95-67966aba974a None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:02.746830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437f45f-b321-4d73-8b95-67966aba974a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:02.746830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437f45f-b321-4d73-8b95-67966aba974a None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:02.748448 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 693/1377] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:29:02.753610 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cf471-09c3-46ae-b0ef-36df2d60ef04 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:02.754065 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cf471-09c3-46ae-b0ef-36df2d60ef04 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:02.754557 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76cf471-09c3-46ae-b0ef-36df2d60ef04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:02.831879 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a76cf471-09c3-46ae-b0ef-36df2d60ef04 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:02.833025 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a76cf471-09c3-46ae-b0ef-36df2d60ef04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:02.840114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:02.930907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 685/1378] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:29:02.974577 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437f45f-b321-4d73-8b95-67966aba974a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:29:02.976805 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d437f45f-b321-4d73-8b95-67966aba974a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:03.124539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437f45f-b321-4d73-8b95-67966aba974a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:29:03.135510 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:03.276727 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddb36f-f60b-49aa-bf48-4a6bc29d8591 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:29:03.277325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddb36f-f60b-49aa-bf48-4a6bc29d8591 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:03.277619 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddb36f-f60b-49aa-bf48-4a6bc29d8591 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:03.277938 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddb36f-f60b-49aa-bf48-4a6bc29d8591 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:03.280464 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-50ddb36f-f60b-49aa-bf48-4a6bc29d8591 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:03.387192 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ddb36f-f60b-49aa-bf48-4a6bc29d8591 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:29:03.388767 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ddb36f-f60b-49aa-bf48-4a6bc29d8591 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:29:03.408189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 694/1379] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:29:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:29:05.595057 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ff2b9-16bb-41ac-8df8-a13147806d5f None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:05.595495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ff2b9-16bb-41ac-8df8-a13147806d5f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:05.595495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ff2b9-16bb-41ac-8df8-a13147806d5f None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:05.601625 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 686/1380] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:29:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:29:05.604249 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e77271-70c3-4813-a913-6520abe93cf9 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:05.604637 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e77271-70c3-4813-a913-6520abe93cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:05.604844 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e77271-70c3-4813-a913-6520abe93cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:05.619455 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:05.679251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-40e77271-70c3-4813-a913-6520abe93cf9 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:05.680459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-40e77271-70c3-4813-a913-6520abe93cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:05.777760 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 695/1381] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:29:05.823248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ff2b9-16bb-41ac-8df8-a13147806d5f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:29:05.824763 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f13ff2b9-16bb-41ac-8df8-a13147806d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:05.968297 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:05.979640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ff2b9-16bb-41ac-8df8-a13147806d5f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:29:06.097380 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b0a5e-0bf5-4f7e-b8d1-ac34aa1d7a4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:29:06.097984 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b0a5e-0bf5-4f7e-b8d1-ac34aa1d7a4a service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:06.098270 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b0a5e-0bf5-4f7e-b8d1-ac34aa1d7a4a service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:06.098548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b0a5e-0bf5-4f7e-b8d1-ac34aa1d7a4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:06.100197 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-695b0a5e-0bf5-4f7e-b8d1-ac34aa1d7a4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:06.202859 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b0a5e-0bf5-4f7e-b8d1-ac34aa1d7a4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:29:06.204691 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b0a5e-0bf5-4f7e-b8d1-ac34aa1d7a4a service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:29:06.218639 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:06.228187 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 687/1382] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:29:08.431206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdeed7-9834-43d1-b19b-a92e6b98fae8 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:08.431714 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdeed7-9834-43d1-b19b-a92e6b98fae8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:08.431934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbdeed7-9834-43d1-b19b-a92e6b98fae8 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:08.433738 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 696/1383] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:29:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:29:08.439163 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1a960-49d8-4e2b-a7b9-bdb1406a3823 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:08.439559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1a960-49d8-4e2b-a7b9-bdb1406a3823 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:08.439721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1a960-49d8-4e2b-a7b9-bdb1406a3823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:08.507116 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0fd1a960-49d8-4e2b-a7b9-bdb1406a3823 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:08.508700 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0fd1a960-49d8-4e2b-a7b9-bdb1406a3823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:08.628292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 688/1384] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:29:08.672779 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdeed7-9834-43d1-b19b-a92e6b98fae8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:29:08.674320 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8fbdeed7-9834-43d1-b19b-a92e6b98fae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:08.878164 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:08.941593 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbdeed7-9834-43d1-b19b-a92e6b98fae8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:29:09.074030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16ebc4a-8ca3-492b-b27e-56a784697bfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:29:09.074894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ebc4a-8ca3-492b-b27e-56a784697bfa service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:09.075250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ebc4a-8ca3-492b-b27e-56a784697bfa service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:09.075600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16ebc4a-8ca3-492b-b27e-56a784697bfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:09.077760 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d16ebc4a-8ca3-492b-b27e-56a784697bfa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:09.140579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:09.192865 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ebc4a-8ca3-492b-b27e-56a784697bfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:29:09.194936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16ebc4a-8ca3-492b-b27e-56a784697bfa service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:29:09.222626 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 697/1385] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:29:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:29:11.364500 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bef599-0e07-4eca-ae6e-45b4291bd23a None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:11.365580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bef599-0e07-4eca-ae6e-45b4291bd23a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:11.365831 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bef599-0e07-4eca-ae6e-45b4291bd23a None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:11.367598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 689/1386] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:29:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:29:11.373421 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7eaef-03f1-4ce2-bc5f-40676a498878 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:11.374013 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7eaef-03f1-4ce2-bc5f-40676a498878 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:11.374152 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca7eaef-03f1-4ce2-bc5f-40676a498878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:11.453140 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-eca7eaef-03f1-4ce2-bc5f-40676a498878 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:11.454571 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-eca7eaef-03f1-4ce2-bc5f-40676a498878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:11.557567 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 698/1387] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:29:11.602408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bef599-0e07-4eca-ae6e-45b4291bd23a None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:29:11.604264 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c9bef599-0e07-4eca-ae6e-45b4291bd23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:11.710059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:11.791776 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bef599-0e07-4eca-ae6e-45b4291bd23a None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:29:11.930081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465195ec-49b9-40d5-83c2-870905083937 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:29:11.930740 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465195ec-49b9-40d5-83c2-870905083937 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:11.931026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465195ec-49b9-40d5-83c2-870905083937 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:11.931304 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465195ec-49b9-40d5-83c2-870905083937 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:11.932987 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-465195ec-49b9-40d5-83c2-870905083937 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:11.975570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:12.031624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465195ec-49b9-40d5-83c2-870905083937 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:29:12.033243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465195ec-49b9-40d5-83c2-870905083937 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:29:12.052320 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 690/1388] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:29:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:29:14.199253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8ab75-c4c7-4cd2-bdc3-caf8bfe79542 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:14.199766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8ab75-c4c7-4cd2-bdc3-caf8bfe79542 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:14.199882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e8ab75-c4c7-4cd2-bdc3-caf8bfe79542 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:14.201328 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 699/1389] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:29:14.206803 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14398f21-4015-4603-8c71-d141c9136e10 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:14.207192 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14398f21-4015-4603-8c71-d141c9136e10 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:14.207890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14398f21-4015-4603-8c71-d141c9136e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:14.270981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-14398f21-4015-4603-8c71-d141c9136e10 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:14.272230 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-14398f21-4015-4603-8c71-d141c9136e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:14.372786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 691/1390] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:29:14.419890 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8ab75-c4c7-4cd2-bdc3-caf8bfe79542 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:29:14.421661 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-68e8ab75-c4c7-4cd2-bdc3-caf8bfe79542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:14.453933 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:14.570142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e8ab75-c4c7-4cd2-bdc3-caf8bfe79542 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:29:14.675302 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:14.692945 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93187fc6-a171-4c87-a1e0-35cc86241732 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:29:14.694069 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93187fc6-a171-4c87-a1e0-35cc86241732 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:14.694543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93187fc6-a171-4c87-a1e0-35cc86241732 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:14.695006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93187fc6-a171-4c87-a1e0-35cc86241732 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:14.698027 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-93187fc6-a171-4c87-a1e0-35cc86241732 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:14.815364 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93187fc6-a171-4c87-a1e0-35cc86241732 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:29:14.816959 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93187fc6-a171-4c87-a1e0-35cc86241732 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:29:14.834994 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 700/1391] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:29:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:29:14.939099 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ed20e-d025-4889-afaa-445a5a38b7bb None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:14.939311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ed20e-d025-4889-afaa-445a5a38b7bb None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:14.939587 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ed20e-d025-4889-afaa-445a5a38b7bb None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:14.941020 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 692/1392] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:29:14.946271 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f532dea-7774-4922-a1a8-7ea54af17feb None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:14.946564 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f532dea-7774-4922-a1a8-7ea54af17feb None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:14.946869 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f532dea-7774-4922-a1a8-7ea54af17feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:15.013015 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7f532dea-7774-4922-a1a8-7ea54af17feb None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:15.014569 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7f532dea-7774-4922-a1a8-7ea54af17feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:15.086033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:15.128464 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 701/1393] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:29:15.187703 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7d37f-5a4e-4a0a-a9e3-9aa077af6908 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:15.187990 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7d37f-5a4e-4a0a-a9e3-9aa077af6908 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:15.188271 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7d37f-5a4e-4a0a-a9e3-9aa077af6908 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:15.189738 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 693/1394] 10.222.0.64 () {54 vars in 961 bytes} [Mon Jul 18 02:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:29:15.195803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310f747-300f-4767-9402-2403479bec03 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:15.196095 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310f747-300f-4767-9402-2403479bec03 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:15.196380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5310f747-300f-4767-9402-2403479bec03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:15.272357 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5310f747-300f-4767-9402-2403479bec03 None None] MFA Rules not processed for user `b8948dc6a55344eaa85e2a6092215ec6`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:15.274612 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5310f747-300f-4767-9402-2403479bec03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:15.354088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 702/1395] 10.222.0.64 () {58 vars in 1058 bytes} [Mon Jul 18 02:29:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:29:15.361763 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7d37f-5a4e-4a0a-a9e3-9aa077af6908 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:29:15.363291 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3cd7d37f-5a4e-4a0a-a9e3-9aa077af6908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:15.377200 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:15.479888 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7d37f-5a4e-4a0a-a9e3-9aa077af6908 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:29:15.556734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481d15f-8d05-4e1b-9614-e1ad729aa701 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8948dc6a55344eaa85e2a6092215ec6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:29:15.557394 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481d15f-8d05-4e1b-9614-e1ad729aa701 service glance] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:15.557680 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481d15f-8d05-4e1b-9614-e1ad729aa701 service glance] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:15.558023 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481d15f-8d05-4e1b-9614-e1ad729aa701 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:15.559720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4481d15f-8d05-4e1b-9614-e1ad729aa701 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:15.627275 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:15.670340 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481d15f-8d05-4e1b-9614-e1ad729aa701 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:29:15.671798 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481d15f-8d05-4e1b-9614-e1ad729aa701 service glance] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:29:15.690256 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 694/1396] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:29:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:29:16.532062 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef926a70-08bd-4f3c-b4d0-bae7ea531bc2 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:16.532588 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef926a70-08bd-4f3c-b4d0-bae7ea531bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:16.532668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef926a70-08bd-4f3c-b4d0-bae7ea531bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:16.600713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ef926a70-08bd-4f3c-b4d0-bae7ea531bc2 None None] MFA Rules not processed for user `01113a3f8cbf46b09fb5fcf4315a219b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:16.601961 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ef926a70-08bd-4f3c-b4d0-bae7ea531bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:16.610494 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:16.690389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 703/1397] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jul 18 02:29:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:29:16.735360 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba6d74-be05-4251-9eb4-f9e4c4955eca None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:16.736212 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba6d74-be05-4251-9eb4-f9e4c4955eca None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:16.736497 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba6d74-be05-4251-9eb4-f9e4c4955eca None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:16.738242 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 695/1398] 10.222.0.64 () {54 vars in 943 bytes} [Mon Jul 18 02:29:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:29:16.745101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3584eb6-ba48-46ae-98b6-9cad1900859c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:16.745466 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3584eb6-ba48-46ae-98b6-9cad1900859c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:16.745790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3584eb6-ba48-46ae-98b6-9cad1900859c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:16.824887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a3584eb6-ba48-46ae-98b6-9cad1900859c None None] MFA Rules not processed for user `6a4e51f478874d99a7fc4ee2dea77caf`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:16.826114 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a3584eb6-ba48-46ae-98b6-9cad1900859c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:16.911609 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:16.935240 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 704/1399] 10.222.0.64 () {58 vars in 1040 bytes} [Mon Jul 18 02:29:16 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:29:16.945306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba6d74-be05-4251-9eb4-f9e4c4955eca None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:29:16.946995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-aeba6d74-be05-4251-9eb4-f9e4c4955eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:17.034818 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e66b0-d7f3-4cdc-a2be-dab3840ef515 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:17.035265 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e66b0-d7f3-4cdc-a2be-dab3840ef515 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:17.035980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e66b0-d7f3-4cdc-a2be-dab3840ef515 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:17.038652 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 705/1400] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:29:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:29:17.044734 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b38552-6b26-4ae5-8218-c8bbf800e736 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:17.045290 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b38552-6b26-4ae5-8218-c8bbf800e736 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:17.045728 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b38552-6b26-4ae5-8218-c8bbf800e736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:17.099584 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba6d74-be05-4251-9eb4-f9e4c4955eca None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:29:17.114515 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-97b38552-6b26-4ae5-8218-c8bbf800e736 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:17.116387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-97b38552-6b26-4ae5-8218-c8bbf800e736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:17.135673 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:17.204193 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab131929-078c-4b58-8675-a760bc0ef597 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4e51f478874d99a7fc4ee2dea77caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:29:17.205055 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab131929-078c-4b58-8675-a760bc0ef597 service swift] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:17.205400 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab131929-078c-4b58-8675-a760bc0ef597 service swift] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:17.205680 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab131929-078c-4b58-8675-a760bc0ef597 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:17.207389 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ab131929-078c-4b58-8675-a760bc0ef597 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:17.216362 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 706/1401] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:29:17.260667 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b38552-6b26-4ae5-8218-c8bbf800e736 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:29:17.262013 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-97b38552-6b26-4ae5-8218-c8bbf800e736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:17.297179 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab131929-078c-4b58-8675-a760bc0ef597 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:29:17.299004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab131929-078c-4b58-8675-a760bc0ef597 service swift] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:29:17.307958 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 696/1402] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jul 18 02:29:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 02:29:17.330623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:17.382253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b38552-6b26-4ae5-8218-c8bbf800e736 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:29:17.493382 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af7b44-4478-4456-9059-b5a0ae81f246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:29:17.494066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af7b44-4478-4456-9059-b5a0ae81f246 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:17.494348 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af7b44-4478-4456-9059-b5a0ae81f246 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:17.494623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af7b44-4478-4456-9059-b5a0ae81f246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:17.496262 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-31af7b44-4478-4456-9059-b5a0ae81f246 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:17.557343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:17.591438 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af7b44-4478-4456-9059-b5a0ae81f246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:29:17.593173 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af7b44-4478-4456-9059-b5a0ae81f246 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:29:17.628393 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 707/1403] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:29:19.783604 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79727033-41d7-4de6-b0f4-fad7319f61f3 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:19.784155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79727033-41d7-4de6-b0f4-fad7319f61f3 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:19.784155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79727033-41d7-4de6-b0f4-fad7319f61f3 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:19.785680 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 697/1404] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:29:19.791503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff4d15-f311-4648-ac5f-93343c085ede None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:19.791956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff4d15-f311-4648-ac5f-93343c085ede None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:19.792190 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff4d15-f311-4648-ac5f-93343c085ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:19.867224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a9ff4d15-f311-4648-ac5f-93343c085ede None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:19.868552 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a9ff4d15-f311-4648-ac5f-93343c085ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:19.979185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 708/1405] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:29:20.026558 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79727033-41d7-4de6-b0f4-fad7319f61f3 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:29:20.029037 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-79727033-41d7-4de6-b0f4-fad7319f61f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:20.109371 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:20.196308 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79727033-41d7-4de6-b0f4-fad7319f61f3 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:29:20.350135 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f7c4f1-8ede-4110-906a-5b66e5c855f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:29:20.350135 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7c4f1-8ede-4110-906a-5b66e5c855f5 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:20.350135 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7c4f1-8ede-4110-906a-5b66e5c855f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:20.350135 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f7c4f1-8ede-4110-906a-5b66e5c855f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:20.350653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d1f7c4f1-8ede-4110-906a-5b66e5c855f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:20.380435 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:20.449566 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7c4f1-8ede-4110-906a-5b66e5c855f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:29:20.451216 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f7c4f1-8ede-4110-906a-5b66e5c855f5 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:29:20.473740 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 698/1406] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:29:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:29:23.547799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fcad6-635f-4b83-b0d7-928a3febb69e None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:23.548348 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fcad6-635f-4b83-b0d7-928a3febb69e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:23.548348 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fcad6-635f-4b83-b0d7-928a3febb69e None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:23.553301 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 709/1407] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:29:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:29:23.554838 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e9dc4-5c5a-4b2c-a2ee-fbfd07f2f37f None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:23.555278 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e9dc4-5c5a-4b2c-a2ee-fbfd07f2f37f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:23.555469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730e9dc4-5c5a-4b2c-a2ee-fbfd07f2f37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:23.626134 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-730e9dc4-5c5a-4b2c-a2ee-fbfd07f2f37f None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:23.627362 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-730e9dc4-5c5a-4b2c-a2ee-fbfd07f2f37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:23.740097 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 699/1408] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:29:23.792600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fcad6-635f-4b83-b0d7-928a3febb69e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:29:23.792600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-316fcad6-635f-4b83-b0d7-928a3febb69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:23.839152 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:23.959674 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fcad6-635f-4b83-b0d7-928a3febb69e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:29:24.080557 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:24.087816 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde35f6d-8ca2-4abf-a883-37b7c4244346 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:29:24.087816 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde35f6d-8ca2-4abf-a883-37b7c4244346 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:24.087816 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde35f6d-8ca2-4abf-a883-37b7c4244346 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:24.087816 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde35f6d-8ca2-4abf-a883-37b7c4244346 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:24.090501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-dde35f6d-8ca2-4abf-a883-37b7c4244346 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:24.196884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde35f6d-8ca2-4abf-a883-37b7c4244346 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:29:24.198545 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde35f6d-8ca2-4abf-a883-37b7c4244346 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:29:24.217424 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 710/1409] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:29:33.737849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:34.215159 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=47 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:40.558904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643bbab-6aa0-415a-82f5-0eabbef5b307 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:40.559416 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643bbab-6aa0-415a-82f5-0eabbef5b307 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:40.559416 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643bbab-6aa0-415a-82f5-0eabbef5b307 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:40.560793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 700/1410] 10.222.0.64 () {54 vars in 918 bytes} [Mon Jul 18 02:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:29:40.566752 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8fcb6-db73-41f2-9296-e84f6df3d59a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:40.567198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8fcb6-db73-41f2-9296-e84f6df3d59a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:40.567302 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8fcb6-db73-41f2-9296-e84f6df3d59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:40.640704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e0d8fcb6-db73-41f2-9296-e84f6df3d59a None None] MFA Rules not processed for user `213ba948a3f34c39bce3f6db093479eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:40.641951 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e0d8fcb6-db73-41f2-9296-e84f6df3d59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:40.746303 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 711/1411] 10.222.0.64 () {58 vars in 1015 bytes} [Mon Jul 18 02:29:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:29:40.762915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a81b57-6fe8-4ee3-b2b7-831f2d348ba9 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:40.763204 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a81b57-6fe8-4ee3-b2b7-831f2d348ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:40.763485 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a81b57-6fe8-4ee3-b2b7-831f2d348ba9 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:40.764860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 701/1412] 10.222.0.64 () {54 vars in 918 bytes} [Mon Jul 18 02:29:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:29:40.769561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdce400-160a-441f-8ad6-db4b79abde29 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:40.769877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdce400-160a-441f-8ad6-db4b79abde29 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:40.770156 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdce400-160a-441f-8ad6-db4b79abde29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:40.841723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:40.844222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7cdce400-160a-441f-8ad6-db4b79abde29 None None] MFA Rules not processed for user `6f51aae36f0b42868567840fa957ffe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:40.845436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7cdce400-160a-441f-8ad6-db4b79abde29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:40.964117 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 712/1413] 10.222.0.64 () {58 vars in 1015 bytes} [Mon Jul 18 02:29:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:29:43.422534 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589249a-dedd-41cb-9422-d5c4df91d435 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:43.423092 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589249a-dedd-41cb-9422-d5c4df91d435 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:43.423092 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589249a-dedd-41cb-9422-d5c4df91d435 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:43.424457 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 02:29:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:29:43.430298 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14fd08-ecec-4792-9f8c-946c84b4e262 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:43.430679 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14fd08-ecec-4792-9f8c-946c84b4e262 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:43.430857 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd14fd08-ecec-4792-9f8c-946c84b4e262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:43.496510 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-fd14fd08-ecec-4792-9f8c-946c84b4e262 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:43.497878 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fd14fd08-ecec-4792-9f8c-946c84b4e262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:43.552948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:43.594709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 02:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:29:43.637502 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589249a-dedd-41cb-9422-d5c4df91d435 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:29:43.639043 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0589249a-dedd-41cb-9422-d5c4df91d435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:43.784167 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589249a-dedd-41cb-9422-d5c4df91d435 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:29:43.855818 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:43.895915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448b0062-36f1-4ab6-b13d-83b248ee67d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:29:43.896529 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b0062-36f1-4ab6-b13d-83b248ee67d3 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:43.896813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b0062-36f1-4ab6-b13d-83b248ee67d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:43.897091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448b0062-36f1-4ab6-b13d-83b248ee67d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:43.898793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-448b0062-36f1-4ab6-b13d-83b248ee67d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:43.986138 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b0062-36f1-4ab6-b13d-83b248ee67d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:29:43.988359 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448b0062-36f1-4ab6-b13d-83b248ee67d3 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:29:44.005810 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 703/1416] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:29:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:29:44.912744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfa889-d4aa-473c-b230-f47522053731 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:44.913321 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfa889-d4aa-473c-b230-f47522053731 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:44.913321 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdfa889-d4aa-473c-b230-f47522053731 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:44.914744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 02:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:29:44.920181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff14259-431f-4aed-a05e-5909c8ac7381 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:44.920594 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff14259-431f-4aed-a05e-5909c8ac7381 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:44.920720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff14259-431f-4aed-a05e-5909c8ac7381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:44.993391 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-8ff14259-431f-4aed-a05e-5909c8ac7381 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:44.994722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8ff14259-431f-4aed-a05e-5909c8ac7381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:45.020752 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:45.089236 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 02:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:29:45.238542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfa889-d4aa-473c-b230-f47522053731 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:29:45.240026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2cdfa889-d4aa-473c-b230-f47522053731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:45.383905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdfa889-d4aa-473c-b230-f47522053731 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:29:45.423735 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:45.495211 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954ae08-c171-40c1-9a70-5dd465112a3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:29:45.495789 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954ae08-c171-40c1-9a70-5dd465112a3e service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:45.496079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954ae08-c171-40c1-9a70-5dd465112a3e service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:45.496356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954ae08-c171-40c1-9a70-5dd465112a3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:45.498013 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f954ae08-c171-40c1-9a70-5dd465112a3e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:45.585834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954ae08-c171-40c1-9a70-5dd465112a3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:29:45.587428 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954ae08-c171-40c1-9a70-5dd465112a3e service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:29:45.605341 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 715/1419] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:29:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:29:46.555203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c89712-972d-47a5-985b-7dbd18f073d4 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:46.555786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c89712-972d-47a5-985b-7dbd18f073d4 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:46.555786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c89712-972d-47a5-985b-7dbd18f073d4 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:46.557057 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 02:29:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:29:46.561927 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e7121-5d31-4964-9a52-cef556b37cfb None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:46.562320 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e7121-5d31-4964-9a52-cef556b37cfb None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:46.562489 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e7121-5d31-4964-9a52-cef556b37cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:46.616209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:46.638633 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-420e7121-5d31-4964-9a52-cef556b37cfb None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:46.639858 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-420e7121-5d31-4964-9a52-cef556b37cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:46.738803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 02:29:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:29:46.890494 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c89712-972d-47a5-985b-7dbd18f073d4 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:29:46.892019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-28c89712-972d-47a5-985b-7dbd18f073d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:47.035986 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c89712-972d-47a5-985b-7dbd18f073d4 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:29:47.048436 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:47.147007 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b502cc7-3880-45df-a5c7-53007f63d1dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:29:47.147674 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b502cc7-3880-45df-a5c7-53007f63d1dc service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:47.147958 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b502cc7-3880-45df-a5c7-53007f63d1dc service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:47.148235 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b502cc7-3880-45df-a5c7-53007f63d1dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:47.149957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9b502cc7-3880-45df-a5c7-53007f63d1dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:47.236585 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b502cc7-3880-45df-a5c7-53007f63d1dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:29:47.238710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b502cc7-3880-45df-a5c7-53007f63d1dc service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:29:47.257106 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 706/1422] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:29:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:29:48.110361 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a45e5e-a608-4cff-a6fe-2b594c335241 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:48.110933 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a45e5e-a608-4cff-a6fe-2b594c335241 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:48.110933 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a45e5e-a608-4cff-a6fe-2b594c335241 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:48.112816 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 02:29:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:29:48.117836 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dffe4c-66a0-4955-b2b7-bc20e7b352f9 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:48.118247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dffe4c-66a0-4955-b2b7-bc20e7b352f9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:48.118392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dffe4c-66a0-4955-b2b7-bc20e7b352f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:48.138507 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:48.194769 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-04dffe4c-66a0-4955-b2b7-bc20e7b352f9 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:48.195984 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-04dffe4c-66a0-4955-b2b7-bc20e7b352f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:48.289106 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 02:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:29:48.437682 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a45e5e-a608-4cff-a6fe-2b594c335241 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:29:48.439316 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-13a45e5e-a608-4cff-a6fe-2b594c335241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:48.548023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:48.584454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a45e5e-a608-4cff-a6fe-2b594c335241 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:29:48.696714 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb3ec20-d49e-423c-8d8d-2278a909a97c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:29:48.697850 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3ec20-d49e-423c-8d8d-2278a909a97c service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:48.698173 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3ec20-d49e-423c-8d8d-2278a909a97c service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:48.698459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb3ec20-d49e-423c-8d8d-2278a909a97c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:48.700126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ffb3ec20-d49e-423c-8d8d-2278a909a97c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:48.776602 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:48.789917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3ec20-d49e-423c-8d8d-2278a909a97c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:29:48.791609 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb3ec20-d49e-423c-8d8d-2278a909a97c service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:29:48.810631 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 718/1425] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:29:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:29:49.665636 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83372b7b-9608-46fa-94ad-ec15b353deb9 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:49.666200 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83372b7b-9608-46fa-94ad-ec15b353deb9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:49.666200 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83372b7b-9608-46fa-94ad-ec15b353deb9 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:49.667730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 02:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:29:49.673271 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec7ceb-b1d8-4e99-bc83-f8802fbb12a7 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:49.673752 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec7ceb-b1d8-4e99-bc83-f8802fbb12a7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:49.673894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeec7ceb-b1d8-4e99-bc83-f8802fbb12a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:49.754968 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-aeec7ceb-b1d8-4e99-bc83-f8802fbb12a7 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:49.756202 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-aeec7ceb-b1d8-4e99-bc83-f8802fbb12a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:49.854955 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 02:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:29:50.005189 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83372b7b-9608-46fa-94ad-ec15b353deb9 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:29:50.007468 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-83372b7b-9608-46fa-94ad-ec15b353deb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:50.092955 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:50.155396 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83372b7b-9608-46fa-94ad-ec15b353deb9 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:29:50.265260 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8e1649-1b10-4b46-9f13-f121a193427a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:29:50.265864 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e1649-1b10-4b46-9f13-f121a193427a service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:50.266152 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e1649-1b10-4b46-9f13-f121a193427a service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:50.266431 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8e1649-1b10-4b46-9f13-f121a193427a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:50.268070 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0a8e1649-1b10-4b46-9f13-f121a193427a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:50.315153 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:50.356808 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e1649-1b10-4b46-9f13-f121a193427a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:29:50.358520 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8e1649-1b10-4b46-9f13-f121a193427a service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:29:50.376467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 709/1428] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:29:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:29:51.282846 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7d79e-6a99-4ce7-a4c1-5141648f1253 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:51.283411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7d79e-6a99-4ce7-a4c1-5141648f1253 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:51.283411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7d79e-6a99-4ce7-a4c1-5141648f1253 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:51.285331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 02:29:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:29:51.290510 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a5d03-71e9-4e3b-90d1-4b7286c75606 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:51.290933 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a5d03-71e9-4e3b-90d1-4b7286c75606 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:51.291052 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a5d03-71e9-4e3b-90d1-4b7286c75606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:51.366243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-190a5d03-71e9-4e3b-90d1-4b7286c75606 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:51.367471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-190a5d03-71e9-4e3b-90d1-4b7286c75606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:51.466515 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 02:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:29:51.615800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7d79e-6a99-4ce7-a4c1-5141648f1253 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:29:51.617389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ced7d79e-6a99-4ce7-a4c1-5141648f1253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:51.666021 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:51.771720 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7d79e-6a99-4ce7-a4c1-5141648f1253 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:29:51.884246 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec46f07-0804-4c77-af64-a7696986a5e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:29:51.884815 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec46f07-0804-4c77-af64-a7696986a5e6 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:51.885100 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec46f07-0804-4c77-af64-a7696986a5e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:51.885429 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec46f07-0804-4c77-af64-a7696986a5e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:51.887086 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8ec46f07-0804-4c77-af64-a7696986a5e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:51.894013 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:51.977688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec46f07-0804-4c77-af64-a7696986a5e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:29:51.979304 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec46f07-0804-4c77-af64-a7696986a5e6 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:29:51.997075 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 721/1431] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:29:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:29:52.871162 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46326d13-3118-4451-9c24-966b243ae7c3 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:52.871740 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46326d13-3118-4451-9c24-966b243ae7c3 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:52.871740 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46326d13-3118-4451-9c24-966b243ae7c3 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:52.873117 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 02:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:29:52.878138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b81c9-7e9f-49a2-80eb-2f90590c2f52 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:52.878566 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b81c9-7e9f-49a2-80eb-2f90590c2f52 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:52.878699 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b81c9-7e9f-49a2-80eb-2f90590c2f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:52.952231 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-481b81c9-7e9f-49a2-80eb-2f90590c2f52 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:52.953441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-481b81c9-7e9f-49a2-80eb-2f90590c2f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:53.020738 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:53.050103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 02:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:29:53.200191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46326d13-3118-4451-9c24-966b243ae7c3 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:29:53.201838 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-46326d13-3118-4451-9c24-966b243ae7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:53.219736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:53.348311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46326d13-3118-4451-9c24-966b243ae7c3 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:29:53.433837 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:53.459411 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d2ac9-3cc4-4815-af5a-d1f99c9e804b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:29:53.460274 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d2ac9-3cc4-4815-af5a-d1f99c9e804b service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:53.460727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d2ac9-3cc4-4815-af5a-d1f99c9e804b service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:53.461262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d2ac9-3cc4-4815-af5a-d1f99c9e804b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:53.463025 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9e9d2ac9-3cc4-4815-af5a-d1f99c9e804b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:53.550795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d2ac9-3cc4-4815-af5a-d1f99c9e804b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:29:53.552410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d2ac9-3cc4-4815-af5a-d1f99c9e804b service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:29:53.570602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 712/1434] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:29:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:29:54.465104 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90c995-7d7e-4cd0-be33-9743bbe14d10 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:54.465649 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90c995-7d7e-4cd0-be33-9743bbe14d10 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:54.465649 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e90c995-7d7e-4cd0-be33-9743bbe14d10 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:54.466989 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 02:29:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:29:54.472004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c0e00-685c-43c7-943b-0f953559b9c4 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:54.472424 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c0e00-685c-43c7-943b-0f953559b9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:54.472588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c0e00-685c-43c7-943b-0f953559b9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:54.545340 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-e03c0e00-685c-43c7-943b-0f953559b9c4 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:54.546599 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e03c0e00-685c-43c7-943b-0f953559b9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:54.587190 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:54.642316 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 02:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:29:54.793166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90c995-7d7e-4cd0-be33-9743bbe14d10 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:29:54.794883 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6e90c995-7d7e-4cd0-be33-9743bbe14d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:54.944875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e90c995-7d7e-4cd0-be33-9743bbe14d10 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:29:54.998016 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:55.055770 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc86a3c3-ff9c-4358-bb5b-a81873c59f74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:29:55.056352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86a3c3-ff9c-4358-bb5b-a81873c59f74 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:55.056636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86a3c3-ff9c-4358-bb5b-a81873c59f74 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:55.056916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc86a3c3-ff9c-4358-bb5b-a81873c59f74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:55.058574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-dc86a3c3-ff9c-4358-bb5b-a81873c59f74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:55.151637 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86a3c3-ff9c-4358-bb5b-a81873c59f74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:29:55.153263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc86a3c3-ff9c-4358-bb5b-a81873c59f74 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:29:55.171435 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 724/1437] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:29:56.060970 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba87cd-9ef6-4aa5-8a2b-c679a0b5527b None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:56.061579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba87cd-9ef6-4aa5-8a2b-c679a0b5527b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:56.061579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba87cd-9ef6-4aa5-8a2b-c679a0b5527b None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:56.062939 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 02:29:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:29:56.067831 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed931f7-450b-4c8c-a0fe-dc23475617ef None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:56.068225 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed931f7-450b-4c8c-a0fe-dc23475617ef None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:56.068387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed931f7-450b-4c8c-a0fe-dc23475617ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:56.141780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-bed931f7-450b-4c8c-a0fe-dc23475617ef None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:56.143043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bed931f7-450b-4c8c-a0fe-dc23475617ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:56.145117 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:56.241682 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 02:29:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:29:56.393741 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba87cd-9ef6-4aa5-8a2b-c679a0b5527b None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:29:56.395311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6fba87cd-9ef6-4aa5-8a2b-c679a0b5527b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:56.541078 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba87cd-9ef6-4aa5-8a2b-c679a0b5527b None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:29:56.569205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:56.656917 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad10eb97-6bb4-4f67-9b43-9016a1bb6426 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:29:56.657577 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10eb97-6bb4-4f67-9b43-9016a1bb6426 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:56.657898 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10eb97-6bb4-4f67-9b43-9016a1bb6426 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:56.658181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad10eb97-6bb4-4f67-9b43-9016a1bb6426 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:56.659948 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ad10eb97-6bb4-4f67-9b43-9016a1bb6426 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:56.749167 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10eb97-6bb4-4f67-9b43-9016a1bb6426 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:29:56.750949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad10eb97-6bb4-4f67-9b43-9016a1bb6426 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:29:56.770106 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 715/1440] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:29:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:29:58.695948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6a776-d510-443f-bfa1-1879d8b2a352 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:58.696483 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6a776-d510-443f-bfa1-1879d8b2a352 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:58.696614 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c6a776-d510-443f-bfa1-1879d8b2a352 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:58.697992 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 02:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:29:58.703273 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0d8b1-300f-489b-9918-ba8947551112 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:58.703675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0d8b1-300f-489b-9918-ba8947551112 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:58.703831 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0d8b1-300f-489b-9918-ba8947551112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:58.743297 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:58.767213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b8b0d8b1-300f-489b-9918-ba8947551112 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:29:58.768896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b8b0d8b1-300f-489b-9918-ba8947551112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:58.867263 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 02:29:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:29:58.906707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6a776-d510-443f-bfa1-1879d8b2a352 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:29:58.908224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-09c6a776-d510-443f-bfa1-1879d8b2a352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:59.011078 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c6a776-d510-443f-bfa1-1879d8b2a352 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:29:59.042505 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:29:59.084007 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cea826-c711-43ee-8b79-ca602bb0da18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:29:59.084647 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cea826-c711-43ee-8b79-ca602bb0da18 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:29:59.084930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cea826-c711-43ee-8b79-ca602bb0da18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:29:59.085214 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cea826-c711-43ee-8b79-ca602bb0da18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:29:59.086935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-77cea826-c711-43ee-8b79-ca602bb0da18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:29:59.193721 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cea826-c711-43ee-8b79-ca602bb0da18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:29:59.195190 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cea826-c711-43ee-8b79-ca602bb0da18 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:29:59.214538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 727/1443] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:29:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:30:01.417867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e8c9a-19f4-4a3a-b140-b3bc62d051a4 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:01.418396 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e8c9a-19f4-4a3a-b140-b3bc62d051a4 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:01.418396 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225e8c9a-19f4-4a3a-b140-b3bc62d051a4 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:01.420042 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 02:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:30:01.425834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b0f7c-6aa8-4211-80ea-aabad1c412c8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:01.426241 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b0f7c-6aa8-4211-80ea-aabad1c412c8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:01.426412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b0f7c-6aa8-4211-80ea-aabad1c412c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:01.490235 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-864b0f7c-6aa8-4211-80ea-aabad1c412c8 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:30:01.491447 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-864b0f7c-6aa8-4211-80ea-aabad1c412c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:01.504181 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:01.588060 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 02:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:30:01.628170 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e8c9a-19f4-4a3a-b140-b3bc62d051a4 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:30:01.630111 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-225e8c9a-19f4-4a3a-b140-b3bc62d051a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:01.737407 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225e8c9a-19f4-4a3a-b140-b3bc62d051a4 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:30:01.749204 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:01.809275 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45119f7-6a2e-4412-8378-f22bb555c9f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:30:01.809957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45119f7-6a2e-4412-8378-f22bb555c9f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:01.810246 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45119f7-6a2e-4412-8378-f22bb555c9f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:01.810527 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45119f7-6a2e-4412-8378-f22bb555c9f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:01.812211 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e45119f7-6a2e-4412-8378-f22bb555c9f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:01.934953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45119f7-6a2e-4412-8378-f22bb555c9f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:30:01.936419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45119f7-6a2e-4412-8378-f22bb555c9f0 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:30:01.954476 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 718/1446] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:30:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:30:04.474922 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003f1ca-6df4-4873-9cce-461f6479ed36 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:04.475441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003f1ca-6df4-4873-9cce-461f6479ed36 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:04.475441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8003f1ca-6df4-4873-9cce-461f6479ed36 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:04.476781 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 02:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:30:04.481937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67f84-6062-478a-80b2-14267476740a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:04.482332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67f84-6062-478a-80b2-14267476740a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:04.482499 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de67f84-6062-478a-80b2-14267476740a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:04.528782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:04.547380 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0de67f84-6062-478a-80b2-14267476740a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:30:04.548605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0de67f84-6062-478a-80b2-14267476740a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:04.643035 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 02:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:30:04.681961 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003f1ca-6df4-4873-9cce-461f6479ed36 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:30:04.683504 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8003f1ca-6df4-4873-9cce-461f6479ed36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:04.786340 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8003f1ca-6df4-4873-9cce-461f6479ed36 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:30:04.826332 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:04.860657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033174e8-0a78-40e3-b754-e09bfd106387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:30:04.861309 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033174e8-0a78-40e3-b754-e09bfd106387 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:04.861594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033174e8-0a78-40e3-b754-e09bfd106387 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:04.861903 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033174e8-0a78-40e3-b754-e09bfd106387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:04.863560 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-033174e8-0a78-40e3-b754-e09bfd106387 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:04.971186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033174e8-0a78-40e3-b754-e09bfd106387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:30:04.972623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033174e8-0a78-40e3-b754-e09bfd106387 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:30:04.991504 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 730/1449] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:30:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:30:07.115824 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c74818-bd83-459a-ab36-f51ec6ead49f None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:07.116406 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c74818-bd83-459a-ab36-f51ec6ead49f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:07.116406 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c74818-bd83-459a-ab36-f51ec6ead49f None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:07.117768 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 02:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:30:07.123167 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ad0e3-3e54-4e18-b6a5-372a51c2ecc8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:07.123577 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ad0e3-3e54-4e18-b6a5-372a51c2ecc8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:07.123722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ad0e3-3e54-4e18-b6a5-372a51c2ecc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:07.189574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f24ad0e3-3e54-4e18-b6a5-372a51c2ecc8 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:30:07.190809 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f24ad0e3-3e54-4e18-b6a5-372a51c2ecc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:07.211344 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:07.287125 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 02:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:30:07.325728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c74818-bd83-459a-ab36-f51ec6ead49f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:30:07.327283 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a3c74818-bd83-459a-ab36-f51ec6ead49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:07.430977 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c74818-bd83-459a-ab36-f51ec6ead49f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:30:07.449912 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:07.502389 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832dc832-a3fd-4688-ac7d-8adbb7260d35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:30:07.503041 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dc832-a3fd-4688-ac7d-8adbb7260d35 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:07.503328 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dc832-a3fd-4688-ac7d-8adbb7260d35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:07.503626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832dc832-a3fd-4688-ac7d-8adbb7260d35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:07.505243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-832dc832-a3fd-4688-ac7d-8adbb7260d35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:07.613279 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832dc832-a3fd-4688-ac7d-8adbb7260d35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:30:07.614742 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832dc832-a3fd-4688-ac7d-8adbb7260d35 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:30:07.632294 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 721/1452] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:30:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:30:09.693163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a265f-63df-4e93-ac9e-e44275b56269 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:09.693761 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a265f-63df-4e93-ac9e-e44275b56269 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:09.693761 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a265f-63df-4e93-ac9e-e44275b56269 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:09.695145 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 02:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:30:09.700532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20a657-0414-4086-aeb4-8b289b4d4c0a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:09.700967 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20a657-0414-4086-aeb4-8b289b4d4c0a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:09.701078 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20a657-0414-4086-aeb4-8b289b4d4c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:09.761836 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:09.764483 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-3c20a657-0414-4086-aeb4-8b289b4d4c0a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:30:09.765720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3c20a657-0414-4086-aeb4-8b289b4d4c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:09.860612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 02:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:30:09.898472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a265f-63df-4e93-ac9e-e44275b56269 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:30:09.900005 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-495a265f-63df-4e93-ac9e-e44275b56269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:10.006402 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a265f-63df-4e93-ac9e-e44275b56269 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:30:10.055540 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:10.081639 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c3554c-edf9-40cf-b77b-5f17d15cb147 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:30:10.082478 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3554c-edf9-40cf-b77b-5f17d15cb147 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:10.082861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3554c-edf9-40cf-b77b-5f17d15cb147 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:10.083226 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c3554c-edf9-40cf-b77b-5f17d15cb147 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:10.085050 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a7c3554c-edf9-40cf-b77b-5f17d15cb147 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:10.192558 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3554c-edf9-40cf-b77b-5f17d15cb147 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:30:10.194080 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c3554c-edf9-40cf-b77b-5f17d15cb147 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:30:10.212769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 733/1455] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:30:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:30:12.340824 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2c5ae-471b-4e5c-b04e-32442c8c94be None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:12.341685 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2c5ae-471b-4e5c-b04e-32442c8c94be None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:12.341685 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2c5ae-471b-4e5c-b04e-32442c8c94be None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:12.342816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 02:30:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:30:12.349185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7f24a-cc82-4313-aa4f-34f9779b4323 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:12.349633 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7f24a-cc82-4313-aa4f-34f9779b4323 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:12.349758 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7f24a-cc82-4313-aa4f-34f9779b4323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:12.415358 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-64c7f24a-cc82-4313-aa4f-34f9779b4323 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:30:12.416496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-64c7f24a-cc82-4313-aa4f-34f9779b4323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:12.445544 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:12.511833 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 02:30:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:30:12.550911 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2c5ae-471b-4e5c-b04e-32442c8c94be None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:30:12.552490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-59f2c5ae-471b-4e5c-b04e-32442c8c94be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:12.661142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2c5ae-471b-4e5c-b04e-32442c8c94be None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:30:12.690401 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:12.736163 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af3d8f-a6d4-44f4-aa7a-423d41e8e3c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:30:12.736818 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af3d8f-a6d4-44f4-aa7a-423d41e8e3c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:12.737103 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af3d8f-a6d4-44f4-aa7a-423d41e8e3c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:12.737398 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af3d8f-a6d4-44f4-aa7a-423d41e8e3c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:12.739121 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a8af3d8f-a6d4-44f4-aa7a-423d41e8e3c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:12.845414 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af3d8f-a6d4-44f4-aa7a-423d41e8e3c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:30:12.846901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af3d8f-a6d4-44f4-aa7a-423d41e8e3c1 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:30:12.864863 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 724/1458] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:30:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:30:14.924322 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1096c5-89e3-46b9-939a-b791e1b077dd None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:14.924906 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1096c5-89e3-46b9-939a-b791e1b077dd None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:14.924906 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1096c5-89e3-46b9-939a-b791e1b077dd None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:14.926304 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 02:30:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:30:14.931494 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012753e-60f4-42b8-951f-97bd5dd130cd None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:14.931901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012753e-60f4-42b8-951f-97bd5dd130cd None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:14.932052 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6012753e-60f4-42b8-951f-97bd5dd130cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:14.996037 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-6012753e-60f4-42b8-951f-97bd5dd130cd None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:30:14.997275 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6012753e-60f4-42b8-951f-97bd5dd130cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:15.006018 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:15.093347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 02:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:30:15.130830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1096c5-89e3-46b9-939a-b791e1b077dd None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:30:15.132404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ee1096c5-89e3-46b9-939a-b791e1b077dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:15.235657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1096c5-89e3-46b9-939a-b791e1b077dd None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:30:15.291219 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:15.310678 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e3397-e379-497f-bce8-6010d763558f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:30:15.317115 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e3397-e379-497f-bce8-6010d763558f service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:15.317115 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e3397-e379-497f-bce8-6010d763558f service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:15.317115 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e3397-e379-497f-bce8-6010d763558f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:15.317115 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4a0e3397-e379-497f-bce8-6010d763558f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:15.425249 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e3397-e379-497f-bce8-6010d763558f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:30:15.426730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e3397-e379-497f-bce8-6010d763558f service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:30:15.445069 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 736/1461] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:30:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:30:17.502717 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef88ce6-5640-4c04-b2c8-85f347b38239 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:17.503231 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef88ce6-5640-4c04-b2c8-85f347b38239 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:17.503231 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef88ce6-5640-4c04-b2c8-85f347b38239 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:17.504581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 02:30:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:30:17.509961 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46a72c-d946-45d4-8bdf-d4622ba1a0a8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:17.510405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46a72c-d946-45d4-8bdf-d4622ba1a0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:17.510531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46a72c-d946-45d4-8bdf-d4622ba1a0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:17.575010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-9e46a72c-d946-45d4-8bdf-d4622ba1a0a8 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:30:17.576254 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9e46a72c-d946-45d4-8bdf-d4622ba1a0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:17.615502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:17.673355 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 02:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:30:17.709846 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef88ce6-5640-4c04-b2c8-85f347b38239 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:30:17.711374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-bef88ce6-5640-4c04-b2c8-85f347b38239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:17.815686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef88ce6-5640-4c04-b2c8-85f347b38239 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:30:17.852884 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:17.887794 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a6d33-3f14-4870-86b2-cb10d3be27f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:30:17.888438 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a6d33-3f14-4870-86b2-cb10d3be27f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:17.888717 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a6d33-3f14-4870-86b2-cb10d3be27f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:17.888991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a6d33-3f14-4870-86b2-cb10d3be27f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:17.890656 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e72a6d33-3f14-4870-86b2-cb10d3be27f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:17.996644 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a6d33-3f14-4870-86b2-cb10d3be27f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:30:17.998107 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72a6d33-3f14-4870-86b2-cb10d3be27f8 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:30:18.021472 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 727/1464] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:30:20.050594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20d248-133a-428b-812c-99a022bc9b1b None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:20.051298 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20d248-133a-428b-812c-99a022bc9b1b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:20.051298 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20d248-133a-428b-812c-99a022bc9b1b None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:20.052920 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 02:30:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:30:20.058677 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c6907-c522-4110-8c8f-397521c15eed None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:20.059109 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c6907-c522-4110-8c8f-397521c15eed None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:20.059248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c6907-c522-4110-8c8f-397521c15eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:20.126774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b54c6907-c522-4110-8c8f-397521c15eed None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:30:20.127919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b54c6907-c522-4110-8c8f-397521c15eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:20.150705 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:20.231595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 02:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:30:20.268557 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20d248-133a-428b-812c-99a022bc9b1b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:30:20.270179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-eb20d248-133a-428b-812c-99a022bc9b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:20.374659 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20d248-133a-428b-812c-99a022bc9b1b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:30:20.441770 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:20.448530 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76489a2-e06b-4125-8042-3837ba598ea0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:30:20.455714 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76489a2-e06b-4125-8042-3837ba598ea0 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:20.455714 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76489a2-e06b-4125-8042-3837ba598ea0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:20.455714 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76489a2-e06b-4125-8042-3837ba598ea0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:20.455714 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e76489a2-e06b-4125-8042-3837ba598ea0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:20.559310 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76489a2-e06b-4125-8042-3837ba598ea0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:30:20.560750 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76489a2-e06b-4125-8042-3837ba598ea0 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:30:20.579103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 739/1467] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:30:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:30:22.596199 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37b588-b4ce-4c9d-b0f1-78b355b7518e None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:22.596711 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37b588-b4ce-4c9d-b0f1-78b355b7518e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:22.596711 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37b588-b4ce-4c9d-b0f1-78b355b7518e None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:22.598107 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 02:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:30:22.603487 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a66dc2-095f-4538-857b-1643133bc9bb None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:22.603927 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a66dc2-095f-4538-857b-1643133bc9bb None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:22.604188 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a66dc2-095f-4538-857b-1643133bc9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:22.669143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-03a66dc2-095f-4538-857b-1643133bc9bb None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:30:22.670372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-03a66dc2-095f-4538-857b-1643133bc9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:22.718876 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:22.767555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 02:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:30:22.805259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37b588-b4ce-4c9d-b0f1-78b355b7518e None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:30:22.806882 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8e37b588-b4ce-4c9d-b0f1-78b355b7518e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:22.908724 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37b588-b4ce-4c9d-b0f1-78b355b7518e None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:30:22.955725 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:22.981687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ebe16-2ecb-4c4a-b889-145016416086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:30:22.982364 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ebe16-2ecb-4c4a-b889-145016416086 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:22.982707 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ebe16-2ecb-4c4a-b889-145016416086 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:22.983186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ebe16-2ecb-4c4a-b889-145016416086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:22.986056 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-026ebe16-2ecb-4c4a-b889-145016416086 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:23.095096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ebe16-2ecb-4c4a-b889-145016416086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:30:23.096563 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ebe16-2ecb-4c4a-b889-145016416086 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:30:23.116564 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 730/1470] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:30:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:30:32.765980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=22 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:33.114095 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=66 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:42.657036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e24aa-7da3-400e-9fa2-236a0a717203 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:42.657573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e24aa-7da3-400e-9fa2-236a0a717203 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:42.657730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e24aa-7da3-400e-9fa2-236a0a717203 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:42.659110 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 741/1471] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:30:42.664574 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6bb8c-4869-409b-bfad-1a3fdef2ddea None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:42.665017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6bb8c-4869-409b-bfad-1a3fdef2ddea None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:42.665127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f6bb8c-4869-409b-bfad-1a3fdef2ddea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:42.729530 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-84f6bb8c-4869-409b-bfad-1a3fdef2ddea None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:30:42.730760 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-84f6bb8c-4869-409b-bfad-1a3fdef2ddea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:42.829301 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 731/1472] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:30:42.877625 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1e72d-3637-47b2-b591-3aa4a5d8c726 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:42.877960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1e72d-3637-47b2-b591-3aa4a5d8c726 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:42.878244 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1e72d-3637-47b2-b591-3aa4a5d8c726 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:42.879624 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 742/1473] 10.222.0.64 () {54 vars in 961 bytes} [Mon Jul 18 02:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:30:42.884556 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2bd40-ca50-46be-bfb4-d1c5399e428d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:42.884843 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2bd40-ca50-46be-bfb4-d1c5399e428d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:42.885120 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c2bd40-ca50-46be-bfb4-d1c5399e428d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:42.957826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c4c2bd40-ca50-46be-bfb4-d1c5399e428d None None] MFA Rules not processed for user `b8948dc6a55344eaa85e2a6092215ec6`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:30:42.959037 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c4c2bd40-ca50-46be-bfb4-d1c5399e428d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:42.979835 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:43.035278 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 732/1474] 10.222.0.64 () {58 vars in 1058 bytes} [Mon Jul 18 02:30:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:30:43.042925 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1e72d-3637-47b2-b591-3aa4a5d8c726 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:30:43.044466 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f4f1e72d-3637-47b2-b591-3aa4a5d8c726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:43.149331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1e72d-3637-47b2-b591-3aa4a5d8c726 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:30:43.222225 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bbcce-fb5c-45df-9ac1-1e144f064a75 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8948dc6a55344eaa85e2a6092215ec6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:30:43.222877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bbcce-fb5c-45df-9ac1-1e144f064a75 service glance] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:43.223165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bbcce-fb5c-45df-9ac1-1e144f064a75 service glance] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:43.223444 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bbcce-fb5c-45df-9ac1-1e144f064a75 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:43.225091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fa1bbcce-fb5c-45df-9ac1-1e144f064a75 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:43.279073 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:43.334859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bbcce-fb5c-45df-9ac1-1e144f064a75 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:30:43.336305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bbcce-fb5c-45df-9ac1-1e144f064a75 service glance] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:30:43.354801 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 743/1475] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:30:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:30:45.509419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46392b42-549d-4665-9f14-a4b44a2487dd None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:45.509975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46392b42-549d-4665-9f14-a4b44a2487dd None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:45.509975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46392b42-549d-4665-9f14-a4b44a2487dd None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:45.511323 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 733/1476] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:30:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:30:45.517242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea29f83-c146-4475-86ad-cf008d1b056a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:45.517689 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea29f83-c146-4475-86ad-cf008d1b056a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:45.517894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea29f83-c146-4475-86ad-cf008d1b056a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:45.581933 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2ea29f83-c146-4475-86ad-cf008d1b056a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:30:45.583144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2ea29f83-c146-4475-86ad-cf008d1b056a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:45.679181 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 744/1477] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:30:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:30:45.702371 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46392b42-549d-4665-9f14-a4b44a2487dd None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:30:45.703965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-46392b42-549d-4665-9f14-a4b44a2487dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:45.827832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46392b42-549d-4665-9f14-a4b44a2487dd None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:30:45.876489 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:45.920968 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36161d-70fd-4e1b-ac81-3812f897fbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:30:45.921660 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36161d-70fd-4e1b-ac81-3812f897fbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:45.921977 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36161d-70fd-4e1b-ac81-3812f897fbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:45.922254 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36161d-70fd-4e1b-ac81-3812f897fbd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:45.922982 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36161d-70fd-4e1b-ac81-3812f897fbd5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:30:45.924781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: WARNING py.warnings [None req-ed36161d-70fd-4e1b-ac81-3812f897fbd5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:30:45.924781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: warnings.warn(msg) Jul 18 02:30:45.924781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: Jul 18 02:30:45.925994 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36161d-70fd-4e1b-ac81-3812f897fbd5 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:30:45.944979 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 734/1478] 10.222.0.64 () {56 vars in 1108 bytes} [Mon Jul 18 02:30:45 2022] GET /identity/v3/projects => generated 2553 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:30:48.028455 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb070e52-a26e-45e7-838f-a3bdb2264d1b None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:48.028996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb070e52-a26e-45e7-838f-a3bdb2264d1b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:48.028996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb070e52-a26e-45e7-838f-a3bdb2264d1b None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:48.030510 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 745/1479] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:30:48.035928 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdef400-744c-4089-8f68-59f07cfd4617 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:48.036384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdef400-744c-4089-8f68-59f07cfd4617 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:48.036482 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdef400-744c-4089-8f68-59f07cfd4617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:48.104246 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-dcdef400-744c-4089-8f68-59f07cfd4617 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:30:48.105493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-dcdef400-744c-4089-8f68-59f07cfd4617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:48.213774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 735/1480] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:30:48.260023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb070e52-a26e-45e7-838f-a3bdb2264d1b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:30:48.261582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cb070e52-a26e-45e7-838f-a3bdb2264d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:48.273486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:48.428119 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb070e52-a26e-45e7-838f-a3bdb2264d1b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:30:48.511230 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:48.555984 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4f9c8-0830-4682-862b-d1f1dad8fcf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:30:48.556660 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4f9c8-0830-4682-862b-d1f1dad8fcf8 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:48.556953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4f9c8-0830-4682-862b-d1f1dad8fcf8 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:48.557235 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4f9c8-0830-4682-862b-d1f1dad8fcf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:48.559199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d7a4f9c8-0830-4682-862b-d1f1dad8fcf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:48.666454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4f9c8-0830-4682-862b-d1f1dad8fcf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:30:48.668260 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4f9c8-0830-4682-862b-d1f1dad8fcf8 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:30:48.688245 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 746/1481] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:30:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:30:50.933897 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30f30b-d8a7-4b6f-bcd5-e6039009ed7a None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:50.934426 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30f30b-d8a7-4b6f-bcd5-e6039009ed7a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:50.934521 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30f30b-d8a7-4b6f-bcd5-e6039009ed7a None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:50.936010 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 736/1482] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:30:50.941683 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b94c98-e52e-4763-b75d-9cf0c2df0776 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:50.942147 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b94c98-e52e-4763-b75d-9cf0c2df0776 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:50.942298 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b94c98-e52e-4763-b75d-9cf0c2df0776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:51.010192 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a6b94c98-e52e-4763-b75d-9cf0c2df0776 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:30:51.011416 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a6b94c98-e52e-4763-b75d-9cf0c2df0776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:51.060136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:51.111089 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 747/1483] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:30:51.147577 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30f30b-d8a7-4b6f-bcd5-e6039009ed7a None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:30:51.149152 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-de30f30b-d8a7-4b6f-bcd5-e6039009ed7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:51.174837 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:51.256763 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30f30b-d8a7-4b6f-bcd5-e6039009ed7a None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:30:51.333475 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af764541-3eec-425c-96a0-ae549e3ef937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:30:51.334207 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af764541-3eec-425c-96a0-ae549e3ef937 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:51.334491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af764541-3eec-425c-96a0-ae549e3ef937 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:51.334767 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af764541-3eec-425c-96a0-ae549e3ef937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:51.336421 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-af764541-3eec-425c-96a0-ae549e3ef937 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:51.413685 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:51.457384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af764541-3eec-425c-96a0-ae549e3ef937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:30:51.458897 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af764541-3eec-425c-96a0-ae549e3ef937 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:30:51.479812 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 737/1484] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:30:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:30:53.644579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b4103-7d9a-4a12-babc-1bcc89060782 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:53.645119 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b4103-7d9a-4a12-babc-1bcc89060782 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:53.645119 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b4103-7d9a-4a12-babc-1bcc89060782 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:53.646670 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 748/1485] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:30:53.652038 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c2536-1db4-4b9d-aa28-e81a4f3d42fc None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:53.652494 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c2536-1db4-4b9d-aa28-e81a4f3d42fc None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:53.652599 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c2536-1db4-4b9d-aa28-e81a4f3d42fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:53.718864 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-7b9c2536-1db4-4b9d-aa28-e81a4f3d42fc None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:30:53.720172 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7b9c2536-1db4-4b9d-aa28-e81a4f3d42fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:53.823513 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 738/1486] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:30:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:30:53.865444 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b4103-7d9a-4a12-babc-1bcc89060782 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:30:53.867085 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ef7b4103-7d9a-4a12-babc-1bcc89060782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:53.977557 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b4103-7d9a-4a12-babc-1bcc89060782 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:30:54.050582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:54.052380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430e250c-177a-4e3a-b95f-543cc05fcab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:30:54.053032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e250c-177a-4e3a-b95f-543cc05fcab9 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:54.053320 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e250c-177a-4e3a-b95f-543cc05fcab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:54.053603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430e250c-177a-4e3a-b95f-543cc05fcab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:54.055279 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-430e250c-177a-4e3a-b95f-543cc05fcab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:54.179335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e250c-177a-4e3a-b95f-543cc05fcab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:30:54.180789 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430e250c-177a-4e3a-b95f-543cc05fcab9 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:30:54.198914 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 749/1487] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:30:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:30:56.300295 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e9d7e-fff1-43f5-973c-e66a9e791a8f None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:56.300768 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e9d7e-fff1-43f5-973c-e66a9e791a8f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:56.300882 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e9d7e-fff1-43f5-973c-e66a9e791a8f None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:56.302273 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 739/1488] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:30:56.307627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be8710-2428-4e4c-8985-4e6b56e88f78 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:56.308168 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be8710-2428-4e4c-8985-4e6b56e88f78 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:56.308302 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22be8710-2428-4e4c-8985-4e6b56e88f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:56.372675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-22be8710-2428-4e4c-8985-4e6b56e88f78 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:30:56.374017 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-22be8710-2428-4e4c-8985-4e6b56e88f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:56.430157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:56.475252 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 750/1489] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:30:56.516840 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e9d7e-fff1-43f5-973c-e66a9e791a8f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:30:56.518421 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cc7e9d7e-fff1-43f5-973c-e66a9e791a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:56.555544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:56.624055 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e9d7e-fff1-43f5-973c-e66a9e791a8f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:30:56.698249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2ffe4-386c-4b2e-bc37-db356d9e427b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:30:56.698837 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2ffe4-386c-4b2e-bc37-db356d9e427b service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:56.699120 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2ffe4-386c-4b2e-bc37-db356d9e427b service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:56.699393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2ffe4-386c-4b2e-bc37-db356d9e427b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:56.701824 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c2a2ffe4-386c-4b2e-bc37-db356d9e427b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:56.782961 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:56.812282 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2ffe4-386c-4b2e-bc37-db356d9e427b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:30:56.813761 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2ffe4-386c-4b2e-bc37-db356d9e427b service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:30:56.831562 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 740/1490] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:30:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:30:59.172800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48f31d-191a-4409-9a3e-e38c364433c8 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:59.173262 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48f31d-191a-4409-9a3e-e38c364433c8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:59.173380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48f31d-191a-4409-9a3e-e38c364433c8 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:59.174821 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 751/1491] 10.222.0.64 () {54 vars in 926 bytes} [Mon Jul 18 02:30:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:30:59.180223 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc681280-06ca-4348-aefb-36895b5c2df0 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:59.180660 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc681280-06ca-4348-aefb-36895b5c2df0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:59.180767 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc681280-06ca-4348-aefb-36895b5c2df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:59.243901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-bc681280-06ca-4348-aefb-36895b5c2df0 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:30:59.245115 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-bc681280-06ca-4348-aefb-36895b5c2df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:59.343686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 741/1492] 10.222.0.64 () {58 vars in 1023 bytes} [Mon Jul 18 02:30:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:30:59.383907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48f31d-191a-4409-9a3e-e38c364433c8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:30:59.385479 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ea48f31d-191a-4409-9a3e-e38c364433c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:59.493135 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48f31d-191a-4409-9a3e-e38c364433c8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:30:59.567984 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb1702-29bd-4f0f-870d-5dbb9df8b14a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:30:59.568633 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb1702-29bd-4f0f-870d-5dbb9df8b14a service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:30:59.568916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb1702-29bd-4f0f-870d-5dbb9df8b14a service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:30:59.569199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb1702-29bd-4f0f-870d-5dbb9df8b14a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:30:59.570923 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-80cb1702-29bd-4f0f-870d-5dbb9df8b14a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:30:59.580168 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:30:59.693375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb1702-29bd-4f0f-870d-5dbb9df8b14a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:30:59.695338 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb1702-29bd-4f0f-870d-5dbb9df8b14a service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:30:59.714078 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 752/1493] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:30:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:31:09.341837 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=82 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:31:09.711706 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=50 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:44.076476 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb786e62-7e43-4173-acd1-11218a837509 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:32:44.077085 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb786e62-7e43-4173-acd1-11218a837509 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:32:44.077085 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb786e62-7e43-4173-acd1-11218a837509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:32:44.150641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-eb786e62-7e43-4173-acd1-11218a837509 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:32:44.151855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-eb786e62-7e43-4173-acd1-11218a837509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:32:44.247854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 742/1494] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:32:44.256554 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a70930-f3c1-487c-aae2-0f63deb509cf None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:32:44.257053 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a70930-f3c1-487c-aae2-0f63deb509cf None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:32:44.257163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a70930-f3c1-487c-aae2-0f63deb509cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:32:44.332089 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-28a70930-f3c1-487c-aae2-0f63deb509cf None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:32:44.333239 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-28a70930-f3c1-487c-aae2-0f63deb509cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:32:44.426889 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 753/1495] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:32:44.431556 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb786e62-7e43-4173-acd1-11218a837509 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:32:44.432773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-eb786e62-7e43-4173-acd1-11218a837509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:32:44.444986 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb786e62-7e43-4173-acd1-11218a837509 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:32:44.505085 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:44.538596 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a708b74-1178-4ddc-95e4-c452e8dc3da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:32:44.539261 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a708b74-1178-4ddc-95e4-c452e8dc3da4 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:32:44.539543 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a708b74-1178-4ddc-95e4-c452e8dc3da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:32:44.539816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a708b74-1178-4ddc-95e4-c452e8dc3da4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:32:44.540620 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a708b74-1178-4ddc-95e4-c452e8dc3da4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:32:44.541129 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a708b74-1178-4ddc-95e4-c452e8dc3da4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:32:44.542358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: WARNING py.warnings [None req-2a708b74-1178-4ddc-95e4-c452e8dc3da4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:32:44.542358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: warnings.warn(msg) Jul 18 02:32:44.542358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: Jul 18 02:32:44.543451 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a708b74-1178-4ddc-95e4-c452e8dc3da4 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:32:44.555125 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 743/1496] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:32:44.563500 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a70930-f3c1-487c-aae2-0f63deb509cf None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:32:44.573357 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a70930-f3c1-487c-aae2-0f63deb509cf None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:32:44.633671 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:44.666442 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652248d9-f351-479e-b5b2-6b2da80cc656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:32:44.667100 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652248d9-f351-479e-b5b2-6b2da80cc656 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:32:44.667385 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652248d9-f351-479e-b5b2-6b2da80cc656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:32:44.667664 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652248d9-f351-479e-b5b2-6b2da80cc656 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:32:44.668358 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652248d9-f351-479e-b5b2-6b2da80cc656 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:32:44.670100 dv-cinder-850015-3-smb devstack@keystone.service[80358]: WARNING py.warnings [None req-652248d9-f351-479e-b5b2-6b2da80cc656 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:32:44.670100 dv-cinder-850015-3-smb devstack@keystone.service[80358]: warnings.warn(msg) Jul 18 02:32:44.670100 dv-cinder-850015-3-smb devstack@keystone.service[80358]: Jul 18 02:32:44.671292 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652248d9-f351-479e-b5b2-6b2da80cc656 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:32:44.775875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 754/1497] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:32:44 2022] POST /identity/v3/projects => generated 379 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:32:44.780146 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a708b74-1178-4ddc-95e4-c452e8dc3da4 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:32:44.781644 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2a708b74-1178-4ddc-95e4-c452e8dc3da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:32:44.814495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a708b74-1178-4ddc-95e4-c452e8dc3da4 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:32:44.906282 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b79168-5158-4f7c-852e-071a6d60a6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:32:44.906871 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b79168-5158-4f7c-852e-071a6d60a6eb admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:32:44.907154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b79168-5158-4f7c-852e-071a6d60a6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:32:44.907428 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b79168-5158-4f7c-852e-071a6d60a6eb admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:32:44.908124 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b79168-5158-4f7c-852e-071a6d60a6eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:32:44.909142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: WARNING py.warnings [None req-c7b79168-5158-4f7c-852e-071a6d60a6eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:32:44.909142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: warnings.warn(msg) Jul 18 02:32:44.909142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: Jul 18 02:32:44.910908 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b79168-5158-4f7c-852e-071a6d60a6eb admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:32:45.004543 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 744/1498] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:32:44 2022] POST /identity/v3/users => generated 290 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:32:45.008680 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652248d9-f351-479e-b5b2-6b2da80cc656 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:32:45.010278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-652248d9-f351-479e-b5b2-6b2da80cc656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:32:45.072564 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652248d9-f351-479e-b5b2-6b2da80cc656 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:32:45.155540 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:45.167151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145bc3e-5bab-4980-a650-b228a48b1d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:32:45.167768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145bc3e-5bab-4980-a650-b228a48b1d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:32:45.168050 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145bc3e-5bab-4980-a650-b228a48b1d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:32:45.168327 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145bc3e-5bab-4980-a650-b228a48b1d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:32:45.169050 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145bc3e-5bab-4980-a650-b228a48b1d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:32:45.170099 dv-cinder-850015-3-smb devstack@keystone.service[80358]: WARNING py.warnings [None req-7145bc3e-5bab-4980-a650-b228a48b1d5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:32:45.170099 dv-cinder-850015-3-smb devstack@keystone.service[80358]: warnings.warn(msg) Jul 18 02:32:45.170099 dv-cinder-850015-3-smb devstack@keystone.service[80358]: Jul 18 02:32:45.170985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7145bc3e-5bab-4980-a650-b228a48b1d5f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:32:45.183600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 755/1499] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:32:45.187703 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b79168-5158-4f7c-852e-071a6d60a6eb admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:32:45.189216 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c7b79168-5158-4f7c-852e-071a6d60a6eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:32:45.200553 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b79168-5158-4f7c-852e-071a6d60a6eb admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:32:45.226929 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:45.415064 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bc2f5a-1269-43c2-8a28-4ae99d7f1160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:32:45.415738 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc2f5a-1269-43c2-8a28-4ae99d7f1160 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:32:45.416026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc2f5a-1269-43c2-8a28-4ae99d7f1160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:32:45.416305 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc2f5a-1269-43c2-8a28-4ae99d7f1160 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:32:45.417035 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc2f5a-1269-43c2-8a28-4ae99d7f1160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:32:45.418130 dv-cinder-850015-3-smb devstack@keystone.service[80357]: WARNING py.warnings [None req-c1bc2f5a-1269-43c2-8a28-4ae99d7f1160 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:32:45.418130 dv-cinder-850015-3-smb devstack@keystone.service[80357]: warnings.warn(msg) Jul 18 02:32:45.418130 dv-cinder-850015-3-smb devstack@keystone.service[80357]: Jul 18 02:32:45.418961 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bc2f5a-1269-43c2-8a28-4ae99d7f1160 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:32:45.431792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 745/1500] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:32:45.436048 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145bc3e-5bab-4980-a650-b228a48b1d5f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:32:45.437576 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7145bc3e-5bab-4980-a650-b228a48b1d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:32:45.470977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7145bc3e-5bab-4980-a650-b228a48b1d5f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:32:45.563116 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf069a59-c073-49b6-ad81-e168a683f4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:32:45.564000 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf069a59-c073-49b6-ad81-e168a683f4e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:32:45.564281 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf069a59-c073-49b6-ad81-e168a683f4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:32:45.564581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf069a59-c073-49b6-ad81-e168a683f4e9 admin admin] PATH_INFO: `/v3/projects/7bf317aedf024073bd0ea7c92c2ffb62/users/2adb0bec8d8b4713948b505ab9cc47b5/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:32:45.588098 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf069a59-c073-49b6-ad81-e168a683f4e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bf317aedf024073bd0ea7c92c2ffb62, user_id=2adb0bec8d8b4713948b505ab9cc47b5, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:32:45.589119 dv-cinder-850015-3-smb devstack@keystone.service[80358]: WARNING py.warnings [None req-bf069a59-c073-49b6-ad81-e168a683f4e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:32:45.589119 dv-cinder-850015-3-smb devstack@keystone.service[80358]: warnings.warn(msg) Jul 18 02:32:45.589119 dv-cinder-850015-3-smb devstack@keystone.service[80358]: Jul 18 02:32:45.591094 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf069a59-c073-49b6-ad81-e168a683f4e9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:32:45.701838 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 756/1501] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:32:45 2022] PUT /identity/v3/projects/7bf317aedf024073bd0ea7c92c2ffb62/users/2adb0bec8d8b4713948b505ab9cc47b5/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:32:45.714728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a005ea-7a55-48fe-8a06-89f31ba46d2d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:32:45.715048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a005ea-7a55-48fe-8a06-89f31ba46d2d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:32:45.715326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a005ea-7a55-48fe-8a06-89f31ba46d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:32:45.772943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a2a005ea-7a55-48fe-8a06-89f31ba46d2d None None] MFA Rules not processed for user `2adb0bec8d8b4713948b505ab9cc47b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:32:45.774185 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a2a005ea-7a55-48fe-8a06-89f31ba46d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:32:45.849404 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 746/1502] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:32:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:32:45.862667 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062e9cb-7beb-48fb-b0dc-d22176473267 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:32:45.862955 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062e9cb-7beb-48fb-b0dc-d22176473267 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:32:45.863233 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8062e9cb-7beb-48fb-b0dc-d22176473267 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:32:45.864593 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 757/1503] 10.222.0.64 () {54 vars in 964 bytes} [Mon Jul 18 02:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:32:45.869425 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94134c-24fb-48a1-bdac-1522c8620df4 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:32:45.869836 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94134c-24fb-48a1-bdac-1522c8620df4 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:32:45.870121 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c94134c-24fb-48a1-bdac-1522c8620df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:32:45.899789 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:45.942605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0c94134c-24fb-48a1-bdac-1522c8620df4 None None] MFA Rules not processed for user `bdb0a04d568e4b14b07cd6d6092bc49f`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:32:45.943809 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0c94134c-24fb-48a1-bdac-1522c8620df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:32:46.016824 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 747/1504] 10.222.0.64 () {58 vars in 1061 bytes} [Mon Jul 18 02:32:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:32:46.024961 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062e9cb-7beb-48fb-b0dc-d22176473267 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:32:46.026496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8062e9cb-7beb-48fb-b0dc-d22176473267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:32:46.076265 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:46.129239 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8062e9cb-7beb-48fb-b0dc-d22176473267 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:32:46.202515 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95cfd86-c1f6-4a4e-a8e2-e7e52f7fd398 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:32:46.203165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95cfd86-c1f6-4a4e-a8e2-e7e52f7fd398 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:32:46.203448 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95cfd86-c1f6-4a4e-a8e2-e7e52f7fd398 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:32:46.203726 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95cfd86-c1f6-4a4e-a8e2-e7e52f7fd398 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:32:46.205346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c95cfd86-c1f6-4a4e-a8e2-e7e52f7fd398 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:32:46.307005 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95cfd86-c1f6-4a4e-a8e2-e7e52f7fd398 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:32:46.308714 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95cfd86-c1f6-4a4e-a8e2-e7e52f7fd398 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:32:46.312379 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:46.327135 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 758/1505] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:32:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:32:46.371769 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd2ac1-cdff-448f-bd14-db648ffb1b05 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:32:46.371769 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd2ac1-cdff-448f-bd14-db648ffb1b05 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:32:46.371769 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd2ac1-cdff-448f-bd14-db648ffb1b05 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:32:46.371769 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 748/1506] 10.222.0.64 () {52 vars in 829 bytes} [Mon Jul 18 02:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:32:46.374616 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95cfd86-c1f6-4a4e-a8e2-e7e52f7fd398 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:32:46.375865 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c95cfd86-c1f6-4a4e-a8e2-e7e52f7fd398 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:32:46.475700 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95cfd86-c1f6-4a4e-a8e2-e7e52f7fd398 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:32:46.568122 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6240c7-1325-4894-a58f-03ebf0c07aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:32:46.568922 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6240c7-1325-4894-a58f-03ebf0c07aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:32:46.569199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6240c7-1325-4894-a58f-03ebf0c07aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:32:46.569471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6240c7-1325-4894-a58f-03ebf0c07aa9 admin admin] PATH_INFO: `/v3/users/2adb0bec8d8b4713948b505ab9cc47b5` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:32:46.581555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6240c7-1325-4894-a58f-03ebf0c07aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2adb0bec8d8b4713948b505ab9cc47b5)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:32:46.582598 dv-cinder-850015-3-smb devstack@keystone.service[80358]: WARNING py.warnings [None req-de6240c7-1325-4894-a58f-03ebf0c07aa9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:32:46.582598 dv-cinder-850015-3-smb devstack@keystone.service[80358]: warnings.warn(msg) Jul 18 02:32:46.582598 dv-cinder-850015-3-smb devstack@keystone.service[80358]: Jul 18 02:32:46.583790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6240c7-1325-4894-a58f-03ebf0c07aa9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:32:46.593375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:46.970479 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-de6240c7-1325-4894-a58f-03ebf0c07aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2adb0bec8d8b4713948b505ab9cc47b5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:32:46.971058 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-de6240c7-1325-4894-a58f-03ebf0c07aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2adb0bec8d8b4713948b505ab9cc47b5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:32:46.971480 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-de6240c7-1325-4894-a58f-03ebf0c07aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2adb0bec8d8b4713948b505ab9cc47b5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:32:46.990384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-de6240c7-1325-4894-a58f-03ebf0c07aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2adb0bec8d8b4713948b505ab9cc47b5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:32:47.043025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-de6240c7-1325-4894-a58f-03ebf0c07aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2adb0bec8d8b4713948b505ab9cc47b5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:32:47.061101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 759/1507] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:32:46 2022] DELETE /identity/v3/users/2adb0bec8d8b4713948b505ab9cc47b5 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:32:47.065566 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c451bb-6ce7-436b-a324-b257a82a765a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:32:47.065881 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c451bb-6ce7-436b-a324-b257a82a765a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:32:47.066160 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c451bb-6ce7-436b-a324-b257a82a765a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:32:47.121484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c3c451bb-6ce7-436b-a324-b257a82a765a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:32:47.122718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c3c451bb-6ce7-436b-a324-b257a82a765a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:32:47.196647 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:47.209082 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 749/1508] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:32:47.219530 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6240c7-1325-4894-a58f-03ebf0c07aa9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:32:47.220788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-de6240c7-1325-4894-a58f-03ebf0c07aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:32:47.322062 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6240c7-1325-4894-a58f-03ebf0c07aa9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:32:47.377843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:47.397450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262db56-de7b-4f55-bfc8-102da335bc0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:32:47.398135 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262db56-de7b-4f55-bfc8-102da335bc0d service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:32:47.398421 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262db56-de7b-4f55-bfc8-102da335bc0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:32:47.398698 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262db56-de7b-4f55-bfc8-102da335bc0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:32:47.400311 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8262db56-de7b-4f55-bfc8-102da335bc0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:32:47.507916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262db56-de7b-4f55-bfc8-102da335bc0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:32:47.509273 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262db56-de7b-4f55-bfc8-102da335bc0d service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:32:47.528059 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 760/1509] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:32:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:32:47.989374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c451bb-6ce7-436b-a324-b257a82a765a None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:32:47.990682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c3c451bb-6ce7-436b-a324-b257a82a765a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:32:48.002592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c451bb-6ce7-436b-a324-b257a82a765a None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:32:48.095806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c093f-0d08-4112-8dde-fba74466cdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:32:48.097162 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c093f-0d08-4112-8dde-fba74466cdde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:32:48.097519 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c093f-0d08-4112-8dde-fba74466cdde admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:32:48.097822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c093f-0d08-4112-8dde-fba74466cdde admin admin] PATH_INFO: `/v3/projects/7bf317aedf024073bd0ea7c92c2ffb62` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:32:48.107983 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c093f-0d08-4112-8dde-fba74466cdde admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bf317aedf024073bd0ea7c92c2ffb62)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:32:48.109013 dv-cinder-850015-3-smb devstack@keystone.service[80357]: WARNING py.warnings [None req-cb4c093f-0d08-4112-8dde-fba74466cdde admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:32:48.109013 dv-cinder-850015-3-smb devstack@keystone.service[80357]: warnings.warn(msg) Jul 18 02:32:48.109013 dv-cinder-850015-3-smb devstack@keystone.service[80357]: Jul 18 02:32:48.110251 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c093f-0d08-4112-8dde-fba74466cdde admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:32:48.236750 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-cb4c093f-0d08-4112-8dde-fba74466cdde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bf317aedf024073bd0ea7c92c2ffb62', 'request_id': 'req-cb4c093f-0d08-4112-8dde-fba74466cdde'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:32:48.243241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-cb4c093f-0d08-4112-8dde-fba74466cdde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bf317aedf024073bd0ea7c92c2ffb62', 'request_id': 'req-cb4c093f-0d08-4112-8dde-fba74466cdde'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:32:48.256113 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-cb4c093f-0d08-4112-8dde-fba74466cdde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bf317aedf024073bd0ea7c92c2ffb62', 'request_id': 'req-cb4c093f-0d08-4112-8dde-fba74466cdde'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:32:48.359002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-cb4c093f-0d08-4112-8dde-fba74466cdde admin admin] The token cache is being invalidate because project 7bf317aedf024073bd0ea7c92c2ffb62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:32:48.359205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-cb4c093f-0d08-4112-8dde-fba74466cdde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:32:48.359613 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-cb4c093f-0d08-4112-8dde-fba74466cdde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:32:48.361113 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 750/1510] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:32:47 2022] DELETE /identity/v3/projects/7bf317aedf024073bd0ea7c92c2ffb62 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:32:57.525746 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=62 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:32:58.356810 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:37.336445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c262e85-5576-4bc2-8418-f4e52465f25b None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:34:37.337039 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c262e85-5576-4bc2-8418-f4e52465f25b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:34:37.337039 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c262e85-5576-4bc2-8418-f4e52465f25b None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:34:37.338413 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 02:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:34:37.343773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a25a1-3883-4d55-bcf9-f1124939f91e None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:34:37.344223 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a25a1-3883-4d55-bcf9-f1124939f91e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:34:37.344340 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a25a1-3883-4d55-bcf9-f1124939f91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:34:37.423844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-283a25a1-3883-4d55-bcf9-f1124939f91e None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:34:37.424979 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-283a25a1-3883-4d55-bcf9-f1124939f91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:34:37.525153 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 02:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:34:37.679324 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c262e85-5576-4bc2-8418-f4e52465f25b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:34:37.681374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0c262e85-5576-4bc2-8418-f4e52465f25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:34:37.800712 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c262e85-5576-4bc2-8418-f4e52465f25b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:34:37.806490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac664ee-d21a-42f7-8ee0-40b53cb7cb50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:34:37.807138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac664ee-d21a-42f7-8ee0-40b53cb7cb50 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:34:37.807422 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac664ee-d21a-42f7-8ee0-40b53cb7cb50 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:34:37.807740 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac664ee-d21a-42f7-8ee0-40b53cb7cb50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:34:37.815838 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac664ee-d21a-42f7-8ee0-40b53cb7cb50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:34:37.817422 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac664ee-d21a-42f7-8ee0-40b53cb7cb50 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:34:37.827349 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 762/1513] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:34:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:34:38.681649 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bbfd9-ea96-49bd-8580-c40d60752755 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:34:38.682230 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bbfd9-ea96-49bd-8580-c40d60752755 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:34:38.682230 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bbfd9-ea96-49bd-8580-c40d60752755 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:34:38.684281 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 02:34:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:34:38.689205 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66aef9-ee9a-463a-b349-f1713b85cc5d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:34:38.689641 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66aef9-ee9a-463a-b349-f1713b85cc5d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:34:38.689796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d66aef9-ee9a-463a-b349-f1713b85cc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:34:38.708515 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-4d66aef9-ee9a-463a-b349-f1713b85cc5d None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:34:38.709736 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4d66aef9-ee9a-463a-b349-f1713b85cc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:34:38.717570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 02:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:34:38.754740 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5f49d-f798-4e38-b121-d322a24f7997 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:34:38.755032 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5f49d-f798-4e38-b121-d322a24f7997 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:34:38.755314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5f49d-f798-4e38-b121-d322a24f7997 None None] PATH_INFO: `/v3` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:34:38.756721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 753/1516] 10.222.0.75 () {54 vars in 925 bytes} [Mon Jul 18 02:34:38 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:34:38.763417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759ecac-1ba9-46a3-8ef8-a6050da21c82 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:34:38.763711 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759ecac-1ba9-46a3-8ef8-a6050da21c82 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:34:38.764026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759ecac-1ba9-46a3-8ef8-a6050da21c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:34:38.823935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2759ecac-1ba9-46a3-8ef8-a6050da21c82 None None] MFA Rules not processed for user `213ba948a3f34c39bce3f6db093479eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:34:38.825164 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2759ecac-1ba9-46a3-8ef8-a6050da21c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:34:38.878001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:38.887413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5f49d-f798-4e38-b121-d322a24f7997 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:34:38.897971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 764/1517] 10.222.0.75 () {58 vars in 1015 bytes} [Mon Jul 18 02:34:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:34:38.901805 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5f49d-f798-4e38-b121-d322a24f7997 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:34:38.908173 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b1b6c-eb8c-4cb3-8060-b02d05aed9a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:34:38.908835 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b1b6c-eb8c-4cb3-8060-b02d05aed9a6 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:34:38.909164 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b1b6c-eb8c-4cb3-8060-b02d05aed9a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:34:38.909446 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b1b6c-eb8c-4cb3-8060-b02d05aed9a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:34:38.918013 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b1b6c-eb8c-4cb3-8060-b02d05aed9a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:34:38.919602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b1b6c-eb8c-4cb3-8060-b02d05aed9a6 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:34:38.929001 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 754/1518] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:34:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:34:48.181149 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064a581-3922-4ca8-97f6-c55f7e215da9 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:34:48.182134 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064a581-3922-4ca8-97f6-c55f7e215da9 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:34:48.182247 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064a581-3922-4ca8-97f6-c55f7e215da9 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:34:48.183631 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 765/1519] 10.222.0.64 () {54 vars in 961 bytes} [Mon Jul 18 02:34:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:34:48.188831 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13437d-e815-487a-9d9f-d5f797defb79 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:34:48.189269 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13437d-e815-487a-9d9f-d5f797defb79 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:34:48.189386 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13437d-e815-487a-9d9f-d5f797defb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:34:48.207689 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-3a13437d-e815-487a-9d9f-d5f797defb79 None None] MFA Rules not processed for user `213ba948a3f34c39bce3f6db093479eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:34:48.208935 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3a13437d-e815-487a-9d9f-d5f797defb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:34:48.217590 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 755/1520] 10.222.0.64 () {58 vars in 1058 bytes} [Mon Jul 18 02:34:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:34:48.225155 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064a581-3922-4ca8-97f6-c55f7e215da9 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:34:48.239051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064a581-3922-4ca8-97f6-c55f7e215da9 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:34:48.243947 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97eae6-b53e-4d61-8276-6febc3abe348 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '213ba948a3f34c39bce3f6db093479eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:34:48.244656 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97eae6-b53e-4d61-8276-6febc3abe348 service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:34:48.244946 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97eae6-b53e-4d61-8276-6febc3abe348 service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:34:48.245229 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97eae6-b53e-4d61-8276-6febc3abe348 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:34:48.253489 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97eae6-b53e-4d61-8276-6febc3abe348 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:34:48.255138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97eae6-b53e-4d61-8276-6febc3abe348 service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:34:48.265258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 766/1521] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:34:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:34:50.149058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07ad73-9c80-4dd1-9aae-20436e48a0a9 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:34:50.149533 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07ad73-9c80-4dd1-9aae-20436e48a0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:34:50.149639 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a07ad73-9c80-4dd1-9aae-20436e48a0a9 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:34:50.151079 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 02:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:34:50.155823 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dada5-5361-4f9b-bb37-f92ce05bcc9d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:34:50.156255 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dada5-5361-4f9b-bb37-f92ce05bcc9d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:34:50.156371 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15dada5-5361-4f9b-bb37-f92ce05bcc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:34:50.183770 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e15dada5-5361-4f9b-bb37-f92ce05bcc9d None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:34:50.185087 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e15dada5-5361-4f9b-bb37-f92ce05bcc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:34:50.193016 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 02:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:34:50.347453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07ad73-9c80-4dd1-9aae-20436e48a0a9 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:34:50.361819 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a07ad73-9c80-4dd1-9aae-20436e48a0a9 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:34:50.367270 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37311d3c-4a8b-46c6-96ab-e73bd86e4723 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:34:50.367931 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37311d3c-4a8b-46c6-96ab-e73bd86e4723 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:34:50.368212 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37311d3c-4a8b-46c6-96ab-e73bd86e4723 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:34:50.378471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37311d3c-4a8b-46c6-96ab-e73bd86e4723 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:34:50.378471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37311d3c-4a8b-46c6-96ab-e73bd86e4723 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:34:50.378783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37311d3c-4a8b-46c6-96ab-e73bd86e4723 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:34:50.388662 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 757/1524] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:34:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:34:51.204288 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a10b2-2a72-4f96-afee-ba61d1760d5c None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:34:51.204823 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a10b2-2a72-4f96-afee-ba61d1760d5c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:34:51.204823 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a10b2-2a72-4f96-afee-ba61d1760d5c None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:34:51.206251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 02:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:34:51.211402 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d91c8-ba21-4b2e-8990-798dd697550c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:34:51.211870 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d91c8-ba21-4b2e-8990-798dd697550c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:34:51.211971 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421d91c8-ba21-4b2e-8990-798dd697550c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:34:51.233794 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-421d91c8-ba21-4b2e-8990-798dd697550c None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:34:51.235035 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-421d91c8-ba21-4b2e-8990-798dd697550c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:34:51.243521 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 02:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:34:51.397358 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a10b2-2a72-4f96-afee-ba61d1760d5c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:34:51.412387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a10b2-2a72-4f96-afee-ba61d1760d5c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:34:51.418293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1086f34-bedb-4b06-9347-3779fdea62a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:34:51.419002 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1086f34-bedb-4b06-9347-3779fdea62a1 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:34:51.419291 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1086f34-bedb-4b06-9347-3779fdea62a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:34:51.419573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1086f34-bedb-4b06-9347-3779fdea62a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:34:51.428712 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1086f34-bedb-4b06-9347-3779fdea62a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:34:51.430353 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1086f34-bedb-4b06-9347-3779fdea62a1 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:34:51.440162 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 769/1527] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:34:55.566033 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0fd47-ae35-485c-a3af-4d562468eb57 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:34:55.566690 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0fd47-ae35-485c-a3af-4d562468eb57 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:34:55.566690 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0fd47-ae35-485c-a3af-4d562468eb57 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:34:55.567970 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 02:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 02:34:55.573496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686a91f-4aaa-49c2-a50a-0d83d0c89635 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:34:55.573949 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686a91f-4aaa-49c2-a50a-0d83d0c89635 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:34:55.574100 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686a91f-4aaa-49c2-a50a-0d83d0c89635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:34:55.593237 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8686a91f-4aaa-49c2-a50a-0d83d0c89635 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:34:55.594485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8686a91f-4aaa-49c2-a50a-0d83d0c89635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:34:55.602383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 02:34:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:34:55.641186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0fd47-ae35-485c-a3af-4d562468eb57 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:34:55.642935 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-54e0fd47-ae35-485c-a3af-4d562468eb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:34:55.676482 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:34:55.721123 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0fd47-ae35-485c-a3af-4d562468eb57 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:34:55.724847 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd432f6-e749-490e-b5fd-0eeec5624eb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:34:55.725508 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd432f6-e749-490e-b5fd-0eeec5624eb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:34:55.725981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd432f6-e749-490e-b5fd-0eeec5624eb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:34:55.726603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd432f6-e749-490e-b5fd-0eeec5624eb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:34:55.736146 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd432f6-e749-490e-b5fd-0eeec5624eb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:34:55.737578 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd432f6-e749-490e-b5fd-0eeec5624eb5 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:34:55.747601 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 760/1530] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:34:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:34:57.755113 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cf52d-0b59-4ece-9f6e-a2e04876297d None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:34:57.755677 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cf52d-0b59-4ece-9f6e-a2e04876297d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:34:57.755677 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cf52d-0b59-4ece-9f6e-a2e04876297d None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:34:57.757083 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 02:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:34:57.762867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba887a-a771-47fb-ac7e-6d4660ae947a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:34:57.763305 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba887a-a771-47fb-ac7e-6d4660ae947a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:34:57.763431 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba887a-a771-47fb-ac7e-6d4660ae947a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:34:57.781484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-4cba887a-a771-47fb-ac7e-6d4660ae947a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:34:57.782737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4cba887a-a771-47fb-ac7e-6d4660ae947a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:34:57.790630 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 02:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:34:57.826305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cf52d-0b59-4ece-9f6e-a2e04876297d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:34:57.837501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cf52d-0b59-4ece-9f6e-a2e04876297d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:34:57.841227 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e1173-74c0-4c90-adce-d027276786e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:34:57.841910 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e1173-74c0-4c90-adce-d027276786e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:34:57.842202 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e1173-74c0-4c90-adce-d027276786e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:34:57.842482 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e1173-74c0-4c90-adce-d027276786e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:34:57.851548 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e1173-74c0-4c90-adce-d027276786e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:34:57.853577 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e1173-74c0-4c90-adce-d027276786e3 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:34:57.863046 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 772/1533] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:34:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:35:01.457967 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff64fa-6959-40e6-93e4-2430f170d4e1 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:35:01.458495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff64fa-6959-40e6-93e4-2430f170d4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:35:01.458495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff64fa-6959-40e6-93e4-2430f170d4e1 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:35:01.459820 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 02:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:35:01.467411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd234b8b-cc01-47c3-b4a8-03f0f3616633 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:35:01.467867 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd234b8b-cc01-47c3-b4a8-03f0f3616633 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:35:01.467986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd234b8b-cc01-47c3-b4a8-03f0f3616633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:35:01.486681 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-cd234b8b-cc01-47c3-b4a8-03f0f3616633 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:35:01.487895 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cd234b8b-cc01-47c3-b4a8-03f0f3616633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:35:01.496288 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 02:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:35:01.802512 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff64fa-6959-40e6-93e4-2430f170d4e1 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:35:01.804181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-28ff64fa-6959-40e6-93e4-2430f170d4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:35:01.879267 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff64fa-6959-40e6-93e4-2430f170d4e1 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:35:01.882785 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2fb63-5a1f-4417-8316-c0c28d101ac6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:35:01.883918 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2fb63-5a1f-4417-8316-c0c28d101ac6 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:35:01.884198 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2fb63-5a1f-4417-8316-c0c28d101ac6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:35:01.884470 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2fb63-5a1f-4417-8316-c0c28d101ac6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:35:01.893369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2fb63-5a1f-4417-8316-c0c28d101ac6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:35:01.894826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2fb63-5a1f-4417-8316-c0c28d101ac6 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:35:01.904482 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 763/1536] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:35:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:35:03.940142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e3a3d-d2c6-4229-a06c-69eb6bd2b6df None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:35:03.940698 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e3a3d-d2c6-4229-a06c-69eb6bd2b6df None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:35:03.940698 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e3a3d-d2c6-4229-a06c-69eb6bd2b6df None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:35:03.942128 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 02:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:35:03.947863 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99b85d-40de-4082-918a-237e78009410 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:35:03.948299 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99b85d-40de-4082-918a-237e78009410 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:35:03.948404 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc99b85d-40de-4082-918a-237e78009410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:35:03.966257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-dc99b85d-40de-4082-918a-237e78009410 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:35:03.967452 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-dc99b85d-40de-4082-918a-237e78009410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:35:03.975234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 02:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:35:04.275688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e3a3d-d2c6-4229-a06c-69eb6bd2b6df None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:35:04.277377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b80e3a3d-d2c6-4229-a06c-69eb6bd2b6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:35:04.291086 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e3a3d-d2c6-4229-a06c-69eb6bd2b6df None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:35:04.294649 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd4adf-ad2a-49f8-9383-dbc9ab11f1b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:35:04.295286 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd4adf-ad2a-49f8-9383-dbc9ab11f1b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:35:04.295574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd4adf-ad2a-49f8-9383-dbc9ab11f1b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:35:04.295852 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd4adf-ad2a-49f8-9383-dbc9ab11f1b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:35:04.304745 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd4adf-ad2a-49f8-9383-dbc9ab11f1b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:35:04.306767 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd4adf-ad2a-49f8-9383-dbc9ab11f1b2 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:35:04.316119 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 775/1539] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:35:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:35:13.961491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=63 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:35:14.311968 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=37 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:38.551934 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be46e9c-b7a3-47b8-871b-8270ca7e374c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:38.552578 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be46e9c-b7a3-47b8-871b-8270ca7e374c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:38.552578 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be46e9c-b7a3-47b8-871b-8270ca7e374c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:38.575767 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0be46e9c-b7a3-47b8-871b-8270ca7e374c None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:38.577802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0be46e9c-b7a3-47b8-871b-8270ca7e374c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:38.593973 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 765/1540] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:38.603534 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88be4e-0fca-474e-88e6-f4142f40baa5 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:38.604838 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88be4e-0fca-474e-88e6-f4142f40baa5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:38.605349 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88be4e-0fca-474e-88e6-f4142f40baa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:38.634320 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6f88be4e-0fca-474e-88e6-f4142f40baa5 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:38.635596 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6f88be4e-0fca-474e-88e6-f4142f40baa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:38.650054 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 776/1541] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:38.654987 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be46e9c-b7a3-47b8-871b-8270ca7e374c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:38.671245 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be46e9c-b7a3-47b8-871b-8270ca7e374c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:38.679993 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902d466-3595-45c7-9dd0-bd083d07ba2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:38.680678 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902d466-3595-45c7-9dd0-bd083d07ba2c admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:38.681663 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902d466-3595-45c7-9dd0-bd083d07ba2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:38.681663 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902d466-3595-45c7-9dd0-bd083d07ba2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:38.682004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902d466-3595-45c7-9dd0-bd083d07ba2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:36:38.682318 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902d466-3595-45c7-9dd0-bd083d07ba2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:38.683937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3902d466-3595-45c7-9dd0-bd083d07ba2c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:38.699102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 766/1542] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:36:38.707560 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88be4e-0fca-474e-88e6-f4142f40baa5 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:38.717506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88be4e-0fca-474e-88e6-f4142f40baa5 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:38.724684 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7841b-4db1-4590-882a-4883b5f83ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:38.725366 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7841b-4db1-4590-882a-4883b5f83ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:38.725658 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7841b-4db1-4590-882a-4883b5f83ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:38.725976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7841b-4db1-4590-882a-4883b5f83ca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:38.726688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7841b-4db1-4590-882a-4883b5f83ca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:38.728617 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e7841b-4db1-4590-882a-4883b5f83ca8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:38.839915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a4e5c-35b4-4c78-9746-2409fbebc681 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:38.840113 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a4e5c-35b4-4c78-9746-2409fbebc681 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:38.840370 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a4e5c-35b4-4c78-9746-2409fbebc681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:38.848017 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 777/1543] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:36:38 2022] POST /identity/v3/projects => generated 405 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:36:38.854102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7841b-4db1-4590-882a-4883b5f83ca8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:38.869596 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-1c4a4e5c-35b4-4c78-9746-2409fbebc681 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:38.871096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1c4a4e5c-35b4-4c78-9746-2409fbebc681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:38.960128 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 767/1544] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:36:38.961622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170658e-b148-4d65-ab3c-6f1cd0b3d206 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:38.961940 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170658e-b148-4d65-ab3c-6f1cd0b3d206 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:38.962567 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170658e-b148-4d65-ab3c-6f1cd0b3d206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:38.996090 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b170658e-b148-4d65-ab3c-6f1cd0b3d206 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:38.997360 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b170658e-b148-4d65-ab3c-6f1cd0b3d206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:39.005457 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7841b-4db1-4590-882a-4883b5f83ca8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:39.012249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 768/1545] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:39.013783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c49e8-e874-4a2a-be11-5a9ede13c499 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.014078 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c49e8-e874-4a2a-be11-5a9ede13c499 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.014356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c49e8-e874-4a2a-be11-5a9ede13c499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.015908 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f338088-85cd-44a3-bc43-6e11849bd37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:39.016602 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f338088-85cd-44a3-bc43-6e11849bd37d admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.016886 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f338088-85cd-44a3-bc43-6e11849bd37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.017169 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f338088-85cd-44a3-bc43-6e11849bd37d admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.017900 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f338088-85cd-44a3-bc43-6e11849bd37d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:39.018928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: WARNING py.warnings [None req-7f338088-85cd-44a3-bc43-6e11849bd37d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:36:39.018928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: warnings.warn(msg) Jul 18 02:36:39.018928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: Jul 18 02:36:39.025064 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f338088-85cd-44a3-bc43-6e11849bd37d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:39.051686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-392c49e8-e874-4a2a-be11-5a9ede13c499 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:39.054830 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-392c49e8-e874-4a2a-be11-5a9ede13c499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:39.062410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 769/1546] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:39.063745 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740eea7-a084-4249-a9fc-a50fb5f67576 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.064040 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740eea7-a084-4249-a9fc-a50fb5f67576 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.064322 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740eea7-a084-4249-a9fc-a50fb5f67576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.082143 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0740eea7-a084-4249-a9fc-a50fb5f67576 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:39.086121 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0740eea7-a084-4249-a9fc-a50fb5f67576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:39.091456 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 770/1547] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:39.092659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f49161-b5d6-440b-bd59-951594846c8b None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.092949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f49161-b5d6-440b-bd59-951594846c8b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.093230 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f49161-b5d6-440b-bd59-951594846c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.112125 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c4f49161-b5d6-440b-bd59-951594846c8b None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:39.113355 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c4f49161-b5d6-440b-bd59-951594846c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:39.121183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 771/1548] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:39.122412 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5f5a6-6483-476a-96ca-63f670cc5485 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.122703 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5f5a6-6483-476a-96ca-63f670cc5485 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.122986 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5f5a6-6483-476a-96ca-63f670cc5485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.145082 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-d5f5f5a6-6483-476a-96ca-63f670cc5485 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:39.148274 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d5f5f5a6-6483-476a-96ca-63f670cc5485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:39.158736 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 778/1549] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:36:38 2022] POST /identity/v3/users => generated 303 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:36:39.158736 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe552ad-a477-49da-b7d5-2029fac30126 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.158736 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe552ad-a477-49da-b7d5-2029fac30126 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.158736 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe552ad-a477-49da-b7d5-2029fac30126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.161573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 772/1550] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:39.163004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613caef-0bac-4f88-b640-3007de485ecf None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.169626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613caef-0bac-4f88-b640-3007de485ecf None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.169626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613caef-0bac-4f88-b640-3007de485ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.184072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-9fe552ad-a477-49da-b7d5-2029fac30126 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:39.185294 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9fe552ad-a477-49da-b7d5-2029fac30126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:39.188273 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-5613caef-0bac-4f88-b640-3007de485ecf None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:39.189443 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5613caef-0bac-4f88-b640-3007de485ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:39.194140 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 779/1551] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:39.194929 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe552ad-a477-49da-b7d5-2029fac30126 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:39.203746 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 773/1552] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:39.204530 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe552ad-a477-49da-b7d5-2029fac30126 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:39.204999 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487ddc7-2b70-4990-8d8a-65835d36c024 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.205289 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487ddc7-2b70-4990-8d8a-65835d36c024 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.205568 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3487ddc7-2b70-4990-8d8a-65835d36c024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.209284 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fd6c7-b829-4214-8882-5fb46b73b566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:39.209983 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fd6c7-b829-4214-8882-5fb46b73b566 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.210266 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fd6c7-b829-4214-8882-5fb46b73b566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.210553 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522fd6c7-b829-4214-8882-5fb46b73b566 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.211435 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fd6c7-b829-4214-8882-5fb46b73b566 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:36:39.211754 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fd6c7-b829-4214-8882-5fb46b73b566 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:39.212817 dv-cinder-850015-3-smb devstack@keystone.service[80358]: WARNING py.warnings [None req-522fd6c7-b829-4214-8882-5fb46b73b566 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:36:39.212817 dv-cinder-850015-3-smb devstack@keystone.service[80358]: warnings.warn(msg) Jul 18 02:36:39.212817 dv-cinder-850015-3-smb devstack@keystone.service[80358]: Jul 18 02:36:39.213733 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522fd6c7-b829-4214-8882-5fb46b73b566 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:39.224368 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-3487ddc7-2b70-4990-8d8a-65835d36c024 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:39.225571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3487ddc7-2b70-4990-8d8a-65835d36c024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:39.226056 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 780/1553] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:36:39.226863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fd6c7-b829-4214-8882-5fb46b73b566 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:39.234369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 774/1554] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:39.235158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487ddc7-2b70-4990-8d8a-65835d36c024 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:39.237465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522fd6c7-b829-4214-8882-5fb46b73b566 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:39.242465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeae3e7-cbe6-40de-bf53-cb5f6258a1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:39.243176 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeae3e7-cbe6-40de-bf53-cb5f6258a1c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.243468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeae3e7-cbe6-40de-bf53-cb5f6258a1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.243782 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeae3e7-cbe6-40de-bf53-cb5f6258a1c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.244566 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeae3e7-cbe6-40de-bf53-cb5f6258a1c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:36:39.244760 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3487ddc7-2b70-4990-8d8a-65835d36c024 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:39.244906 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeae3e7-cbe6-40de-bf53-cb5f6258a1c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:39.246624 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeae3e7-cbe6-40de-bf53-cb5f6258a1c8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:39.249374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305d731-cd15-440d-858f-22693dd944c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:39.250047 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305d731-cd15-440d-858f-22693dd944c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.250335 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305d731-cd15-440d-858f-22693dd944c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.250614 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305d731-cd15-440d-858f-22693dd944c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.251367 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305d731-cd15-440d-858f-22693dd944c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:39.252956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305d731-cd15-440d-858f-22693dd944c5 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:39.259434 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 781/1555] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:36:39.260778 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bee714-d398-48fd-8e78-7a41ec7c4be4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.261063 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bee714-d398-48fd-8e78-7a41ec7c4be4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.261347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bee714-d398-48fd-8e78-7a41ec7c4be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.263170 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 775/1556] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:39.264490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c30e84-4256-43a1-8d7d-6b78755e59dc None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.264788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c30e84-4256-43a1-8d7d-6b78755e59dc None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.265067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c30e84-4256-43a1-8d7d-6b78755e59dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.283581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-07bee714-d398-48fd-8e78-7a41ec7c4be4 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:39.283780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-76c30e84-4256-43a1-8d7d-6b78755e59dc None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:39.284774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-76c30e84-4256-43a1-8d7d-6b78755e59dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:39.284877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-07bee714-d398-48fd-8e78-7a41ec7c4be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:39.292651 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 776/1557] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:39.292801 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 782/1558] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:39.297314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516d48f-ae68-4740-a7e2-6b22e7c18130 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.297473 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b91b9c-3cfb-4358-a4eb-3dec71a178f2 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.297562 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516d48f-ae68-4740-a7e2-6b22e7c18130 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.297664 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b91b9c-3cfb-4358-a4eb-3dec71a178f2 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.297795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516d48f-ae68-4740-a7e2-6b22e7c18130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.297905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b91b9c-3cfb-4358-a4eb-3dec71a178f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.314080 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c6b91b9c-3cfb-4358-a4eb-3dec71a178f2 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:39.315295 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c6b91b9c-3cfb-4358-a4eb-3dec71a178f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:39.315434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-6516d48f-ae68-4740-a7e2-6b22e7c18130 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:39.316624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6516d48f-ae68-4740-a7e2-6b22e7c18130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:39.323375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 783/1559] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:39.323887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b91b9c-3cfb-4358-a4eb-3dec71a178f2 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:39.328093 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 777/1560] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:39.328093 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516d48f-ae68-4740-a7e2-6b22e7c18130 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:39.333502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b91b9c-3cfb-4358-a4eb-3dec71a178f2 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:39.337444 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516d48f-ae68-4740-a7e2-6b22e7c18130 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:39.338189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e7e44-bb6f-40f4-b337-6f8bd5a09ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:39.338866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e7e44-bb6f-40f4-b337-6f8bd5a09ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.339158 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e7e44-bb6f-40f4-b337-6f8bd5a09ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.339437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e7e44-bb6f-40f4-b337-6f8bd5a09ec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.340122 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e7e44-bb6f-40f4-b337-6f8bd5a09ec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:39.342109 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e7e44-bb6f-40f4-b337-6f8bd5a09ec8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:39.342249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304eb578-75cd-4cec-a4cb-e4cb0fb3e179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:39.343453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304eb578-75cd-4cec-a4cb-e4cb0fb3e179 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.343748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304eb578-75cd-4cec-a4cb-e4cb0fb3e179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.344031 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304eb578-75cd-4cec-a4cb-e4cb0fb3e179 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.344753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304eb578-75cd-4cec-a4cb-e4cb0fb3e179 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:36:39.345062 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304eb578-75cd-4cec-a4cb-e4cb0fb3e179 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:39.347219 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304eb578-75cd-4cec-a4cb-e4cb0fb3e179 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:39.367608 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 778/1561] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:36:39.367608 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304eb578-75cd-4cec-a4cb-e4cb0fb3e179 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:39.371339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304eb578-75cd-4cec-a4cb-e4cb0fb3e179 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:39.376298 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee2d26-41ee-4716-87d8-c049b51f2772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:39.376964 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee2d26-41ee-4716-87d8-c049b51f2772 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.377251 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee2d26-41ee-4716-87d8-c049b51f2772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.377525 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ee2d26-41ee-4716-87d8-c049b51f2772 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.378291 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee2d26-41ee-4716-87d8-c049b51f2772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:39.379917 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ee2d26-41ee-4716-87d8-c049b51f2772 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:39.391532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 779/1562] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:39.392542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee2d26-41ee-4716-87d8-c049b51f2772 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:39.402598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ee2d26-41ee-4716-87d8-c049b51f2772 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:39.407752 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fec69-06b8-4ff4-a461-6f8d84c166b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:39.408376 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fec69-06b8-4ff4-a461-6f8d84c166b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.408659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fec69-06b8-4ff4-a461-6f8d84c166b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.409229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fec69-06b8-4ff4-a461-6f8d84c166b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.409879 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497fec69-06b8-4ff4-a461-6f8d84c166b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:39.410898 dv-cinder-850015-3-smb devstack@keystone.service[80357]: WARNING py.warnings [None req-497fec69-06b8-4ff4-a461-6f8d84c166b3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:36:39.410898 dv-cinder-850015-3-smb devstack@keystone.service[80357]: warnings.warn(msg) Jul 18 02:36:39.410898 dv-cinder-850015-3-smb devstack@keystone.service[80357]: Jul 18 02:36:39.412092 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497fec69-06b8-4ff4-a461-6f8d84c166b3 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:39.463457 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 784/1563] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:36:39 2022] POST /identity/v3/projects => generated 367 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:36:39.464285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e7e44-bb6f-40f4-b337-6f8bd5a09ec8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:39.509762 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:39.518480 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 780/1564] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:36:39 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:36:39.518480 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886e61f-aad1-4306-8a20-64621643da44 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.518480 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886e61f-aad1-4306-8a20-64621643da44 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.518480 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886e61f-aad1-4306-8a20-64621643da44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.530006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e7e44-bb6f-40f4-b337-6f8bd5a09ec8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:39.536681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-4886e61f-aad1-4306-8a20-64621643da44 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:39.537923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4886e61f-aad1-4306-8a20-64621643da44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:39.557408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:39.588822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa1c64-771d-4eb7-882e-93519d7f5a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:39.589498 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa1c64-771d-4eb7-882e-93519d7f5a98 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.589817 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa1c64-771d-4eb7-882e-93519d7f5a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.590102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa1c64-771d-4eb7-882e-93519d7f5a98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.590876 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa1c64-771d-4eb7-882e-93519d7f5a98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:36:39.591191 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa1c64-771d-4eb7-882e-93519d7f5a98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:39.593508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa1c64-771d-4eb7-882e-93519d7f5a98 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:39.597994 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 781/1565] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:39.598952 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886e61f-aad1-4306-8a20-64621643da44 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:39.606078 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 785/1566] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:36:39.606784 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa1c64-771d-4eb7-882e-93519d7f5a98 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:39.608061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886e61f-aad1-4306-8a20-64621643da44 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:39.613318 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c315f-fabb-452e-a074-bd8004da5b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:39.614018 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c315f-fabb-452e-a074-bd8004da5b0d admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.614307 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c315f-fabb-452e-a074-bd8004da5b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.614585 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c315f-fabb-452e-a074-bd8004da5b0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.615312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c315f-fabb-452e-a074-bd8004da5b0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:36:39.615619 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c315f-fabb-452e-a074-bd8004da5b0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:39.617155 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa1c64-771d-4eb7-882e-93519d7f5a98 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:39.617277 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c315f-fabb-452e-a074-bd8004da5b0d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:39.623099 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978ae75-7496-4ecc-83ef-2f0fb7b86c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:39.623810 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978ae75-7496-4ecc-83ef-2f0fb7b86c5e admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.624269 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978ae75-7496-4ecc-83ef-2f0fb7b86c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.624558 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978ae75-7496-4ecc-83ef-2f0fb7b86c5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.625389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978ae75-7496-4ecc-83ef-2f0fb7b86c5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:36:39.625713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978ae75-7496-4ecc-83ef-2f0fb7b86c5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:39.627299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978ae75-7496-4ecc-83ef-2f0fb7b86c5e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:39.629758 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 782/1567] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:36:39.630542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c315f-fabb-452e-a074-bd8004da5b0d admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:39.643002 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 786/1568] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:36:39.643002 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978ae75-7496-4ecc-83ef-2f0fb7b86c5e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:39.645926 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c315f-fabb-452e-a074-bd8004da5b0d admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:39.650759 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18debb4a-1e4e-441e-b82f-c0c3c8e66567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:39.651683 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18debb4a-1e4e-441e-b82f-c0c3c8e66567 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.651967 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18debb4a-1e4e-441e-b82f-c0c3c8e66567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.652237 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18debb4a-1e4e-441e-b82f-c0c3c8e66567 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.653012 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18debb4a-1e4e-441e-b82f-c0c3c8e66567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:39.653125 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978ae75-7496-4ecc-83ef-2f0fb7b86c5e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:39.654929 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18debb4a-1e4e-441e-b82f-c0c3c8e66567 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:39.658302 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ebf63-639f-4a04-a436-d8a0d5b8cf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:39.659181 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ebf63-639f-4a04-a436-d8a0d5b8cf23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.659467 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ebf63-639f-4a04-a436-d8a0d5b8cf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.659743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ebf63-639f-4a04-a436-d8a0d5b8cf23 admin admin] PATH_INFO: `/v3/projects/f99a48508c754186a7d89e782e1d9ac0/users/de75c674bfd2422eac230f228c093cac/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.675404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ebf63-639f-4a04-a436-d8a0d5b8cf23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f99a48508c754186a7d89e782e1d9ac0, user_id=de75c674bfd2422eac230f228c093cac, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:39.678701 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ebf63-639f-4a04-a436-d8a0d5b8cf23 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:39.831191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 783/1569] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:36:39 2022] POST /identity/v3/projects => generated 405 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:36:39.832007 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18debb4a-1e4e-441e-b82f-c0c3c8e66567 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:39.872435 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 787/1570] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:36:39 2022] PUT /identity/v3/projects/f99a48508c754186a7d89e782e1d9ac0/users/de75c674bfd2422eac230f228c093cac/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:39.873276 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ebf63-639f-4a04-a436-d8a0d5b8cf23 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:39.894987 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18debb4a-1e4e-441e-b82f-c0c3c8e66567 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:39.942270 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ebf63-639f-4a04-a436-d8a0d5b8cf23 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:39.947407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c02e2-9895-4e03-ad26-dc3a5c098740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:39.948181 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c02e2-9895-4e03-ad26-dc3a5c098740 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.948545 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c02e2-9895-4e03-ad26-dc3a5c098740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.948826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c02e2-9895-4e03-ad26-dc3a5c098740 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.949544 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c02e2-9895-4e03-ad26-dc3a5c098740 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:39.951584 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c02e2-9895-4e03-ad26-dc3a5c098740 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:39.957297 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55df9f9-3d2a-4147-9c45-424d53a43e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:39.958018 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55df9f9-3d2a-4147-9c45-424d53a43e6f admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:39.958305 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55df9f9-3d2a-4147-9c45-424d53a43e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:39.958586 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55df9f9-3d2a-4147-9c45-424d53a43e6f admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:39.959279 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55df9f9-3d2a-4147-9c45-424d53a43e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:39.961188 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55df9f9-3d2a-4147-9c45-424d53a43e6f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:40.098561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 788/1571] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:36:39 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:36:40.098561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c02e2-9895-4e03-ad26-dc3a5c098740 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:40.105929 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c02e2-9895-4e03-ad26-dc3a5c098740 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:40.111507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7c1db-3cea-42ae-b028-48b15e5a79c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:40.112298 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7c1db-3cea-42ae-b028-48b15e5a79c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:40.112690 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7c1db-3cea-42ae-b028-48b15e5a79c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:40.112993 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc7c1db-3cea-42ae-b028-48b15e5a79c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:40.113726 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7c1db-3cea-42ae-b028-48b15e5a79c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:36:40.117287 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7c1db-3cea-42ae-b028-48b15e5a79c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:40.117287 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc7c1db-3cea-42ae-b028-48b15e5a79c6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:40.142489 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 784/1572] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:36:39 2022] POST /identity/v3/users => generated 284 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:36:40.143305 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55df9f9-3d2a-4147-9c45-424d53a43e6f admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:40.153655 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55df9f9-3d2a-4147-9c45-424d53a43e6f admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:40.158925 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42add0da-cee9-4675-abb1-71ccfe6ebffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:40.159600 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add0da-cee9-4675-abb1-71ccfe6ebffb admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:40.163236 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add0da-cee9-4675-abb1-71ccfe6ebffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:40.163236 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42add0da-cee9-4675-abb1-71ccfe6ebffb admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:40.163236 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42add0da-cee9-4675-abb1-71ccfe6ebffb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:40.163236 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42add0da-cee9-4675-abb1-71ccfe6ebffb admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:40.183333 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 789/1573] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:36:40.184167 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7c1db-3cea-42ae-b028-48b15e5a79c6 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:40.194115 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc7c1db-3cea-42ae-b028-48b15e5a79c6 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:40.198697 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936be41-f2eb-4018-af06-b561232b61a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:40.199326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936be41-f2eb-4018-af06-b561232b61a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:40.199620 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936be41-f2eb-4018-af06-b561232b61a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:40.199916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9936be41-f2eb-4018-af06-b561232b61a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:40.200581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936be41-f2eb-4018-af06-b561232b61a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:40.202513 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9936be41-f2eb-4018-af06-b561232b61a0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:40.422245 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 790/1574] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:36:40 2022] POST /identity/v3/projects => generated 383 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:36:40.422245 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936be41-f2eb-4018-af06-b561232b61a0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:40.424543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:40.491813 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9936be41-f2eb-4018-af06-b561232b61a0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:40.496440 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26628bdf-2986-48c6-b0b6-8c274a604f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:40.497134 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26628bdf-2986-48c6-b0b6-8c274a604f60 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:40.497422 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26628bdf-2986-48c6-b0b6-8c274a604f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:40.497724 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26628bdf-2986-48c6-b0b6-8c274a604f60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:40.498421 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26628bdf-2986-48c6-b0b6-8c274a604f60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:40.500916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26628bdf-2986-48c6-b0b6-8c274a604f60 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:40.518727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 785/1575] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:36:40 2022] POST /identity/v3/projects => generated 385 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:36:40.519798 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42add0da-cee9-4675-abb1-71ccfe6ebffb admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:40.524871 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:40.579819 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42add0da-cee9-4675-abb1-71ccfe6ebffb admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:40.584392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583827e-398b-4440-91e6-209227997da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:40.585341 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583827e-398b-4440-91e6-209227997da2 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:40.585626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583827e-398b-4440-91e6-209227997da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:40.585940 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583827e-398b-4440-91e6-209227997da2 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:40.586628 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583827e-398b-4440-91e6-209227997da2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:40.588548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2583827e-398b-4440-91e6-209227997da2 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:40.680310 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 791/1576] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:36:40 2022] POST /identity/v3/projects => generated 373 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:36:40.681633 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425606d8-6d31-4ba1-8923-c8c04a7c3177 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:40.682032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425606d8-6d31-4ba1-8923-c8c04a7c3177 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:40.682320 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425606d8-6d31-4ba1-8923-c8c04a7c3177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:40.711445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-425606d8-6d31-4ba1-8923-c8c04a7c3177 None None] MFA Rules not processed for user `de75c674bfd2422eac230f228c093cac`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:40.712676 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-425606d8-6d31-4ba1-8923-c8c04a7c3177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:40.746063 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 786/1577] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:36:40 2022] POST /identity/v3/users => generated 303 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:36:40.754725 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583827e-398b-4440-91e6-209227997da2 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:40.757173 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583827e-398b-4440-91e6-209227997da2 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:40.777358 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 792/1578] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:40 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:40.778361 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425606d8-6d31-4ba1-8923-c8c04a7c3177 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:40.818247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298c40a-1ed4-425f-93ff-5083d2528c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:40.818929 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298c40a-1ed4-425f-93ff-5083d2528c3f admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:40.819218 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298c40a-1ed4-425f-93ff-5083d2528c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:40.819507 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1298c40a-1ed4-425f-93ff-5083d2528c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:40.820233 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298c40a-1ed4-425f-93ff-5083d2528c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:40.821877 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1298c40a-1ed4-425f-93ff-5083d2528c3f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:40.832751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 787/1579] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:40.833581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298c40a-1ed4-425f-93ff-5083d2528c3f admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:40.843294 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1298c40a-1ed4-425f-93ff-5083d2528c3f admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:40.844895 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425606d8-6d31-4ba1-8923-c8c04a7c3177 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:40.847812 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047da555-71cd-4fbf-98e7-0fa139f0c42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:40.848442 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047da555-71cd-4fbf-98e7-0fa139f0c42c admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:40.848730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047da555-71cd-4fbf-98e7-0fa139f0c42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:40.849008 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047da555-71cd-4fbf-98e7-0fa139f0c42c admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:40.849486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccb27b-ba3f-4dc0-9be3-a3ddcfb86a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:40.849687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047da555-71cd-4fbf-98e7-0fa139f0c42c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:40.850192 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccb27b-ba3f-4dc0-9be3-a3ddcfb86a1e admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:40.850482 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccb27b-ba3f-4dc0-9be3-a3ddcfb86a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:40.850765 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccb27b-ba3f-4dc0-9be3-a3ddcfb86a1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:40.851492 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccb27b-ba3f-4dc0-9be3-a3ddcfb86a1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:40.851721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047da555-71cd-4fbf-98e7-0fa139f0c42c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:40.853107 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccb27b-ba3f-4dc0-9be3-a3ddcfb86a1e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:40.864213 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 793/1580] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:40.869128 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccb27b-ba3f-4dc0-9be3-a3ddcfb86a1e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:40.875602 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccb27b-ba3f-4dc0-9be3-a3ddcfb86a1e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:40.880164 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfacb6-f2fe-415f-aae6-368bf6efae62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:40.880803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfacb6-f2fe-415f-aae6-368bf6efae62 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:40.881091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfacb6-f2fe-415f-aae6-368bf6efae62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:40.881370 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfacb6-f2fe-415f-aae6-368bf6efae62 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:40.882097 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfacb6-f2fe-415f-aae6-368bf6efae62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:40.884002 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfacb6-f2fe-415f-aae6-368bf6efae62 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:41.018335 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 788/1581] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:36:40 2022] POST /identity/v3/projects => generated 393 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:36:41.019158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047da555-71cd-4fbf-98e7-0fa139f0c42c admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:41.034001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:41.039953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 794/1582] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:36:40 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:36:41.040739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfacb6-f2fe-415f-aae6-368bf6efae62 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:41.051605 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfacb6-f2fe-415f-aae6-368bf6efae62 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:41.093422 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047da555-71cd-4fbf-98e7-0fa139f0c42c admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:41.100147 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43497f0-3960-4c1c-9dea-823af37beafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:41.100817 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43497f0-3960-4c1c-9dea-823af37beafc admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:41.101115 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43497f0-3960-4c1c-9dea-823af37beafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:41.102536 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43497f0-3960-4c1c-9dea-823af37beafc admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:41.103244 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43497f0-3960-4c1c-9dea-823af37beafc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:41.105217 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43497f0-3960-4c1c-9dea-823af37beafc admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:41.111729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946cc39-e9c6-4735-9e7b-7cd55b7e8e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:41.112448 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946cc39-e9c6-4735-9e7b-7cd55b7e8e6d admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:41.112760 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946cc39-e9c6-4735-9e7b-7cd55b7e8e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:41.113040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946cc39-e9c6-4735-9e7b-7cd55b7e8e6d admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:41.113767 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946cc39-e9c6-4735-9e7b-7cd55b7e8e6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:41.115789 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4946cc39-e9c6-4735-9e7b-7cd55b7e8e6d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:41.262659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:41.272516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 789/1584] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:36:41 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:36:41.272675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 795/1584] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:36:41 2022] POST /identity/v3/users => generated 287 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:36:41.272675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946cc39-e9c6-4735-9e7b-7cd55b7e8e6d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:41.273849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43497f0-3960-4c1c-9dea-823af37beafc admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:41.280903 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4946cc39-e9c6-4735-9e7b-7cd55b7e8e6d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:41.284378 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43497f0-3960-4c1c-9dea-823af37beafc admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:41.285669 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd7cae-e74b-4c2d-9709-706d332552b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:41.286430 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd7cae-e74b-4c2d-9709-706d332552b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:41.286817 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd7cae-e74b-4c2d-9709-706d332552b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:41.287102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd7cae-e74b-4c2d-9709-706d332552b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:41.287826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd7cae-e74b-4c2d-9709-706d332552b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:41.289341 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda9a24-6957-4276-8974-138431278b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:41.289496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd7cae-e74b-4c2d-9709-706d332552b2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:41.290120 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda9a24-6957-4276-8974-138431278b28 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:41.294085 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda9a24-6957-4276-8974-138431278b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:41.294085 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cda9a24-6957-4276-8974-138431278b28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:41.294085 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda9a24-6957-4276-8974-138431278b28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:41.294085 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cda9a24-6957-4276-8974-138431278b28 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:41.299607 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 796/1585] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:41.300707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd7cae-e74b-4c2d-9709-706d332552b2 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:41.310306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd7cae-e74b-4c2d-9709-706d332552b2 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:41.314996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136678e-2434-4045-af58-4c28addd58b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:41.315651 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136678e-2434-4045-af58-4c28addd58b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:41.315935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136678e-2434-4045-af58-4c28addd58b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:41.316216 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b136678e-2434-4045-af58-4c28addd58b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:41.316931 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136678e-2434-4045-af58-4c28addd58b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:41.318565 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b136678e-2434-4045-af58-4c28addd58b6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:41.328895 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 797/1586] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:41.329712 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136678e-2434-4045-af58-4c28addd58b6 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:41.338947 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b136678e-2434-4045-af58-4c28addd58b6 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:41.344109 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f430cb-920d-48ed-9208-fee40a6e5d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:41.344723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f430cb-920d-48ed-9208-fee40a6e5d40 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:41.345006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f430cb-920d-48ed-9208-fee40a6e5d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:41.345284 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f430cb-920d-48ed-9208-fee40a6e5d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:41.346060 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f430cb-920d-48ed-9208-fee40a6e5d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:41.347606 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f430cb-920d-48ed-9208-fee40a6e5d40 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:41.357815 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 798/1587] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:41.358566 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f430cb-920d-48ed-9208-fee40a6e5d40 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:41.367701 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f430cb-920d-48ed-9208-fee40a6e5d40 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:41.373050 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d70c71-7b66-434e-852f-858b19fe69d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:41.373658 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d70c71-7b66-434e-852f-858b19fe69d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:41.373658 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d70c71-7b66-434e-852f-858b19fe69d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:41.373658 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d70c71-7b66-434e-852f-858b19fe69d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:41.375195 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d70c71-7b66-434e-852f-858b19fe69d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:41.376787 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d70c71-7b66-434e-852f-858b19fe69d6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:41.441854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 790/1588] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:36:41 2022] POST /identity/v3/projects => generated 405 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:36:41.442695 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda9a24-6957-4276-8974-138431278b28 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:41.502457 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cda9a24-6957-4276-8974-138431278b28 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:41.507139 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957721f-2d4b-4825-ad69-81f12ef29383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:41.507796 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957721f-2d4b-4825-ad69-81f12ef29383 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:41.508082 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957721f-2d4b-4825-ad69-81f12ef29383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:41.508361 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4957721f-2d4b-4825-ad69-81f12ef29383 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:41.509077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957721f-2d4b-4825-ad69-81f12ef29383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:41.510762 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4957721f-2d4b-4825-ad69-81f12ef29383 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:41.520973 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 791/1589] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:41.521772 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957721f-2d4b-4825-ad69-81f12ef29383 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:41.531284 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4957721f-2d4b-4825-ad69-81f12ef29383 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:41.535843 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f9355-9c0b-499d-b48f-78ab6c17c098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:41.536460 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f9355-9c0b-499d-b48f-78ab6c17c098 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:41.536750 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f9355-9c0b-499d-b48f-78ab6c17c098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:41.537032 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f9355-9c0b-499d-b48f-78ab6c17c098 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:41.537749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f9355-9c0b-499d-b48f-78ab6c17c098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:41.539294 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f9355-9c0b-499d-b48f-78ab6c17c098 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:41.548827 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 792/1590] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:41.549621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f9355-9c0b-499d-b48f-78ab6c17c098 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:41.555409 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 799/1591] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:36:41 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:36:41.555409 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d70c71-7b66-434e-852f-858b19fe69d6 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:41.559295 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f9355-9c0b-499d-b48f-78ab6c17c098 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:41.564862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d70c71-7b66-434e-852f-858b19fe69d6 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:41.565693 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bd83b-ac12-41e3-acdd-fc87c86d8c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:41.572564 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bd83b-ac12-41e3-acdd-fc87c86d8c97 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:41.572564 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bd83b-ac12-41e3-acdd-fc87c86d8c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:41.572564 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2bd83b-ac12-41e3-acdd-fc87c86d8c97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:41.572564 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2bd83b-ac12-41e3-acdd-fc87c86d8c97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:41.572564 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2bd83b-ac12-41e3-acdd-fc87c86d8c97 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:41.573091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10d3c8-d0a3-4705-9f49-d500809627bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:41.573091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10d3c8-d0a3-4705-9f49-d500809627bd admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:41.573091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10d3c8-d0a3-4705-9f49-d500809627bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:41.573091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f10d3c8-d0a3-4705-9f49-d500809627bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:41.573469 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10d3c8-d0a3-4705-9f49-d500809627bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:41.573469 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f10d3c8-d0a3-4705-9f49-d500809627bd admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:41.580920 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 793/1592] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:41.581538 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bd83b-ac12-41e3-acdd-fc87c86d8c97 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:41.586948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 800/1593] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:41.587755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10d3c8-d0a3-4705-9f49-d500809627bd admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:41.591154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2bd83b-ac12-41e3-acdd-fc87c86d8c97 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:41.596271 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7f5c2-cc87-4196-8142-460996acfb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:41.597140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7f5c2-cc87-4196-8142-460996acfb6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:41.597421 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7f5c2-cc87-4196-8142-460996acfb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:41.597692 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7f5c2-cc87-4196-8142-460996acfb6d admin admin] PATH_INFO: `/v3/projects/867531f082ec4beeab9ef834c9b504b3/users/6673e93e63fc4e0bb47a7ca7c3fd4a18/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:41.598126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f10d3c8-d0a3-4705-9f49-d500809627bd admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:41.602985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b272d-cfde-4788-808d-393854ee7be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:41.603869 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b272d-cfde-4788-808d-393854ee7be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:41.604190 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b272d-cfde-4788-808d-393854ee7be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:41.604474 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b272d-cfde-4788-808d-393854ee7be0 admin admin] PATH_INFO: `/v3/projects/733813e673fb410aa8f2f2b13ba52938/users/82f52f79b0e04e36bd8fdc491ff2f990/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:41.613340 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7f5c2-cc87-4196-8142-460996acfb6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=867531f082ec4beeab9ef834c9b504b3, user_id=6673e93e63fc4e0bb47a7ca7c3fd4a18, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:41.614416 dv-cinder-850015-3-smb devstack@keystone.service[80357]: WARNING py.warnings [None req-0eb7f5c2-cc87-4196-8142-460996acfb6d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:36:41.614416 dv-cinder-850015-3-smb devstack@keystone.service[80357]: warnings.warn(msg) Jul 18 02:36:41.614416 dv-cinder-850015-3-smb devstack@keystone.service[80357]: Jul 18 02:36:41.616801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7f5c2-cc87-4196-8142-460996acfb6d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:41.620896 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b272d-cfde-4788-808d-393854ee7be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=733813e673fb410aa8f2f2b13ba52938, user_id=82f52f79b0e04e36bd8fdc491ff2f990, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:41.623593 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b272d-cfde-4788-808d-393854ee7be0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:41.717301 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 794/1594] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:36:41 2022] PUT /identity/v3/projects/867531f082ec4beeab9ef834c9b504b3/users/6673e93e63fc4e0bb47a7ca7c3fd4a18/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:41.718616 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7f5c2-cc87-4196-8142-460996acfb6d admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:41.734945 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 801/1595] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:36:41 2022] PUT /identity/v3/projects/733813e673fb410aa8f2f2b13ba52938/users/82f52f79b0e04e36bd8fdc491ff2f990/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:41.735996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b272d-cfde-4788-808d-393854ee7be0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:41.783844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7f5c2-cc87-4196-8142-460996acfb6d admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:41.799064 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b272d-cfde-4788-808d-393854ee7be0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:41.803778 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f43536-737d-4467-9e22-164b55a5d49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:41.804450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f43536-737d-4467-9e22-164b55a5d49a admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:41.804738 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f43536-737d-4467-9e22-164b55a5d49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:41.805020 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f43536-737d-4467-9e22-164b55a5d49a admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:41.805797 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f43536-737d-4467-9e22-164b55a5d49a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:41.807432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f43536-737d-4467-9e22-164b55a5d49a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:41.808748 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:41.815762 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:41.821162 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 802/1596] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:41.821162 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f43536-737d-4467-9e22-164b55a5d49a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:41.830648 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f43536-737d-4467-9e22-164b55a5d49a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:41.835696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332d2cb-def3-4677-8af4-5fea54d58214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:41.836419 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332d2cb-def3-4677-8af4-5fea54d58214 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:41.836688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332d2cb-def3-4677-8af4-5fea54d58214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:41.836968 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332d2cb-def3-4677-8af4-5fea54d58214 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:41.837684 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332d2cb-def3-4677-8af4-5fea54d58214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:41.839333 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332d2cb-def3-4677-8af4-5fea54d58214 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:41.841794 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0566ea6-fa20-400d-9f01-0306b15741d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:41.843049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0566ea6-fa20-400d-9f01-0306b15741d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:41.843425 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0566ea6-fa20-400d-9f01-0306b15741d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:41.843687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0566ea6-fa20-400d-9f01-0306b15741d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:41.844412 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0566ea6-fa20-400d-9f01-0306b15741d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:41.846488 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0566ea6-fa20-400d-9f01-0306b15741d1 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:41.850588 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 803/1597] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:41.851472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332d2cb-def3-4677-8af4-5fea54d58214 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:41.861005 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332d2cb-def3-4677-8af4-5fea54d58214 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:41.869092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f638384-3c8e-485a-b1f3-45adf775642b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:41.869801 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f638384-3c8e-485a-b1f3-45adf775642b admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:41.870097 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f638384-3c8e-485a-b1f3-45adf775642b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:41.870377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f638384-3c8e-485a-b1f3-45adf775642b admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:41.871111 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f638384-3c8e-485a-b1f3-45adf775642b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:41.872842 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f638384-3c8e-485a-b1f3-45adf775642b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:41.883972 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 804/1598] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:41.884841 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f638384-3c8e-485a-b1f3-45adf775642b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:41.894936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f638384-3c8e-485a-b1f3-45adf775642b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:41.899573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad410555-be51-4fa2-85a7-9a75317f59ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:41.900214 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad410555-be51-4fa2-85a7-9a75317f59ce admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:41.900600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad410555-be51-4fa2-85a7-9a75317f59ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:41.900887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad410555-be51-4fa2-85a7-9a75317f59ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:41.901898 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad410555-be51-4fa2-85a7-9a75317f59ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:41.903466 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad410555-be51-4fa2-85a7-9a75317f59ce admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:41.913861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 805/1599] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:41.915172 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad410555-be51-4fa2-85a7-9a75317f59ce admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:41.923918 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad410555-be51-4fa2-85a7-9a75317f59ce admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:41.928475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939415b-bb91-40b3-aa99-cb847016471b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:41.929300 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939415b-bb91-40b3-aa99-cb847016471b admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:41.929591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939415b-bb91-40b3-aa99-cb847016471b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:41.929904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939415b-bb91-40b3-aa99-cb847016471b admin admin] PATH_INFO: `/v3/projects/bc26a58802fe4d05ac7b64745c1838fc/users/1ee01dc5841e4c7dbdbba94e81ce1d84/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:41.944510 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939415b-bb91-40b3-aa99-cb847016471b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc26a58802fe4d05ac7b64745c1838fc, user_id=1ee01dc5841e4c7dbdbba94e81ce1d84, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:41.948290 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9939415b-bb91-40b3-aa99-cb847016471b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:41.951570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 795/1600] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:36:41 2022] POST /identity/v3/users => generated 309 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:36:41.953547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be251e3-4abc-4dde-84ea-d9700928e2ff None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:41.953870 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be251e3-4abc-4dde-84ea-d9700928e2ff None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:41.954148 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be251e3-4abc-4dde-84ea-d9700928e2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:41.971806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-3be251e3-4abc-4dde-84ea-d9700928e2ff None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:41.973014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3be251e3-4abc-4dde-84ea-d9700928e2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:41.980774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 796/1601] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:41.982166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578379b-f418-4928-bb46-dcd2a9eb6293 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:41.982449 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578379b-f418-4928-bb46-dcd2a9eb6293 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:41.986426 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578379b-f418-4928-bb46-dcd2a9eb6293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:42.008882 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-4578379b-f418-4928-bb46-dcd2a9eb6293 None None] MFA Rules not processed for user `82f52f79b0e04e36bd8fdc491ff2f990`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:42.010104 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4578379b-f418-4928-bb46-dcd2a9eb6293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:42.045190 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 806/1602] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:36:41 2022] PUT /identity/v3/projects/bc26a58802fe4d05ac7b64745c1838fc/users/1ee01dc5841e4c7dbdbba94e81ce1d84/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:42.046039 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939415b-bb91-40b3-aa99-cb847016471b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:42.072913 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 797/1603] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:42.073945 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578379b-f418-4928-bb46-dcd2a9eb6293 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:42.084745 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578379b-f418-4928-bb46-dcd2a9eb6293 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:42.110194 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939415b-bb91-40b3-aa99-cb847016471b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:42.114866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b3cf9-9142-4ca3-b683-b1f0b6640515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:42.115739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b3cf9-9142-4ca3-b683-b1f0b6640515 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:42.116025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b3cf9-9142-4ca3-b683-b1f0b6640515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:42.116308 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b3cf9-9142-4ca3-b683-b1f0b6640515 admin admin] PATH_INFO: `/v3/projects/20ccca50870f4a86b5ba6c20ceb8d24a/users/1f09a9a483934c88a06be690f02fba4b/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:42.133806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b3cf9-9142-4ca3-b683-b1f0b6640515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20ccca50870f4a86b5ba6c20ceb8d24a, user_id=1f09a9a483934c88a06be690f02fba4b, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:42.136487 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b3cf9-9142-4ca3-b683-b1f0b6640515 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:42.141429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28317fbd-7e3e-4e40-935a-9e73f8517a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:42.142375 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28317fbd-7e3e-4e40-935a-9e73f8517a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:42.142661 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28317fbd-7e3e-4e40-935a-9e73f8517a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:42.142941 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28317fbd-7e3e-4e40-935a-9e73f8517a0b admin admin] PATH_INFO: `/v3/projects/8678d5999bad4524bc87466918c9be1d/users/425b75e3ecef458fad477092c6d51dd1/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:42.158503 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28317fbd-7e3e-4e40-935a-9e73f8517a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8678d5999bad4524bc87466918c9be1d, user_id=425b75e3ecef458fad477092c6d51dd1, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:42.161207 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28317fbd-7e3e-4e40-935a-9e73f8517a0b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:42.205432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 807/1604] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:36:42 2022] PUT /identity/v3/projects/20ccca50870f4a86b5ba6c20ceb8d24a/users/1f09a9a483934c88a06be690f02fba4b/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:42.206576 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b3cf9-9142-4ca3-b683-b1f0b6640515 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:42.237724 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 798/1605] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:36:42 2022] PUT /identity/v3/projects/8678d5999bad4524bc87466918c9be1d/users/425b75e3ecef458fad477092c6d51dd1/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:42.238599 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28317fbd-7e3e-4e40-935a-9e73f8517a0b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:42.268630 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:42.269998 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b3cf9-9142-4ca3-b683-b1f0b6640515 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:42.298007 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:42.300631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28317fbd-7e3e-4e40-935a-9e73f8517a0b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:42.305322 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a940a2-fb48-4e4b-ad76-600d69865341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:42.307950 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a940a2-fb48-4e4b-ad76-600d69865341 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:42.307950 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a940a2-fb48-4e4b-ad76-600d69865341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:42.307950 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a940a2-fb48-4e4b-ad76-600d69865341 admin admin] PATH_INFO: `/v3/projects/891ef5df61be4390b01531158f6ae274/users/a8e1b96d2a6f4efeb70e5ea740b427da/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:42.322313 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a940a2-fb48-4e4b-ad76-600d69865341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=891ef5df61be4390b01531158f6ae274, user_id=a8e1b96d2a6f4efeb70e5ea740b427da, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:42.324973 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a940a2-fb48-4e4b-ad76-600d69865341 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:42.327478 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd33109-59f5-414b-9d90-7f9515e9b35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:42.328087 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd33109-59f5-414b-9d90-7f9515e9b35b admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:42.328373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd33109-59f5-414b-9d90-7f9515e9b35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:42.328656 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd33109-59f5-414b-9d90-7f9515e9b35b admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:42.329385 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd33109-59f5-414b-9d90-7f9515e9b35b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:42.331005 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd33109-59f5-414b-9d90-7f9515e9b35b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:42.340919 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 808/1606] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:42.341913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd33109-59f5-414b-9d90-7f9515e9b35b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:42.351852 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd33109-59f5-414b-9d90-7f9515e9b35b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:42.356383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6faa9-c455-4eba-ab76-c53f24c444d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:42.357009 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6faa9-c455-4eba-ab76-c53f24c444d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:42.357297 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6faa9-c455-4eba-ab76-c53f24c444d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:42.357577 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6faa9-c455-4eba-ab76-c53f24c444d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:42.358906 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6faa9-c455-4eba-ab76-c53f24c444d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:42.360982 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6faa9-c455-4eba-ab76-c53f24c444d6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:42.370946 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 809/1607] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:42.371784 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6faa9-c455-4eba-ab76-c53f24c444d6 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:42.409560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 799/1608] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:36:42 2022] PUT /identity/v3/projects/891ef5df61be4390b01531158f6ae274/users/a8e1b96d2a6f4efeb70e5ea740b427da/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:42.411021 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385d6c9-1e1b-4979-8e1f-65e09e9b456a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:42.411388 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385d6c9-1e1b-4979-8e1f-65e09e9b456a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:42.411670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385d6c9-1e1b-4979-8e1f-65e09e9b456a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:42.428268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6faa9-c455-4eba-ab76-c53f24c444d6 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:42.430218 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-7385d6c9-1e1b-4979-8e1f-65e09e9b456a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:42.431958 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7385d6c9-1e1b-4979-8e1f-65e09e9b456a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:42.486594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92722e8-1663-469a-9fdc-f398c00d4d81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:42.487274 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92722e8-1663-469a-9fdc-f398c00d4d81 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:42.487568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92722e8-1663-469a-9fdc-f398c00d4d81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:42.487848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92722e8-1663-469a-9fdc-f398c00d4d81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:42.499209 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 800/1609] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:42.500072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385d6c9-1e1b-4979-8e1f-65e09e9b456a None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:42.572318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92722e8-1663-469a-9fdc-f398c00d4d81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:42.572318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92722e8-1663-469a-9fdc-f398c00d4d81 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:42.573192 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385d6c9-1e1b-4979-8e1f-65e09e9b456a None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:42.573192 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d7e5b-612b-4a61-81dd-2aa33fc10786 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:42.573192 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d7e5b-612b-4a61-81dd-2aa33fc10786 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:42.573192 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d7e5b-612b-4a61-81dd-2aa33fc10786 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:42.573780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d7e5b-612b-4a61-81dd-2aa33fc10786 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:42.573965 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 810/1610] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:36:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:36:42.573965 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1d35d-0fd7-4d6d-9134-75fad61b66bf None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:42.573965 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1d35d-0fd7-4d6d-9134-75fad61b66bf None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:42.573965 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b1d35d-0fd7-4d6d-9134-75fad61b66bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:42.588070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-31b1d35d-0fd7-4d6d-9134-75fad61b66bf None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:42.589686 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-31b1d35d-0fd7-4d6d-9134-75fad61b66bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:42.598568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 811/1611] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:42.599744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4af24-b735-4839-891d-dd4d4ef2c6b1 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:42.600106 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4af24-b735-4839-891d-dd4d4ef2c6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:42.600452 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4af24-b735-4839-891d-dd4d4ef2c6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:42.623043 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d7e5b-612b-4a61-81dd-2aa33fc10786 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:42.624515 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d7e5b-612b-4a61-81dd-2aa33fc10786 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:42.625412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:42.628452 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-92f4af24-b735-4839-891d-dd4d4ef2c6b1 None None] MFA Rules not processed for user `425b75e3ecef458fad477092c6d51dd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:42.629758 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-92f4af24-b735-4839-891d-dd4d4ef2c6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:42.634042 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 801/1612] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:36:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:36:42.635213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d7e5b-612b-4a61-81dd-2aa33fc10786 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:42.645744 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d7e5b-612b-4a61-81dd-2aa33fc10786 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:42.651648 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d916042-b383-4f80-87ea-21016f10ec2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:42.652537 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d916042-b383-4f80-87ea-21016f10ec2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:42.652821 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d916042-b383-4f80-87ea-21016f10ec2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:42.653094 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d916042-b383-4f80-87ea-21016f10ec2c admin admin] PATH_INFO: `/v3/projects/824120d47e204b5bbbd4fe0024a15f03/users/6618ecc2692c40be876654dfdc4496b5/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:42.657001 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:42.672254 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d916042-b383-4f80-87ea-21016f10ec2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=824120d47e204b5bbbd4fe0024a15f03, user_id=6618ecc2692c40be876654dfdc4496b5, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:42.674962 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d916042-b383-4f80-87ea-21016f10ec2c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:42.697180 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 812/1613] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:42.698095 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4af24-b735-4839-891d-dd4d4ef2c6b1 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:42.710094 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4af24-b735-4839-891d-dd4d4ef2c6b1 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:42.715205 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0efab-5180-478d-9ec2-dab3cd6d6b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:42.716081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0efab-5180-478d-9ec2-dab3cd6d6b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:42.716530 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0efab-5180-478d-9ec2-dab3cd6d6b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:42.716655 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0efab-5180-478d-9ec2-dab3cd6d6b9f admin admin] PATH_INFO: `/v3/projects/8f1b283588524a3081f31f8eb08b55d1/users/1a3f439ad1944033947d9ac6327beb46/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:42.741684 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0efab-5180-478d-9ec2-dab3cd6d6b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1b283588524a3081f31f8eb08b55d1, user_id=1a3f439ad1944033947d9ac6327beb46, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:42.745278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb0efab-5180-478d-9ec2-dab3cd6d6b9f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:42.834823 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 802/1614] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:36:42 2022] PUT /identity/v3/projects/824120d47e204b5bbbd4fe0024a15f03/users/6618ecc2692c40be876654dfdc4496b5/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:42.834823 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c8a72-f318-4155-bdf4-ed70c60c15fb None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:42.834823 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c8a72-f318-4155-bdf4-ed70c60c15fb None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:42.834823 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c8a72-f318-4155-bdf4-ed70c60c15fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:42.860538 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b89c8a72-f318-4155-bdf4-ed70c60c15fb None None] MFA Rules not processed for user `a8e1b96d2a6f4efeb70e5ea740b427da`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:42.863273 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b89c8a72-f318-4155-bdf4-ed70c60c15fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:42.935239 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 803/1615] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:42.935239 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c8a72-f318-4155-bdf4-ed70c60c15fb None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:42.942813 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 813/1616] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:36:42 2022] PUT /identity/v3/projects/8f1b283588524a3081f31f8eb08b55d1/users/1a3f439ad1944033947d9ac6327beb46/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:42.942813 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0efab-5180-478d-9ec2-dab3cd6d6b9f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:42.944945 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cbb0efab-5180-478d-9ec2-dab3cd6d6b9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:43.024226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89c8a72-f318-4155-bdf4-ed70c60c15fb None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:43.026327 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0efab-5180-478d-9ec2-dab3cd6d6b9f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:43.030835 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f69ebb-6544-4512-babc-7df05f8be3a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:43.031517 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f69ebb-6544-4512-babc-7df05f8be3a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:43.031883 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f69ebb-6544-4512-babc-7df05f8be3a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:43.032173 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f69ebb-6544-4512-babc-7df05f8be3a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:43.040999 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde658cd-5e49-49fd-95f1-6646b1a1b104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:43.041783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde658cd-5e49-49fd-95f1-6646b1a1b104 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:43.042350 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde658cd-5e49-49fd-95f1-6646b1a1b104 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:43.042703 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde658cd-5e49-49fd-95f1-6646b1a1b104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:43.103031 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f69ebb-6544-4512-babc-7df05f8be3a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:43.104745 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f69ebb-6544-4512-babc-7df05f8be3a2 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:43.111452 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde658cd-5e49-49fd-95f1-6646b1a1b104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:43.112900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde658cd-5e49-49fd-95f1-6646b1a1b104 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:43.114891 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 814/1617] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:36:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:36:43.116194 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a09199-7e22-4703-8dd0-ec4b5a243273 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:43.116479 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a09199-7e22-4703-8dd0-ec4b5a243273 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:43.116771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a09199-7e22-4703-8dd0-ec4b5a243273 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:43.122590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 815/1618] 10.222.0.64 () {54 vars in 962 bytes} [Mon Jul 18 02:36:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:36:43.124677 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92d596-37e4-433f-acb0-405b886c20ff None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:43.124677 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92d596-37e4-433f-acb0-405b886c20ff None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:43.125076 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c92d596-37e4-433f-acb0-405b886c20ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:43.126192 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 804/1619] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:36:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:36:43.127824 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde658cd-5e49-49fd-95f1-6646b1a1b104 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:43.154557 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde658cd-5e49-49fd-95f1-6646b1a1b104 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:43.160496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5c92d596-37e4-433f-acb0-405b886c20ff None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:43.160496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5c92d596-37e4-433f-acb0-405b886c20ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:43.165035 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5eb230-379d-4d34-8456-0cfcee1d4982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:43.165928 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5eb230-379d-4d34-8456-0cfcee1d4982 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:43.166286 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5eb230-379d-4d34-8456-0cfcee1d4982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:43.170028 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 816/1620] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:43.170244 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5eb230-379d-4d34-8456-0cfcee1d4982 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:43.170244 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5eb230-379d-4d34-8456-0cfcee1d4982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:43.170472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820cd37-a9dc-4f65-b3b9-464e867147ad None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:43.170472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820cd37-a9dc-4f65-b3b9-464e867147ad None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:43.170472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d820cd37-a9dc-4f65-b3b9-464e867147ad None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:43.170472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 817/1621] 10.222.0.64 () {54 vars in 962 bytes} [Mon Jul 18 02:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:36:43.170799 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5eb230-379d-4d34-8456-0cfcee1d4982 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:43.171239 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2e517-efd4-4c82-aeda-0015ac05ff40 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:43.171530 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2e517-efd4-4c82-aeda-0015ac05ff40 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:43.171940 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2e517-efd4-4c82-aeda-0015ac05ff40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:43.191286 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 805/1622] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:43 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:43.191286 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5eb230-379d-4d34-8456-0cfcee1d4982 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:43.204521 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5eb230-379d-4d34-8456-0cfcee1d4982 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:43.209002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524f6305-9f0e-4446-8b08-f93a7c4fc1c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:43.210445 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f6305-9f0e-4446-8b08-f93a7c4fc1c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:43.210839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f6305-9f0e-4446-8b08-f93a7c4fc1c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:43.211218 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524f6305-9f0e-4446-8b08-f93a7c4fc1c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:43.220699 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-eee2e517-efd4-4c82-aeda-0015ac05ff40 None None] MFA Rules not processed for user `6f51aae36f0b42868567840fa957ffe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:43.222267 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-eee2e517-efd4-4c82-aeda-0015ac05ff40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:43.225256 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f6305-9f0e-4446-8b08-f93a7c4fc1c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:43.227407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:43.227880 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524f6305-9f0e-4446-8b08-f93a7c4fc1c4 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:43.242861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 806/1623] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:36:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:36:43.245149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c20f3d-7349-44e8-a67b-72aa8d7fd866 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:43.245922 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c20f3d-7349-44e8-a67b-72aa8d7fd866 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:43.246501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c20f3d-7349-44e8-a67b-72aa8d7fd866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:43.268668 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-d3c20f3d-7349-44e8-a67b-72aa8d7fd866 None None] MFA Rules not processed for user `6f51aae36f0b42868567840fa957ffe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:43.270101 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d3c20f3d-7349-44e8-a67b-72aa8d7fd866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:43.326471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 818/1624] 10.222.0.64 () {58 vars in 1059 bytes} [Mon Jul 18 02:36:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:43.327949 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2e517-efd4-4c82-aeda-0015ac05ff40 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:43.339788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2e517-efd4-4c82-aeda-0015ac05ff40 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:43.345748 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671c78d-23c2-4547-96a7-c740edd510f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:43.346884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671c78d-23c2-4547-96a7-c740edd510f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:43.347321 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671c78d-23c2-4547-96a7-c740edd510f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:43.347780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671c78d-23c2-4547-96a7-c740edd510f6 admin admin] PATH_INFO: `/v3/projects/8f1b283588524a3081f31f8eb08b55d1/users/1a3f439ad1944033947d9ac6327beb46/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:43.351189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671c78d-23c2-4547-96a7-c740edd510f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f1b283588524a3081f31f8eb08b55d1, user_id=1a3f439ad1944033947d9ac6327beb46, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:43.356507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671c78d-23c2-4547-96a7-c740edd510f6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:43.386630 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 807/1625] 10.222.0.64 () {58 vars in 1059 bytes} [Mon Jul 18 02:36:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:43.387703 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c20f3d-7349-44e8-a67b-72aa8d7fd866 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:43.394286 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 819/1626] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:36:43 2022] PUT /identity/v3/projects/8f1b283588524a3081f31f8eb08b55d1/users/1a3f439ad1944033947d9ac6327beb46/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:43.395490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671c78d-23c2-4547-96a7-c740edd510f6 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:43.410490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c20f3d-7349-44e8-a67b-72aa8d7fd866 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:43.445019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:43.492042 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b3a3c-a96d-447c-a0e2-118c11ec824e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:43.492704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b3a3c-a96d-447c-a0e2-118c11ec824e service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:43.493018 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b3a3c-a96d-447c-a0e2-118c11ec824e service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:43.493297 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b3a3c-a96d-447c-a0e2-118c11ec824e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:43.506555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671c78d-23c2-4547-96a7-c740edd510f6 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:43.515148 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b007646-2102-4ca4-90a4-dd27a0045a8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:43.516290 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b007646-2102-4ca4-90a4-dd27a0045a8f service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:43.516653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b007646-2102-4ca4-90a4-dd27a0045a8f service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:43.517097 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b007646-2102-4ca4-90a4-dd27a0045a8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:43.559178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b3a3c-a96d-447c-a0e2-118c11ec824e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:43.560828 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b3a3c-a96d-447c-a0e2-118c11ec824e service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:43.575251 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 808/1627] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:36:43 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:36:43.577825 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d074d8-eeeb-4cee-8eae-498d0946d01d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:43.578599 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d074d8-eeeb-4cee-8eae-498d0946d01d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:43.579062 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d074d8-eeeb-4cee-8eae-498d0946d01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:43.590674 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b007646-2102-4ca4-90a4-dd27a0045a8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:43.592621 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b007646-2102-4ca4-90a4-dd27a0045a8f service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:43.604931 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 820/1628] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:36:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:36:43.620918 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-e7d074d8-eeeb-4cee-8eae-498d0946d01d None None] MFA Rules not processed for user `1a3f439ad1944033947d9ac6327beb46`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:43.622926 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e7d074d8-eeeb-4cee-8eae-498d0946d01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:43.754531 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 809/1629] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:43 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:43.767507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b007646-2102-4ca4-90a4-dd27a0045a8f service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:43.851446 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b007646-2102-4ca4-90a4-dd27a0045a8f service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:43.865772 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74534b4f-cc27-4a04-a8e7-790936743753 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:43.868457 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74534b4f-cc27-4a04-a8e7-790936743753 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:43.868840 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74534b4f-cc27-4a04-a8e7-790936743753 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:43.869498 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74534b4f-cc27-4a04-a8e7-790936743753 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:43.927317 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74534b4f-cc27-4a04-a8e7-790936743753 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:43.931414 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74534b4f-cc27-4a04-a8e7-790936743753 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:43.963938 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 821/1630] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:36:43 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:36:44.005444 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3df01-acf9-4e91-9a35-64bc02529a9d None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:44.005812 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3df01-acf9-4e91-9a35-64bc02529a9d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:44.006057 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3df01-acf9-4e91-9a35-64bc02529a9d None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:44.007501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 810/1631] 10.222.0.64 () {54 vars in 912 bytes} [Mon Jul 18 02:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:36:44.014777 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810b696-762d-4e5e-8b72-247a71d0c9be None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:44.015085 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810b696-762d-4e5e-8b72-247a71d0c9be None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:44.016733 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fb4ce-a780-4341-8515-e98032a65bc4 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:44.017028 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fb4ce-a780-4341-8515-e98032a65bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:44.017346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304fb4ce-a780-4341-8515-e98032a65bc4 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:44.018157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810b696-762d-4e5e-8b72-247a71d0c9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:44.020829 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 811/1632] 10.222.0.64 () {54 vars in 912 bytes} [Mon Jul 18 02:36:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:36:44.026669 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb8329-d0e3-43e9-a0d7-9a8d8dcc7f24 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:44.027026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb8329-d0e3-43e9-a0d7-9a8d8dcc7f24 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:44.027310 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb8329-d0e3-43e9-a0d7-9a8d8dcc7f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:44.041562 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8810b696-762d-4e5e-8b72-247a71d0c9be None None] MFA Rules not processed for user `6f51aae36f0b42868567840fa957ffe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:44.043221 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8810b696-762d-4e5e-8b72-247a71d0c9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:44.048092 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-06eb8329-d0e3-43e9-a0d7-9a8d8dcc7f24 None None] MFA Rules not processed for user `6f51aae36f0b42868567840fa957ffe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:44.049731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-06eb8329-d0e3-43e9-a0d7-9a8d8dcc7f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:44.055206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 822/1633] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jul 18 02:36:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:44.061902 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 812/1634] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jul 18 02:36:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:36:44.078384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810b696-762d-4e5e-8b72-247a71d0c9be None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:44.104622 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810b696-762d-4e5e-8b72-247a71d0c9be None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:44.114051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737977e9-a1fa-418f-97fd-ccce0eba74be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:44.115165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737977e9-a1fa-418f-97fd-ccce0eba74be service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:44.116564 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737977e9-a1fa-418f-97fd-ccce0eba74be service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:44.117529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737977e9-a1fa-418f-97fd-ccce0eba74be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:44.119981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb8329-d0e3-43e9-a0d7-9a8d8dcc7f24 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:44.132000 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737977e9-a1fa-418f-97fd-ccce0eba74be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:44.133121 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb8329-d0e3-43e9-a0d7-9a8d8dcc7f24 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:44.134331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737977e9-a1fa-418f-97fd-ccce0eba74be service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:44.137523 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c564463-03ff-48e7-8b38-baa629582ea0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:44.138356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c564463-03ff-48e7-8b38-baa629582ea0 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:44.140570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c564463-03ff-48e7-8b38-baa629582ea0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:44.141239 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c564463-03ff-48e7-8b38-baa629582ea0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:44.151386 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 823/1635] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:36:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:36:44.158652 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c564463-03ff-48e7-8b38-baa629582ea0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:44.160584 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c564463-03ff-48e7-8b38-baa629582ea0 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:44.173572 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 813/1636] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:36:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:36:44.515460 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:44.643538 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:45.744935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737977e9-a1fa-418f-97fd-ccce0eba74be service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:45.744935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737977e9-a1fa-418f-97fd-ccce0eba74be service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:45.744935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5e087-283d-44b6-952c-66230f0daed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:45.744935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5e087-283d-44b6-952c-66230f0daed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:45.752763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5e087-283d-44b6-952c-66230f0daed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:45.752763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5e087-283d-44b6-952c-66230f0daed4 admin admin] PATH_INFO: `/v3/users/de75c674bfd2422eac230f228c093cac` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:45.752763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5e087-283d-44b6-952c-66230f0daed4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de75c674bfd2422eac230f228c093cac)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:45.752763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5e087-283d-44b6-952c-66230f0daed4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:45.754515 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ad202-e454-404b-b110-e58b35e67848 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:45.754515 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ad202-e454-404b-b110-e58b35e67848 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:45.754515 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ad202-e454-404b-b110-e58b35e67848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:45.754515 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-753ad202-e454-404b-b110-e58b35e67848 None None] MFA Rules not processed for user `1ee01dc5841e4c7dbdbba94e81ce1d84`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:45.754515 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-753ad202-e454-404b-b110-e58b35e67848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:45.858982 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 814/1637] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:45.863129 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ad202-e454-404b-b110-e58b35e67848 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:45.878001 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ad202-e454-404b-b110-e58b35e67848 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:45.884671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75caa77-ef93-4020-bd6a-b6fd316fbd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:45.885598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75caa77-ef93-4020-bd6a-b6fd316fbd40 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:45.886185 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75caa77-ef93-4020-bd6a-b6fd316fbd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:45.886781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75caa77-ef93-4020-bd6a-b6fd316fbd40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:45.888742 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75caa77-ef93-4020-bd6a-b6fd316fbd40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:45.891917 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75caa77-ef93-4020-bd6a-b6fd316fbd40 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:45.978846 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fcc5e087-283d-44b6-952c-66230f0daed4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de75c674bfd2422eac230f228c093cac'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:45.979915 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fcc5e087-283d-44b6-952c-66230f0daed4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de75c674bfd2422eac230f228c093cac'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:45.980767 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fcc5e087-283d-44b6-952c-66230f0daed4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de75c674bfd2422eac230f228c093cac'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:45.988154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 815/1638] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:36:45 2022] POST /identity/v3/projects => generated 405 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:36:45.992699 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75caa77-ef93-4020-bd6a-b6fd316fbd40 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:45.995368 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d75caa77-ef93-4020-bd6a-b6fd316fbd40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:46.002105 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fcc5e087-283d-44b6-952c-66230f0daed4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de75c674bfd2422eac230f228c093cac'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:46.080786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75caa77-ef93-4020-bd6a-b6fd316fbd40 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:46.087353 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcebe6-5ad8-4add-a0b4-e36473c298d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:46.088384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcebe6-5ad8-4add-a0b4-e36473c298d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:46.088384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcebe6-5ad8-4add-a0b4-e36473c298d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:46.088687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bcebe6-5ad8-4add-a0b4-e36473c298d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:46.094019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bcebe6-5ad8-4add-a0b4-e36473c298d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:46.094095 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-fcc5e087-283d-44b6-952c-66230f0daed4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de75c674bfd2422eac230f228c093cac'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:46.094160 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bcebe6-5ad8-4add-a0b4-e36473c298d3 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:46.102730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:46.116503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 824/1639] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:36:45 2022] DELETE /identity/v3/users/de75c674bfd2422eac230f228c093cac => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:46.120591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982815f-0012-4899-9c56-a87d950c50cc None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:46.120898 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982815f-0012-4899-9c56-a87d950c50cc None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:46.122487 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982815f-0012-4899-9c56-a87d950c50cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:46.145663 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2982815f-0012-4899-9c56-a87d950c50cc None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:46.147448 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2982815f-0012-4899-9c56-a87d950c50cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:46.187645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:46.246572 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 816/1640] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:36:45 2022] POST /identity/v3/users => generated 309 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:36:46.250163 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcebe6-5ad8-4add-a0b4-e36473c298d3 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:46.258122 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 825/1641] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:46.273456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982815f-0012-4899-9c56-a87d950c50cc None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:46.276342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2982815f-0012-4899-9c56-a87d950c50cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:46.283449 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bcebe6-5ad8-4add-a0b4-e36473c298d3 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:46.293141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad590c4-2ff7-4765-bb1a-b1bcc3321250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:46.294042 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad590c4-2ff7-4765-bb1a-b1bcc3321250 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:46.294333 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad590c4-2ff7-4765-bb1a-b1bcc3321250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:46.294614 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad590c4-2ff7-4765-bb1a-b1bcc3321250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:46.298126 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad590c4-2ff7-4765-bb1a-b1bcc3321250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:46.299807 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad590c4-2ff7-4765-bb1a-b1bcc3321250 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:46.320207 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 817/1642] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:36:46.328756 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad590c4-2ff7-4765-bb1a-b1bcc3321250 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:46.343970 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad590c4-2ff7-4765-bb1a-b1bcc3321250 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:46.354191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05b04c-b8c1-492e-832b-58cb6b26eafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:46.362941 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05b04c-b8c1-492e-832b-58cb6b26eafa admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:46.362941 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05b04c-b8c1-492e-832b-58cb6b26eafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:46.362941 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05b04c-b8c1-492e-832b-58cb6b26eafa admin admin] PATH_INFO: `/v3/projects/1b34d96b6f05425c9eb131e4c2474490/users/7b8948513140499897efc889c8dfb741/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:46.375489 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05b04c-b8c1-492e-832b-58cb6b26eafa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b34d96b6f05425c9eb131e4c2474490, user_id=7b8948513140499897efc889c8dfb741, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:46.379064 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd05b04c-b8c1-492e-832b-58cb6b26eafa admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:46.396581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982815f-0012-4899-9c56-a87d950c50cc None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:46.402237 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c972d35-0c62-4b46-a1de-a93e4d829588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:46.403206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c972d35-0c62-4b46-a1de-a93e4d829588 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:46.405031 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c972d35-0c62-4b46-a1de-a93e4d829588 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:46.405448 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c972d35-0c62-4b46-a1de-a93e4d829588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:46.444467 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c972d35-0c62-4b46-a1de-a93e4d829588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:46.444467 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c972d35-0c62-4b46-a1de-a93e4d829588 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:46.452937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 826/1643] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:36:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:36:46.529534 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 818/1644] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:36:46 2022] PUT /identity/v3/projects/1b34d96b6f05425c9eb131e4c2474490/users/7b8948513140499897efc889c8dfb741/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:46.535437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c972d35-0c62-4b46-a1de-a93e4d829588 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:46.587741 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c972d35-0c62-4b46-a1de-a93e4d829588 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:46.690935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8424b-7611-4fd3-8a97-f54deeb4e952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:46.691642 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8424b-7611-4fd3-8a97-f54deeb4e952 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:46.691927 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8424b-7611-4fd3-8a97-f54deeb4e952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:46.692203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8424b-7611-4fd3-8a97-f54deeb4e952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:46.692939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8424b-7611-4fd3-8a97-f54deeb4e952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:46.697379 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8424b-7611-4fd3-8a97-f54deeb4e952 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:46.732047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 827/1645] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:46.736634 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05b04c-b8c1-492e-832b-58cb6b26eafa admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:46.755154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05b04c-b8c1-492e-832b-58cb6b26eafa admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:46.777247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b069df-64de-49d3-9367-d8fabd276033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:46.780945 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b069df-64de-49d3-9367-d8fabd276033 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:46.782317 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b069df-64de-49d3-9367-d8fabd276033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:46.783999 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b069df-64de-49d3-9367-d8fabd276033 admin admin] PATH_INFO: `/v3/projects/1b34d96b6f05425c9eb131e4c2474490/users/7b8948513140499897efc889c8dfb741/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:46.794635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b069df-64de-49d3-9367-d8fabd276033 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b34d96b6f05425c9eb131e4c2474490, user_id=7b8948513140499897efc889c8dfb741, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:46.801459 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b069df-64de-49d3-9367-d8fabd276033 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:46.827148 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 819/1646] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:36:46 2022] PUT /identity/v3/projects/1b34d96b6f05425c9eb131e4c2474490/users/7b8948513140499897efc889c8dfb741/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:47.964888 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8424b-7611-4fd3-8a97-f54deeb4e952 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:47.969903 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4dd8424b-7611-4fd3-8a97-f54deeb4e952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:47.987693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8424b-7611-4fd3-8a97-f54deeb4e952 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:48.102362 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59de16c-b0aa-4ca3-9f34-72432cf2fddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:48.119937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59de16c-b0aa-4ca3-9f34-72432cf2fddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:48.121032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59de16c-b0aa-4ca3-9f34-72432cf2fddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:48.121468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59de16c-b0aa-4ca3-9f34-72432cf2fddc admin admin] PATH_INFO: `/v3/projects/f99a48508c754186a7d89e782e1d9ac0` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:48.165562 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59de16c-b0aa-4ca3-9f34-72432cf2fddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f99a48508c754186a7d89e782e1d9ac0)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:48.170664 dv-cinder-850015-3-smb devstack@keystone.service[80358]: WARNING py.warnings [None req-e59de16c-b0aa-4ca3-9f34-72432cf2fddc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:36:48.170664 dv-cinder-850015-3-smb devstack@keystone.service[80358]: warnings.warn(msg) Jul 18 02:36:48.170664 dv-cinder-850015-3-smb devstack@keystone.service[80358]: Jul 18 02:36:48.176465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59de16c-b0aa-4ca3-9f34-72432cf2fddc admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:48.441679 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e59de16c-b0aa-4ca3-9f34-72432cf2fddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f99a48508c754186a7d89e782e1d9ac0', 'request_id': 'req-e59de16c-b0aa-4ca3-9f34-72432cf2fddc'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:48.463743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e59de16c-b0aa-4ca3-9f34-72432cf2fddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f99a48508c754186a7d89e782e1d9ac0', 'request_id': 'req-e59de16c-b0aa-4ca3-9f34-72432cf2fddc'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:48.501376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e59de16c-b0aa-4ca3-9f34-72432cf2fddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f99a48508c754186a7d89e782e1d9ac0', 'request_id': 'req-e59de16c-b0aa-4ca3-9f34-72432cf2fddc'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:48.635482 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e59de16c-b0aa-4ca3-9f34-72432cf2fddc admin admin] The token cache is being invalidate because project f99a48508c754186a7d89e782e1d9ac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:36:48.635482 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e59de16c-b0aa-4ca3-9f34-72432cf2fddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:48.635482 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e59de16c-b0aa-4ca3-9f34-72432cf2fddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:48.636692 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 828/1647] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:36:47 2022] DELETE /identity/v3/projects/f99a48508c754186a7d89e782e1d9ac0 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:48.640762 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b069df-64de-49d3-9367-d8fabd276033 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:48.642846 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c4b069df-64de-49d3-9367-d8fabd276033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:48.658801 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:48.663491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b069df-64de-49d3-9367-d8fabd276033 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:48.842554 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb00ddf-c43a-4df6-a9a7-ab0e4b2abfcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:48.845380 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb00ddf-c43a-4df6-a9a7-ab0e4b2abfcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:48.845380 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb00ddf-c43a-4df6-a9a7-ab0e4b2abfcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:48.845380 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb00ddf-c43a-4df6-a9a7-ab0e4b2abfcd admin admin] PATH_INFO: `/v3/users/1a3f439ad1944033947d9ac6327beb46` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:48.850064 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb00ddf-c43a-4df6-a9a7-ab0e4b2abfcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a3f439ad1944033947d9ac6327beb46)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:48.858456 dv-cinder-850015-3-smb devstack@keystone.service[80357]: WARNING py.warnings [None req-deb00ddf-c43a-4df6-a9a7-ab0e4b2abfcd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 02:36:48.858456 dv-cinder-850015-3-smb devstack@keystone.service[80357]: warnings.warn(msg) Jul 18 02:36:48.858456 dv-cinder-850015-3-smb devstack@keystone.service[80357]: Jul 18 02:36:48.859662 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb00ddf-c43a-4df6-a9a7-ab0e4b2abfcd admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:49.226732 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-deb00ddf-c43a-4df6-a9a7-ab0e4b2abfcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a3f439ad1944033947d9ac6327beb46'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:49.227661 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-deb00ddf-c43a-4df6-a9a7-ab0e4b2abfcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a3f439ad1944033947d9ac6327beb46'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:49.230339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-deb00ddf-c43a-4df6-a9a7-ab0e4b2abfcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a3f439ad1944033947d9ac6327beb46'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:49.274328 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-deb00ddf-c43a-4df6-a9a7-ab0e4b2abfcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a3f439ad1944033947d9ac6327beb46'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:49.294094 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-deb00ddf-c43a-4df6-a9a7-ab0e4b2abfcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a3f439ad1944033947d9ac6327beb46'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:49.425490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 820/1648] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:36:48 2022] DELETE /identity/v3/users/1a3f439ad1944033947d9ac6327beb46 => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:49.900975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59de16c-b0aa-4ca3-9f34-72432cf2fddc admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:49.900975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e59de16c-b0aa-4ca3-9f34-72432cf2fddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:49.925021 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59de16c-b0aa-4ca3-9f34-72432cf2fddc admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:50.065750 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef81c4-36ef-4a51-bee8-5495d84f245b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:50.067236 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef81c4-36ef-4a51-bee8-5495d84f245b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:50.067697 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef81c4-36ef-4a51-bee8-5495d84f245b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:50.068120 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef81c4-36ef-4a51-bee8-5495d84f245b admin admin] PATH_INFO: `/v3/users/a8e1b96d2a6f4efeb70e5ea740b427da` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:50.069636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef81c4-36ef-4a51-bee8-5495d84f245b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e1b96d2a6f4efeb70e5ea740b427da)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:50.072354 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef81c4-36ef-4a51-bee8-5495d84f245b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:50.354241 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-10ef81c4-36ef-4a51-bee8-5495d84f245b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e1b96d2a6f4efeb70e5ea740b427da'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:50.356793 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-10ef81c4-36ef-4a51-bee8-5495d84f245b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e1b96d2a6f4efeb70e5ea740b427da'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:50.358109 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-10ef81c4-36ef-4a51-bee8-5495d84f245b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e1b96d2a6f4efeb70e5ea740b427da'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:50.395745 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-10ef81c4-36ef-4a51-bee8-5495d84f245b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e1b96d2a6f4efeb70e5ea740b427da'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:50.530974 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-10ef81c4-36ef-4a51-bee8-5495d84f245b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e1b96d2a6f4efeb70e5ea740b427da'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:50.571588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f108ac-87dd-4b69-85b7-f05989ec552a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:50.571588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f108ac-87dd-4b69-85b7-f05989ec552a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:50.571588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f108ac-87dd-4b69-85b7-f05989ec552a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:50.572112 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 829/1649] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:36:49 2022] DELETE /identity/v3/users/a8e1b96d2a6f4efeb70e5ea740b427da => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:50.607706 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-e8f108ac-87dd-4b69-85b7-f05989ec552a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:50.613913 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e8f108ac-87dd-4b69-85b7-f05989ec552a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:50.636958 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:INSERT=6,keystone:SELECT=84,keystone:DELETE=10 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:50.726267 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 821/1650] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:50.741084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef81c4-36ef-4a51-bee8-5495d84f245b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:50.742855 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-10ef81c4-36ef-4a51-bee8-5495d84f245b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:50.767358 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:50.813967 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef81c4-36ef-4a51-bee8-5495d84f245b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:50.821973 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c798e4d-e67c-43f5-a6f1-f93c9d357529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:50.821973 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c798e4d-e67c-43f5-a6f1-f93c9d357529 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:50.821973 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c798e4d-e67c-43f5-a6f1-f93c9d357529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:50.822905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c798e4d-e67c-43f5-a6f1-f93c9d357529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:50.834517 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c798e4d-e67c-43f5-a6f1-f93c9d357529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:50.836147 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c798e4d-e67c-43f5-a6f1-f93c9d357529 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:50.848650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 830/1651] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:36:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:36:50.983107 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018c973-4a50-4c10-8ae2-0a7c85fe80ea None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:50.984186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018c973-4a50-4c10-8ae2-0a7c85fe80ea None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:50.984186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018c973-4a50-4c10-8ae2-0a7c85fe80ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:51.049975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-6018c973-4a50-4c10-8ae2-0a7c85fe80ea None None] MFA Rules not processed for user `7b8948513140499897efc889c8dfb741`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:51.053465 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6018c973-4a50-4c10-8ae2-0a7c85fe80ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:51.267575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 822/1652] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:50 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:51.442510 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c798e4d-e67c-43f5-a6f1-f93c9d357529 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:51.444157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0c798e4d-e67c-43f5-a6f1-f93c9d357529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:51.470697 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c798e4d-e67c-43f5-a6f1-f93c9d357529 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:51.486162 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c5595-1071-4df7-a561-97ce5c1b5c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:51.487112 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c5595-1071-4df7-a561-97ce5c1b5c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:51.487402 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c5595-1071-4df7-a561-97ce5c1b5c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:51.487683 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c5595-1071-4df7-a561-97ce5c1b5c0a admin admin] PATH_INFO: `/v3/projects/8f1b283588524a3081f31f8eb08b55d1` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:51.491773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c5595-1071-4df7-a561-97ce5c1b5c0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f1b283588524a3081f31f8eb08b55d1)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:51.497221 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c5595-1071-4df7-a561-97ce5c1b5c0a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:51.746764 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-305c5595-1071-4df7-a561-97ce5c1b5c0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f1b283588524a3081f31f8eb08b55d1', 'request_id': 'req-305c5595-1071-4df7-a561-97ce5c1b5c0a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:51.764489 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-305c5595-1071-4df7-a561-97ce5c1b5c0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f1b283588524a3081f31f8eb08b55d1', 'request_id': 'req-305c5595-1071-4df7-a561-97ce5c1b5c0a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:51.775911 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-305c5595-1071-4df7-a561-97ce5c1b5c0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f1b283588524a3081f31f8eb08b55d1', 'request_id': 'req-305c5595-1071-4df7-a561-97ce5c1b5c0a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:51.969322 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-305c5595-1071-4df7-a561-97ce5c1b5c0a admin admin] The token cache is being invalidate because project 8f1b283588524a3081f31f8eb08b55d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:36:51.970536 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-305c5595-1071-4df7-a561-97ce5c1b5c0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:51.977102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-305c5595-1071-4df7-a561-97ce5c1b5c0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:51.987068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 831/1653] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:36:51 2022] DELETE /identity/v3/projects/8f1b283588524a3081f31f8eb08b55d1 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:51.992889 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ac30c-4c99-43e7-a356-bb1d91511589 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:51.993750 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ac30c-4c99-43e7-a356-bb1d91511589 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:51.994170 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ac30c-4c99-43e7-a356-bb1d91511589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:52.017891 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-f51ac30c-4c99-43e7-a356-bb1d91511589 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:52.019496 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f51ac30c-4c99-43e7-a356-bb1d91511589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:52.067688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c5595-1071-4df7-a561-97ce5c1b5c0a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:52.069356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-305c5595-1071-4df7-a561-97ce5c1b5c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:52.195906 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 823/1654] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:52.204435 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f13e59-bed2-4e07-8187-39b4ef386f6c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:52.204767 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f13e59-bed2-4e07-8187-39b4ef386f6c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:52.205048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f13e59-bed2-4e07-8187-39b4ef386f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:52.225363 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c5595-1071-4df7-a561-97ce5c1b5c0a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:52.235261 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-82f13e59-bed2-4e07-8187-39b4ef386f6c None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:52.235743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392ba0d-03b9-4c8d-90be-307e79791181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:52.236977 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-82f13e59-bed2-4e07-8187-39b4ef386f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:52.237330 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392ba0d-03b9-4c8d-90be-307e79791181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:52.237687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392ba0d-03b9-4c8d-90be-307e79791181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:52.238079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392ba0d-03b9-4c8d-90be-307e79791181 admin admin] PATH_INFO: `/v3/projects/891ef5df61be4390b01531158f6ae274` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:52.239771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392ba0d-03b9-4c8d-90be-307e79791181 admin admin] RBAC: Authorizing `identity:delete_project(project_id=891ef5df61be4390b01531158f6ae274)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:52.242150 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392ba0d-03b9-4c8d-90be-307e79791181 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:52.247345 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 824/1655] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:36:52.251256 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f13e59-bed2-4e07-8187-39b4ef386f6c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:52.285543 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f13e59-bed2-4e07-8187-39b4ef386f6c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:52.291377 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efb948-6063-4792-9cd6-1171790875ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:52.292292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efb948-6063-4792-9cd6-1171790875ed admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:52.292742 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efb948-6063-4792-9cd6-1171790875ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:52.293156 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efb948-6063-4792-9cd6-1171790875ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:52.295486 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efb948-6063-4792-9cd6-1171790875ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:36:52.295937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efb948-6063-4792-9cd6-1171790875ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:52.298180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91efb948-6063-4792-9cd6-1171790875ed admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:52.313372 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 825/1656] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:36:52.329886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efb948-6063-4792-9cd6-1171790875ed admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:52.355942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efb948-6063-4792-9cd6-1171790875ed admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:52.368589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fb37a-3c33-47b9-980f-55b45f854c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:52.370630 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fb37a-3c33-47b9-980f-55b45f854c46 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:52.371246 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fb37a-3c33-47b9-980f-55b45f854c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:52.372859 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476fb37a-3c33-47b9-980f-55b45f854c46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:52.378444 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fb37a-3c33-47b9-980f-55b45f854c46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:52.381211 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476fb37a-3c33-47b9-980f-55b45f854c46 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:52.462022 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e392ba0d-03b9-4c8d-90be-307e79791181 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '891ef5df61be4390b01531158f6ae274', 'request_id': 'req-e392ba0d-03b9-4c8d-90be-307e79791181'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:52.473149 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e392ba0d-03b9-4c8d-90be-307e79791181 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '891ef5df61be4390b01531158f6ae274', 'request_id': 'req-e392ba0d-03b9-4c8d-90be-307e79791181'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:52.484547 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e392ba0d-03b9-4c8d-90be-307e79791181 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '891ef5df61be4390b01531158f6ae274', 'request_id': 'req-e392ba0d-03b9-4c8d-90be-307e79791181'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:52.528446 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 826/1657] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:36:52 2022] POST /identity/v3/projects => generated 371 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:36:52.533041 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fb37a-3c33-47b9-980f-55b45f854c46 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:52.634227 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e392ba0d-03b9-4c8d-90be-307e79791181 admin admin] The token cache is being invalidate because project 891ef5df61be4390b01531158f6ae274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:36:52.634521 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e392ba0d-03b9-4c8d-90be-307e79791181 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:52.641126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e392ba0d-03b9-4c8d-90be-307e79791181 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:52.645964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 832/1658] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:36:52 2022] DELETE /identity/v3/projects/891ef5df61be4390b01531158f6ae274 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:52.651007 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c70238-60bc-45f5-b232-a647c2cae511 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:52.651296 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c70238-60bc-45f5-b232-a647c2cae511 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:52.651576 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c70238-60bc-45f5-b232-a647c2cae511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:52.702184 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-33c70238-60bc-45f5-b232-a647c2cae511 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:52.725074 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-33c70238-60bc-45f5-b232-a647c2cae511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:52.753639 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476fb37a-3c33-47b9-980f-55b45f854c46 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:52.766171 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 833/1659] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:52.767667 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0781c-7071-45d8-9cd3-f4d9021320ca None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:52.770461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0781c-7071-45d8-9cd3-f4d9021320ca None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:52.772167 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc0781c-7071-45d8-9cd3-f4d9021320ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:52.775149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b33eab-79e4-480b-8ca3-935fc51497e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:52.777491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b33eab-79e4-480b-8ca3-935fc51497e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:52.782869 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b33eab-79e4-480b-8ca3-935fc51497e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:52.783414 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b33eab-79e4-480b-8ca3-935fc51497e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:52.784780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b33eab-79e4-480b-8ca3-935fc51497e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:52.803496 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b33eab-79e4-480b-8ca3-935fc51497e5 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:52.835635 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3fc0781c-7071-45d8-9cd3-f4d9021320ca None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:52.837101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3fc0781c-7071-45d8-9cd3-f4d9021320ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:52.850206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 834/1660] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:52.851308 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0781c-7071-45d8-9cd3-f4d9021320ca None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:52.863110 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc0781c-7071-45d8-9cd3-f4d9021320ca None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:52.869937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b87567-385e-46c7-9a77-de0a53825802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:52.870911 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b87567-385e-46c7-9a77-de0a53825802 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:52.871210 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b87567-385e-46c7-9a77-de0a53825802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:52.871751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b87567-385e-46c7-9a77-de0a53825802 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:52.875335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b87567-385e-46c7-9a77-de0a53825802 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:36:52.875762 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b87567-385e-46c7-9a77-de0a53825802 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:52.878151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b87567-385e-46c7-9a77-de0a53825802 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:52.903689 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 835/1661] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:36:52.905207 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b87567-385e-46c7-9a77-de0a53825802 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:52.937320 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 827/1662] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:36:52 2022] POST /identity/v3/users => generated 286 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:36:52.938489 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b33eab-79e4-480b-8ca3-935fc51497e5 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:52.941091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-41b33eab-79e4-480b-8ca3-935fc51497e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:52.947331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b87567-385e-46c7-9a77-de0a53825802 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:52.961666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b95c6c-a06a-4c97-ba28-c1092e75d9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:52.962953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b95c6c-a06a-4c97-ba28-c1092e75d9d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:52.963492 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b95c6c-a06a-4c97-ba28-c1092e75d9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:52.963785 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b95c6c-a06a-4c97-ba28-c1092e75d9d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:52.964585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b95c6c-a06a-4c97-ba28-c1092e75d9d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:52.972768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b95c6c-a06a-4c97-ba28-c1092e75d9d0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:52.979674 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b33eab-79e4-480b-8ca3-935fc51497e5 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:52.998469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dab44-708a-4a5f-8e84-c1d282dcc5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:52.999283 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dab44-708a-4a5f-8e84-c1d282dcc5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:52.999645 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dab44-708a-4a5f-8e84-c1d282dcc5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:53.002958 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4dab44-708a-4a5f-8e84-c1d282dcc5e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:53.003923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4dab44-708a-4a5f-8e84-c1d282dcc5e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:53.005624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4dab44-708a-4a5f-8e84-c1d282dcc5e6 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:53.049301 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 828/1663] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:53.054002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dab44-708a-4a5f-8e84-c1d282dcc5e6 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:53.082363 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4dab44-708a-4a5f-8e84-c1d282dcc5e6 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:53.099736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a41c37-86a3-4850-ae4b-4efeb05c75a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:53.100609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a41c37-86a3-4850-ae4b-4efeb05c75a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:53.104757 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a41c37-86a3-4850-ae4b-4efeb05c75a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:53.105185 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a41c37-86a3-4850-ae4b-4efeb05c75a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:53.117532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a41c37-86a3-4850-ae4b-4efeb05c75a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:53.124621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a41c37-86a3-4850-ae4b-4efeb05c75a1 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:53.125795 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 836/1664] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:36:52 2022] POST /identity/v3/projects => generated 375 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:36:53.130264 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b95c6c-a06a-4c97-ba28-c1092e75d9d0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:53.167532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 829/1665] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:53.172980 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a41c37-86a3-4850-ae4b-4efeb05c75a1 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:53.193502 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a41c37-86a3-4850-ae4b-4efeb05c75a1 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:53.320009 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b95c6c-a06a-4c97-ba28-c1092e75d9d0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:53.335088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc8a73-9bca-45af-a5e9-7f88f2c0d450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:53.336651 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc8a73-9bca-45af-a5e9-7f88f2c0d450 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:53.337057 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc8a73-9bca-45af-a5e9-7f88f2c0d450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:53.337344 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc8a73-9bca-45af-a5e9-7f88f2c0d450 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:53.338186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc8a73-9bca-45af-a5e9-7f88f2c0d450 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:53.345876 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dc8a73-9bca-45af-a5e9-7f88f2c0d450 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:53.354159 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa43eec-da07-4068-b328-1083ce1306c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:53.358751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa43eec-da07-4068-b328-1083ce1306c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:53.359261 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa43eec-da07-4068-b328-1083ce1306c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:53.359685 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa43eec-da07-4068-b328-1083ce1306c0 admin admin] PATH_INFO: `/v3/projects/450ba5c3ca6747269c941d33591e24ff/users/8b8c7165802148f2b61f64d21cb57d06/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:53.403054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa43eec-da07-4068-b328-1083ce1306c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=450ba5c3ca6747269c941d33591e24ff, user_id=8b8c7165802148f2b61f64d21cb57d06, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:53.410657 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa43eec-da07-4068-b328-1083ce1306c0 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:53.455183 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 837/1666] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:36:53 2022] POST /identity/v3/users => generated 288 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:36:53.456045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc8a73-9bca-45af-a5e9-7f88f2c0d450 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:53.493785 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:53.496718 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dc8a73-9bca-45af-a5e9-7f88f2c0d450 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:53.521645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90341cc3-e567-488d-bb5a-ae4798b394cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:53.522377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90341cc3-e567-488d-bb5a-ae4798b394cf admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:53.522873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90341cc3-e567-488d-bb5a-ae4798b394cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:53.523694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90341cc3-e567-488d-bb5a-ae4798b394cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:53.525313 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90341cc3-e567-488d-bb5a-ae4798b394cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:53.528268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90341cc3-e567-488d-bb5a-ae4798b394cf admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:53.532665 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 830/1667] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:36:53 2022] PUT /identity/v3/projects/450ba5c3ca6747269c941d33591e24ff/users/8b8c7165802148f2b61f64d21cb57d06/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:53.543066 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f89a87-bfb2-4316-8c5f-52a183e3b895 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:53.543485 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f89a87-bfb2-4316-8c5f-52a183e3b895 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:53.543846 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f89a87-bfb2-4316-8c5f-52a183e3b895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:53.567386 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 838/1668] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:53.571746 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90341cc3-e567-488d-bb5a-ae4798b394cf admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:53.577283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-90341cc3-e567-488d-bb5a-ae4798b394cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:53.611961 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-e1f89a87-bfb2-4316-8c5f-52a183e3b895 None None] MFA Rules not processed for user `8b8c7165802148f2b61f64d21cb57d06`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:53.615306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90341cc3-e567-488d-bb5a-ae4798b394cf admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:53.619518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e1f89a87-bfb2-4316-8c5f-52a183e3b895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:53.664877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:53.734977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd3837-119e-403d-8cd4-772b916da52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:53.739333 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd3837-119e-403d-8cd4-772b916da52c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:53.739660 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd3837-119e-403d-8cd4-772b916da52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:53.739948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd3837-119e-403d-8cd4-772b916da52c admin admin] PATH_INFO: `/v3/users/425b75e3ecef458fad477092c6d51dd1` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:53.756020 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd3837-119e-403d-8cd4-772b916da52c admin admin] RBAC: Authorizing `identity:delete_user(user_id=425b75e3ecef458fad477092c6d51dd1)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:53.764781 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd3837-119e-403d-8cd4-772b916da52c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:53.820640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 831/1669] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:53.820640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f89a87-bfb2-4316-8c5f-52a183e3b895 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:53.842749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f89a87-bfb2-4316-8c5f-52a183e3b895 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:53.851914 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e66ae8-8189-4cd5-b319-cd560dff9df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:53.853479 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e66ae8-8189-4cd5-b319-cd560dff9df8 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:53.853479 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e66ae8-8189-4cd5-b319-cd560dff9df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:53.853663 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e66ae8-8189-4cd5-b319-cd560dff9df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:53.856848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e66ae8-8189-4cd5-b319-cd560dff9df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:53.858545 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e66ae8-8189-4cd5-b319-cd560dff9df8 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:53.886689 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 832/1670] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:53.887808 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e66ae8-8189-4cd5-b319-cd560dff9df8 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:53.913547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e66ae8-8189-4cd5-b319-cd560dff9df8 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:53.922288 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62466028-1135-4d70-ac69-80ac33e61183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:53.923145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62466028-1135-4d70-ac69-80ac33e61183 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:53.923537 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62466028-1135-4d70-ac69-80ac33e61183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:53.923968 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62466028-1135-4d70-ac69-80ac33e61183 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:53.924805 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62466028-1135-4d70-ac69-80ac33e61183 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:53.930246 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62466028-1135-4d70-ac69-80ac33e61183 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:54.050618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f1cd3837-119e-403d-8cd4-772b916da52c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '425b75e3ecef458fad477092c6d51dd1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:54.051472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f1cd3837-119e-403d-8cd4-772b916da52c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '425b75e3ecef458fad477092c6d51dd1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:54.051952 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f1cd3837-119e-403d-8cd4-772b916da52c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '425b75e3ecef458fad477092c6d51dd1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:54.073436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f1cd3837-119e-403d-8cd4-772b916da52c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '425b75e3ecef458fad477092c6d51dd1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:54.120319 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 833/1671] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:36:53 2022] POST /identity/v3/projects => generated 373 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:36:54.120319 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62466028-1135-4d70-ac69-80ac33e61183 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:54.122030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-62466028-1135-4d70-ac69-80ac33e61183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:54.181686 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f1cd3837-119e-403d-8cd4-772b916da52c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '425b75e3ecef458fad477092c6d51dd1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:54.208511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 839/1672] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:36:53 2022] DELETE /identity/v3/users/425b75e3ecef458fad477092c6d51dd1 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:54.208511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fc90e-b04b-465b-a318-9aa9d537f78b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:54.208511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fc90e-b04b-465b-a318-9aa9d537f78b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:54.208511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9fc90e-b04b-465b-a318-9aa9d537f78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:54.269030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62466028-1135-4d70-ac69-80ac33e61183 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:54.270404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-fb9fc90e-b04b-465b-a318-9aa9d537f78b None None] MFA Rules not processed for user `6673e93e63fc4e0bb47a7ca7c3fd4a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:54.271742 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fb9fc90e-b04b-465b-a318-9aa9d537f78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:54.350655 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023887e-b84b-46e8-8893-57bdcbbb499c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:54.351614 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023887e-b84b-46e8-8893-57bdcbbb499c admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:54.352458 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023887e-b84b-46e8-8893-57bdcbbb499c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:54.352809 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023887e-b84b-46e8-8893-57bdcbbb499c admin admin] PATH_INFO: `/v3/projects/676c84d5459a44e6a2e29ddc95d64648/users/fcea2c645d6c450b9251923b614a6b18/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:54.388905 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023887e-b84b-46e8-8893-57bdcbbb499c admin admin] RBAC: Authorizing `identity:create_grant(project_id=676c84d5459a44e6a2e29ddc95d64648, user_id=fcea2c645d6c450b9251923b614a6b18, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:54.392763 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023887e-b84b-46e8-8893-57bdcbbb499c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:54.403714 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 840/1673] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:54.404767 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fc90e-b04b-465b-a318-9aa9d537f78b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:54.415223 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fb9fc90e-b04b-465b-a318-9aa9d537f78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:54.444089 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9fc90e-b04b-465b-a318-9aa9d537f78b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:54.451112 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c23cc06-2317-4cdb-890f-d665dc6a0322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:54.451901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23cc06-2317-4cdb-890f-d665dc6a0322 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:54.452210 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23cc06-2317-4cdb-890f-d665dc6a0322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:54.452485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c23cc06-2317-4cdb-890f-d665dc6a0322 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:54.454014 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23cc06-2317-4cdb-890f-d665dc6a0322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:54.456233 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c23cc06-2317-4cdb-890f-d665dc6a0322 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:54.559224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 834/1674] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:36:54 2022] PUT /identity/v3/projects/676c84d5459a44e6a2e29ddc95d64648/users/fcea2c645d6c450b9251923b614a6b18/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:54.561831 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e2ee6-7102-4eb1-8b4e-0ee16e97ae81 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:54.562122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e2ee6-7102-4eb1-8b4e-0ee16e97ae81 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:54.562461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11e2ee6-7102-4eb1-8b4e-0ee16e97ae81 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:54.569092 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 835/1675] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jul 18 02:36:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:36:54.571922 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b1d42-e9eb-48c3-8480-a08f62c3b514 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:54.573745 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b1d42-e9eb-48c3-8480-a08f62c3b514 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:54.574067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b1d42-e9eb-48c3-8480-a08f62c3b514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:54.577206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 841/1676] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:36:54 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:36:54.578423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33519abf-4d75-4a62-b9e2-e1cb1924e8c3 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:54.578935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33519abf-4d75-4a62-b9e2-e1cb1924e8c3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:54.580364 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33519abf-4d75-4a62-b9e2-e1cb1924e8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:54.604374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-33519abf-4d75-4a62-b9e2-e1cb1924e8c3 None None] MFA Rules not processed for user `6673e93e63fc4e0bb47a7ca7c3fd4a18`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:54.604374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-33519abf-4d75-4a62-b9e2-e1cb1924e8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:54.631285 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-862b1d42-e9eb-48c3-8480-a08f62c3b514 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:54.640034 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-862b1d42-e9eb-48c3-8480-a08f62c3b514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:54.755130 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 842/1677] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:54.758803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee9b33-5e8d-44c0-8e46-75fe95f4e730 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:54.759304 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee9b33-5e8d-44c0-8e46-75fe95f4e730 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:54.769369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:54.773639 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 836/1678] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:54.773822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee9b33-5e8d-44c0-8e46-75fe95f4e730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:54.774666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b1d42-e9eb-48c3-8480-a08f62c3b514 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:54.797220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862b1d42-e9eb-48c3-8480-a08f62c3b514 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:54.804659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3758d725-8aec-4863-8897-b710ff668621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:54.805837 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758d725-8aec-4863-8897-b710ff668621 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:54.806195 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758d725-8aec-4863-8897-b710ff668621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:54.807159 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3758d725-8aec-4863-8897-b710ff668621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:54.808025 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758d725-8aec-4863-8897-b710ff668621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:54.809977 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3758d725-8aec-4863-8897-b710ff668621 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:54.823823 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f8ee9b33-5e8d-44c0-8e46-75fe95f4e730 None None] MFA Rules not processed for user `fcea2c645d6c450b9251923b614a6b18`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:54.825679 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f8ee9b33-5e8d-44c0-8e46-75fe95f4e730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:54.826743 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 837/1679] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:54.828085 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3764cdd-caaa-40be-98e9-f435a5147ec7 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:54.828428 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3764cdd-caaa-40be-98e9-f435a5147ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:54.829616 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3764cdd-caaa-40be-98e9-f435a5147ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:54.855846 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a3764cdd-caaa-40be-98e9-f435a5147ec7 None None] MFA Rules not processed for user `213ba948a3f34c39bce3f6db093479eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:54.857818 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a3764cdd-caaa-40be-98e9-f435a5147ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:54.994381 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 843/1680] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:54.995461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee9b33-5e8d-44c0-8e46-75fe95f4e730 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:54.997954 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f8ee9b33-5e8d-44c0-8e46-75fe95f4e730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:55.027539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 838/1681] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jul 18 02:36:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:55.031897 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3764cdd-caaa-40be-98e9-f435a5147ec7 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:55.034062 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a3764cdd-caaa-40be-98e9-f435a5147ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:55.162871 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee9b33-5e8d-44c0-8e46-75fe95f4e730 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:55.181743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f4631-2279-4c6e-aea4-ed7f2f9cbcb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:55.182850 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f4631-2279-4c6e-aea4-ed7f2f9cbcb9 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:55.183374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f4631-2279-4c6e-aea4-ed7f2f9cbcb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:55.183889 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f4631-2279-4c6e-aea4-ed7f2f9cbcb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:55.197185 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3764cdd-caaa-40be-98e9-f435a5147ec7 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:55.208439 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f4631-2279-4c6e-aea4-ed7f2f9cbcb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:55.209353 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015a934-254e-4eda-97d7-a794c7dc2fac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:55.210120 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f4631-2279-4c6e-aea4-ed7f2f9cbcb9 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:55.210431 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015a934-254e-4eda-97d7-a794c7dc2fac service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:55.210859 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015a934-254e-4eda-97d7-a794c7dc2fac service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:55.211554 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a015a934-254e-4eda-97d7-a794c7dc2fac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:55.236128 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015a934-254e-4eda-97d7-a794c7dc2fac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:55.237365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 844/1682] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:36:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:36:55.238663 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a015a934-254e-4eda-97d7-a794c7dc2fac service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:55.246588 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f4631-2279-4c6e-aea4-ed7f2f9cbcb9 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:55.259621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 839/1683] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:36:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:36:55.260734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015a934-254e-4eda-97d7-a794c7dc2fac service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:55.265001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f4631-2279-4c6e-aea4-ed7f2f9cbcb9 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:55.265975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a015a934-254e-4eda-97d7-a794c7dc2fac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:55.277439 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b964f8f-cf39-44ee-bb15-0c5535ff5809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:55.279791 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b964f8f-cf39-44ee-bb15-0c5535ff5809 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:55.279791 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b964f8f-cf39-44ee-bb15-0c5535ff5809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:55.280008 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b964f8f-cf39-44ee-bb15-0c5535ff5809 admin admin] PATH_INFO: `/v3/projects/ef830e8e94c14ee498a0218fda8710eb/users/8db367a357bb46c38cb6803aa8070635/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:55.299216 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a015a934-254e-4eda-97d7-a794c7dc2fac service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:55.314286 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2ade5-2501-4e75-8335-febcf6f8ad26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:55.317145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2ade5-2501-4e75-8335-febcf6f8ad26 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:55.318236 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b964f8f-cf39-44ee-bb15-0c5535ff5809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef830e8e94c14ee498a0218fda8710eb, user_id=8db367a357bb46c38cb6803aa8070635, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:55.318702 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2ade5-2501-4e75-8335-febcf6f8ad26 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:55.319168 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2ade5-2501-4e75-8335-febcf6f8ad26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:55.329299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b964f8f-cf39-44ee-bb15-0c5535ff5809 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:55.350769 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2ade5-2501-4e75-8335-febcf6f8ad26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:55.352826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2ade5-2501-4e75-8335-febcf6f8ad26 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:55.367070 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 840/1684] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:36:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:36:55.369334 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb024a9b-c71c-40b6-b9c8-5ca8f1785083 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:55.369955 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb024a9b-c71c-40b6-b9c8-5ca8f1785083 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:55.370363 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb024a9b-c71c-40b6-b9c8-5ca8f1785083 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:55.372490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 841/1685] 10.222.0.64 () {54 vars in 961 bytes} [Mon Jul 18 02:36:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:36:55.378863 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c147765-89f5-4e11-9473-4030f3adfaf5 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:55.379202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c147765-89f5-4e11-9473-4030f3adfaf5 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:55.379543 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c147765-89f5-4e11-9473-4030f3adfaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:55.426894 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-5c147765-89f5-4e11-9473-4030f3adfaf5 None None] MFA Rules not processed for user `213ba948a3f34c39bce3f6db093479eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:55.429771 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5c147765-89f5-4e11-9473-4030f3adfaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:55.451227 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 845/1686] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:36:55 2022] PUT /identity/v3/projects/ef830e8e94c14ee498a0218fda8710eb/users/8db367a357bb46c38cb6803aa8070635/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:55.452839 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b964f8f-cf39-44ee-bb15-0c5535ff5809 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:55.564637 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:55.690891 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 842/1687] 10.222.0.64 () {58 vars in 1058 bytes} [Mon Jul 18 02:36:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:55.691822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c147765-89f5-4e11-9473-4030f3adfaf5 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:55.694921 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b964f8f-cf39-44ee-bb15-0c5535ff5809 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:55.714068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90674381-5e1f-40dd-b006-71deff76b04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:55.714068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90674381-5e1f-40dd-b006-71deff76b04f admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:55.714498 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90674381-5e1f-40dd-b006-71deff76b04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:55.714744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90674381-5e1f-40dd-b006-71deff76b04f admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:55.716496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90674381-5e1f-40dd-b006-71deff76b04f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:55.720810 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90674381-5e1f-40dd-b006-71deff76b04f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:55.726042 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c147765-89f5-4e11-9473-4030f3adfaf5 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:55.754679 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ccbea-aae2-453e-93b4-aff08b8c7aa6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '213ba948a3f34c39bce3f6db093479eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:55.754679 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ccbea-aae2-453e-93b4-aff08b8c7aa6 service placement] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:55.754679 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ccbea-aae2-453e-93b4-aff08b8c7aa6 service placement] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:55.754679 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ccbea-aae2-453e-93b4-aff08b8c7aa6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:55.761153 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ccbea-aae2-453e-93b4-aff08b8c7aa6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:55.762873 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ccbea-aae2-453e-93b4-aff08b8c7aa6 service placement] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:55.788886 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 846/1688] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:36:55.790245 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90674381-5e1f-40dd-b006-71deff76b04f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:55.796205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 843/1689] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:36:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:36:55.797240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ccbea-aae2-453e-93b4-aff08b8c7aa6 service placement] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:55.818071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90674381-5e1f-40dd-b006-71deff76b04f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:55.828478 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266b93f-5b41-40b9-91dc-eca3ebf1c76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:55.829636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266b93f-5b41-40b9-91dc-eca3ebf1c76b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:55.829976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266b93f-5b41-40b9-91dc-eca3ebf1c76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:55.830242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266b93f-5b41-40b9-91dc-eca3ebf1c76b admin admin] PATH_INFO: `/v3/users/fcea2c645d6c450b9251923b614a6b18` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:55.831996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266b93f-5b41-40b9-91dc-eca3ebf1c76b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcea2c645d6c450b9251923b614a6b18)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:55.834176 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266b93f-5b41-40b9-91dc-eca3ebf1c76b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:55.836537 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:55.840089 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ccbea-aae2-453e-93b4-aff08b8c7aa6 service placement] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:55.862397 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2323d9f-e6c9-4162-8f43-3d51bdb21499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:55.863430 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2323d9f-e6c9-4162-8f43-3d51bdb21499 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:55.863720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2323d9f-e6c9-4162-8f43-3d51bdb21499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:55.864005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2323d9f-e6c9-4162-8f43-3d51bdb21499 admin admin] PATH_INFO: `/v3/projects/ef830e8e94c14ee498a0218fda8710eb/users/8db367a357bb46c38cb6803aa8070635/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:55.879374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2323d9f-e6c9-4162-8f43-3d51bdb21499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef830e8e94c14ee498a0218fda8710eb, user_id=8db367a357bb46c38cb6803aa8070635, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:55.882284 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2323d9f-e6c9-4162-8f43-3d51bdb21499 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:55.905802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 844/1690] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:36:55 2022] PUT /identity/v3/projects/ef830e8e94c14ee498a0218fda8710eb/users/8db367a357bb46c38cb6803aa8070635/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:55.917332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627dc1b-f805-4e34-bbe6-29f81c3308aa None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:55.917740 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627dc1b-f805-4e34-bbe6-29f81c3308aa None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:55.918097 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627dc1b-f805-4e34-bbe6-29f81c3308aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:55.972290 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a627dc1b-f805-4e34-bbe6-29f81c3308aa None None] MFA Rules not processed for user `8db367a357bb46c38cb6803aa8070635`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:55.974521 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a627dc1b-f805-4e34-bbe6-29f81c3308aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:56.089788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 845/1691] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:36:56.092043 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816abfc-7965-495f-b99c-378a50a87312 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:56.092341 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816abfc-7965-495f-b99c-378a50a87312 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:56.092619 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816abfc-7965-495f-b99c-378a50a87312 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:56.094155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 846/1692] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jul 18 02:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:36:56.100489 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99221046-0dc5-44d2-8823-49802e7b053d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:56.105159 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99221046-0dc5-44d2-8823-49802e7b053d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:56.110844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99221046-0dc5-44d2-8823-49802e7b053d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:56.157345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0266b93f-5b41-40b9-91dc-eca3ebf1c76b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcea2c645d6c450b9251923b614a6b18'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:56.161454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0266b93f-5b41-40b9-91dc-eca3ebf1c76b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcea2c645d6c450b9251923b614a6b18'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:56.163719 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0266b93f-5b41-40b9-91dc-eca3ebf1c76b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcea2c645d6c450b9251923b614a6b18'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:56.193914 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-99221046-0dc5-44d2-8823-49802e7b053d None None] MFA Rules not processed for user `213ba948a3f34c39bce3f6db093479eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:56.197518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-99221046-0dc5-44d2-8823-49802e7b053d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:56.202076 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0266b93f-5b41-40b9-91dc-eca3ebf1c76b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcea2c645d6c450b9251923b614a6b18'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:56.300902 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0266b93f-5b41-40b9-91dc-eca3ebf1c76b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcea2c645d6c450b9251923b614a6b18'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:56.323153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 847/1693] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:36:55 2022] DELETE /identity/v3/users/fcea2c645d6c450b9251923b614a6b18 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:56.324208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266b93f-5b41-40b9-91dc-eca3ebf1c76b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:56.328226 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0266b93f-5b41-40b9-91dc-eca3ebf1c76b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:56.362393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 847/1694] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jul 18 02:36:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:56.363664 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99221046-0dc5-44d2-8823-49802e7b053d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:56.364956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-99221046-0dc5-44d2-8823-49802e7b053d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:56.428721 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266b93f-5b41-40b9-91dc-eca3ebf1c76b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:56.437178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffeb8ba-fa27-4d77-8fc0-21e4f14c18a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:56.437905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeb8ba-fa27-4d77-8fc0-21e4f14c18a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:56.438191 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeb8ba-fa27-4d77-8fc0-21e4f14c18a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:56.438611 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffeb8ba-fa27-4d77-8fc0-21e4f14c18a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:56.440545 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8ffeb8ba-fa27-4d77-8fc0-21e4f14c18a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:56.511515 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99221046-0dc5-44d2-8823-49802e7b053d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:56.543306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffeb8ba-fa27-4d77-8fc0-21e4f14c18a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:56.545216 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffeb8ba-fa27-4d77-8fc0-21e4f14c18a5 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:56.562241 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 848/1695] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:36:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:36:56.563835 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b7b1d-c681-4d05-a339-a1d805ff90be None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:56.564134 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b7b1d-c681-4d05-a339-a1d805ff90be None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:56.564414 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b7b1d-c681-4d05-a339-a1d805ff90be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:56.588831 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-4c0b7b1d-c681-4d05-a339-a1d805ff90be None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:56.590728 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4c0b7b1d-c681-4d05-a339-a1d805ff90be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:56.667213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d2089-d124-42d2-b92f-1d2fa1a64b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:56.668288 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d2089-d124-42d2-b92f-1d2fa1a64b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:56.668678 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d2089-d124-42d2-b92f-1d2fa1a64b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:56.669130 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d2089-d124-42d2-b92f-1d2fa1a64b6b admin admin] PATH_INFO: `/v3/users/1ee01dc5841e4c7dbdbba94e81ce1d84` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:56.672728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d2089-d124-42d2-b92f-1d2fa1a64b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee01dc5841e4c7dbdbba94e81ce1d84)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:56.675018 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d2089-d124-42d2-b92f-1d2fa1a64b6b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:56.694156 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 849/1696] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:56.695354 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b7b1d-c681-4d05-a339-a1d805ff90be None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:56.698388 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4c0b7b1d-c681-4d05-a339-a1d805ff90be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:56.871544 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b7b1d-c681-4d05-a339-a1d805ff90be None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:56.880421 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48173c-f67a-4aff-894f-77d34d567ff4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '213ba948a3f34c39bce3f6db093479eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:56.880740 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48173c-f67a-4aff-894f-77d34d567ff4 service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:56.881102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48173c-f67a-4aff-894f-77d34d567ff4 service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:56.881528 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f48173c-f67a-4aff-894f-77d34d567ff4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:56.896631 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48173c-f67a-4aff-894f-77d34d567ff4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:56.898673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f48173c-f67a-4aff-894f-77d34d567ff4 service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:56.912507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 850/1697] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:36:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:36:56.913471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48173c-f67a-4aff-894f-77d34d567ff4 service placement] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:56.916324 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6f48173c-f67a-4aff-894f-77d34d567ff4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:56.966615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6f0d2089-d124-42d2-b92f-1d2fa1a64b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee01dc5841e4c7dbdbba94e81ce1d84'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:56.968289 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6f0d2089-d124-42d2-b92f-1d2fa1a64b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee01dc5841e4c7dbdbba94e81ce1d84'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:56.969167 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6f0d2089-d124-42d2-b92f-1d2fa1a64b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee01dc5841e4c7dbdbba94e81ce1d84'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:57.058193 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f48173c-f67a-4aff-894f-77d34d567ff4 service placement] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:57.059413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6f0d2089-d124-42d2-b92f-1d2fa1a64b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee01dc5841e4c7dbdbba94e81ce1d84'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:57.068260 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbb1c2-f52d-4aab-a708-c3694f68ff0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:57.070587 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbb1c2-f52d-4aab-a708-c3694f68ff0b service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:57.071236 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbb1c2-f52d-4aab-a708-c3694f68ff0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:57.072197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bbb1c2-f52d-4aab-a708-c3694f68ff0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:57.077714 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-79bbb1c2-f52d-4aab-a708-c3694f68ff0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:57.099733 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bbb1c2-f52d-4aab-a708-c3694f68ff0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:57.102299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bbb1c2-f52d-4aab-a708-c3694f68ff0b service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:57.112628 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6f0d2089-d124-42d2-b92f-1d2fa1a64b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee01dc5841e4c7dbdbba94e81ce1d84'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:57.197901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 851/1698] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:36:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:36:57.197901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbb1c2-f52d-4aab-a708-c3694f68ff0b service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:57.197901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-79bbb1c2-f52d-4aab-a708-c3694f68ff0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:57.197901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bbb1c2-f52d-4aab-a708-c3694f68ff0b service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:57.200184 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee1ac9-c85f-482b-b839-17444493edfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:57.200184 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee1ac9-c85f-482b-b839-17444493edfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:57.200184 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee1ac9-c85f-482b-b839-17444493edfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:57.200184 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ee1ac9-c85f-482b-b839-17444493edfa admin admin] PATH_INFO: `/v3/projects/8678d5999bad4524bc87466918c9be1d` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:57.201046 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee1ac9-c85f-482b-b839-17444493edfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8678d5999bad4524bc87466918c9be1d)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:57.201046 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ee1ac9-c85f-482b-b839-17444493edfa admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:58.719688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 848/1699] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:36:56 2022] DELETE /identity/v3/users/1ee01dc5841e4c7dbdbba94e81ce1d84 => generated 0 bytes in 2357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:58.721293 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362443d2-eeda-4ad1-a1bf-ce900c197f78 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:58.721972 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362443d2-eeda-4ad1-a1bf-ce900c197f78 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:58.725239 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362443d2-eeda-4ad1-a1bf-ce900c197f78 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:58.725239 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 849/1700] 10.222.0.64 () {54 vars in 912 bytes} [Mon Jul 18 02:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:36:58.733144 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffc20c-d3ee-4854-a5da-d2d2a2fb9779 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:58.733614 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffc20c-d3ee-4854-a5da-d2d2a2fb9779 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:58.734106 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffc20c-d3ee-4854-a5da-d2d2a2fb9779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:58.815576 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-24ee1ac9-c85f-482b-b839-17444493edfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8678d5999bad4524bc87466918c9be1d', 'request_id': 'req-24ee1ac9-c85f-482b-b839-17444493edfa'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:58.833971 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-cbffc20c-d3ee-4854-a5da-d2d2a2fb9779 None None] MFA Rules not processed for user `fa9e6d3fe3e740e6aedab33d727ec478`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:58.835246 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cbffc20c-d3ee-4854-a5da-d2d2a2fb9779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:58.838053 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-24ee1ac9-c85f-482b-b839-17444493edfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8678d5999bad4524bc87466918c9be1d', 'request_id': 'req-24ee1ac9-c85f-482b-b839-17444493edfa'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:58.866576 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-24ee1ac9-c85f-482b-b839-17444493edfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8678d5999bad4524bc87466918c9be1d', 'request_id': 'req-24ee1ac9-c85f-482b-b839-17444493edfa'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:58.947166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:58.969031 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 850/1701] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jul 18 02:36:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:58.993204 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-24ee1ac9-c85f-482b-b839-17444493edfa admin admin] The token cache is being invalidate because project 8678d5999bad4524bc87466918c9be1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:36:58.993204 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-24ee1ac9-c85f-482b-b839-17444493edfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:58.993619 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-24ee1ac9-c85f-482b-b839-17444493edfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:58.999462 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 852/1702] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:36:57 2022] DELETE /identity/v3/projects/8678d5999bad4524bc87466918c9be1d => generated 0 bytes in 1854 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:59.004162 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41920b90-4c9d-43b5-857e-56df51aa27a8 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:59.004508 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41920b90-4c9d-43b5-857e-56df51aa27a8 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:59.004797 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41920b90-4c9d-43b5-857e-56df51aa27a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:59.036596 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee1ac9-c85f-482b-b839-17444493edfa admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:59.038396 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-24ee1ac9-c85f-482b-b839-17444493edfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:59.058914 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-41920b90-4c9d-43b5-857e-56df51aa27a8 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:59.064223 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-41920b90-4c9d-43b5-857e-56df51aa27a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:59.067749 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ee1ac9-c85f-482b-b839-17444493edfa admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:59.083425 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27935e-4a0f-4a1c-8d0e-73a084b20dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:59.085511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27935e-4a0f-4a1c-8d0e-73a084b20dcf service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:59.086239 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27935e-4a0f-4a1c-8d0e-73a084b20dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:59.087085 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27935e-4a0f-4a1c-8d0e-73a084b20dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:59.092266 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cd27935e-4a0f-4a1c-8d0e-73a084b20dcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:59.151792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27935e-4a0f-4a1c-8d0e-73a084b20dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:59.158878 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27935e-4a0f-4a1c-8d0e-73a084b20dcf service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:59.194337 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 853/1703] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:36:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:36:59.292303 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e6e58-f587-4a19-8ae1-841f7fabbe0f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:59.296521 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e6e58-f587-4a19-8ae1-841f7fabbe0f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:59.296521 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e6e58-f587-4a19-8ae1-841f7fabbe0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:59.296746 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 851/1704] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:59.362019 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:59.364540 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41920b90-4c9d-43b5-857e-56df51aa27a8 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:59.366002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-41920b90-4c9d-43b5-857e-56df51aa27a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:59.368507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e08e6e58-f587-4a19-8ae1-841f7fabbe0f None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:36:59.371438 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e08e6e58-f587-4a19-8ae1-841f7fabbe0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:59.391360 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41920b90-4c9d-43b5-857e-56df51aa27a8 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:59.398812 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b534ac-3184-4a41-bf9d-8fe9697f35f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:59.399697 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b534ac-3184-4a41-bf9d-8fe9697f35f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:59.400020 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b534ac-3184-4a41-bf9d-8fe9697f35f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:59.400623 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b534ac-3184-4a41-bf9d-8fe9697f35f1 admin admin] PATH_INFO: `/v3/projects/bc26a58802fe4d05ac7b64745c1838fc` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:59.405920 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b534ac-3184-4a41-bf9d-8fe9697f35f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc26a58802fe4d05ac7b64745c1838fc)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:59.407917 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b534ac-3184-4a41-bf9d-8fe9697f35f1 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:59.417407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 854/1705] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:36:59.423260 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e6e58-f587-4a19-8ae1-841f7fabbe0f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:59.448019 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e6e58-f587-4a19-8ae1-841f7fabbe0f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:59.477516 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62cf76-ef03-4c83-9ab1-f97df53f2e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:59.482627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62cf76-ef03-4c83-9ab1-f97df53f2e63 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:59.482627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62cf76-ef03-4c83-9ab1-f97df53f2e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:59.482627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e62cf76-ef03-4c83-9ab1-f97df53f2e63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:59.482627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62cf76-ef03-4c83-9ab1-f97df53f2e63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:36:59.482627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62cf76-ef03-4c83-9ab1-f97df53f2e63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:59.489184 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e62cf76-ef03-4c83-9ab1-f97df53f2e63 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:59.541968 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 855/1706] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:36:59.545003 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62cf76-ef03-4c83-9ab1-f97df53f2e63 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:59.550315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7e62cf76-ef03-4c83-9ab1-f97df53f2e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:59.582648 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e62cf76-ef03-4c83-9ab1-f97df53f2e63 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:59.588996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7187c38-11ec-438d-bbd0-317b9462422c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:36:59.590278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7187c38-11ec-438d-bbd0-317b9462422c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:36:59.591708 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7187c38-11ec-438d-bbd0-317b9462422c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:36:59.592197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7187c38-11ec-438d-bbd0-317b9462422c admin admin] PATH_INFO: `/v3/projects/676c84d5459a44e6a2e29ddc95d64648` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:36:59.596715 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7187c38-11ec-438d-bbd0-317b9462422c admin admin] RBAC: Authorizing `identity:delete_project(project_id=676c84d5459a44e6a2e29ddc95d64648)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:36:59.603179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7187c38-11ec-438d-bbd0-317b9462422c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:36:59.637520 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-65b534ac-3184-4a41-bf9d-8fe9697f35f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc26a58802fe4d05ac7b64745c1838fc', 'request_id': 'req-65b534ac-3184-4a41-bf9d-8fe9697f35f1'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:59.645328 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-65b534ac-3184-4a41-bf9d-8fe9697f35f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc26a58802fe4d05ac7b64745c1838fc', 'request_id': 'req-65b534ac-3184-4a41-bf9d-8fe9697f35f1'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:59.655479 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-65b534ac-3184-4a41-bf9d-8fe9697f35f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc26a58802fe4d05ac7b64745c1838fc', 'request_id': 'req-65b534ac-3184-4a41-bf9d-8fe9697f35f1'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:59.751112 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-65b534ac-3184-4a41-bf9d-8fe9697f35f1 admin admin] The token cache is being invalidate because project bc26a58802fe4d05ac7b64745c1838fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:36:59.751758 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-65b534ac-3184-4a41-bf9d-8fe9697f35f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:59.752830 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-65b534ac-3184-4a41-bf9d-8fe9697f35f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:59.758406 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 852/1707] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:36:59 2022] DELETE /identity/v3/projects/bc26a58802fe4d05ac7b64745c1838fc => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:36:59.759381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b534ac-3184-4a41-bf9d-8fe9697f35f1 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:59.761645 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-65b534ac-3184-4a41-bf9d-8fe9697f35f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:36:59.777911 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d7187c38-11ec-438d-bbd0-317b9462422c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '676c84d5459a44e6a2e29ddc95d64648', 'request_id': 'req-d7187c38-11ec-438d-bbd0-317b9462422c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:59.785897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d7187c38-11ec-438d-bbd0-317b9462422c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '676c84d5459a44e6a2e29ddc95d64648', 'request_id': 'req-d7187c38-11ec-438d-bbd0-317b9462422c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:59.802304 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d7187c38-11ec-438d-bbd0-317b9462422c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '676c84d5459a44e6a2e29ddc95d64648', 'request_id': 'req-d7187c38-11ec-438d-bbd0-317b9462422c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:59.817756 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:36:59.880849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b534ac-3184-4a41-bf9d-8fe9697f35f1 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:36:59.887049 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d7187c38-11ec-438d-bbd0-317b9462422c admin admin] The token cache is being invalidate because project 676c84d5459a44e6a2e29ddc95d64648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:36:59.887049 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d7187c38-11ec-438d-bbd0-317b9462422c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:59.887049 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d7187c38-11ec-438d-bbd0-317b9462422c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:36:59.895577 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 856/1708] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:36:59 2022] DELETE /identity/v3/projects/676c84d5459a44e6a2e29ddc95d64648 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:36:59.897464 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7187c38-11ec-438d-bbd0-317b9462422c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:36:59.899972 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d7187c38-11ec-438d-bbd0-317b9462422c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:00.073268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7187c38-11ec-438d-bbd0-317b9462422c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:00.079916 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c7255-1629-4625-9311-44995c812ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:00.080626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c7255-1629-4625-9311-44995c812ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:00.080915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c7255-1629-4625-9311-44995c812ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:00.081200 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c7255-1629-4625-9311-44995c812ed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:00.084623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0c89e-afbc-4024-805c-67a3da479263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:00.085599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0c89e-afbc-4024-805c-67a3da479263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:00.085928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0c89e-afbc-4024-805c-67a3da479263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:00.086214 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0c89e-afbc-4024-805c-67a3da479263 admin admin] PATH_INFO: `/v3/users/8b8c7165802148f2b61f64d21cb57d06` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:00.087418 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c7255-1629-4625-9311-44995c812ed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:00.089548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c7255-1629-4625-9311-44995c812ed5 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:00.096854 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0c89e-afbc-4024-805c-67a3da479263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b8c7165802148f2b61f64d21cb57d06)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:00.098943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0c89e-afbc-4024-805c-67a3da479263 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:00.259407 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 853/1709] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:36:59 2022] POST /identity/v3/projects => generated 369 bytes in 497 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:00.259407 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c7255-1629-4625-9311-44995c812ed5 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:00.260966 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-516c7255-1629-4625-9311-44995c812ed5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:00.383140 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-40e0c89e-afbc-4024-805c-67a3da479263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b8c7165802148f2b61f64d21cb57d06'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:00.384245 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-40e0c89e-afbc-4024-805c-67a3da479263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b8c7165802148f2b61f64d21cb57d06'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:00.386084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-40e0c89e-afbc-4024-805c-67a3da479263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b8c7165802148f2b61f64d21cb57d06'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:00.422245 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-40e0c89e-afbc-4024-805c-67a3da479263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b8c7165802148f2b61f64d21cb57d06'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:00.442346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c7255-1629-4625-9311-44995c812ed5 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:00.455854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac774c8c-19f9-45a9-9bb6-1566cac5eda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:00.459536 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac774c8c-19f9-45a9-9bb6-1566cac5eda4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:00.459845 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac774c8c-19f9-45a9-9bb6-1566cac5eda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:00.462361 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac774c8c-19f9-45a9-9bb6-1566cac5eda4 admin admin] PATH_INFO: `/v3/users/7b8948513140499897efc889c8dfb741` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:00.464611 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac774c8c-19f9-45a9-9bb6-1566cac5eda4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b8948513140499897efc889c8dfb741)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:00.467981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac774c8c-19f9-45a9-9bb6-1566cac5eda4 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:00.558351 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-40e0c89e-afbc-4024-805c-67a3da479263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b8c7165802148f2b61f64d21cb57d06'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:00.593335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 857/1710] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:36:59 2022] DELETE /identity/v3/users/8b8c7165802148f2b61f64d21cb57d06 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:00.594664 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc268e85-d1fe-486b-9d47-7856f2bcf140 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:00.598612 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc268e85-d1fe-486b-9d47-7856f2bcf140 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:00.598612 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc268e85-d1fe-486b-9d47-7856f2bcf140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:00.633488 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-dc268e85-d1fe-486b-9d47-7856f2bcf140 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:00.634892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-dc268e85-d1fe-486b-9d47-7856f2bcf140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:00.714862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 858/1711] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:00.716201 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc268e85-d1fe-486b-9d47-7856f2bcf140 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:00.718003 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-dc268e85-d1fe-486b-9d47-7856f2bcf140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:00.726038 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ac774c8c-19f9-45a9-9bb6-1566cac5eda4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b8948513140499897efc889c8dfb741'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:00.727753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ac774c8c-19f9-45a9-9bb6-1566cac5eda4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b8948513140499897efc889c8dfb741'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:00.729271 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ac774c8c-19f9-45a9-9bb6-1566cac5eda4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b8948513140499897efc889c8dfb741'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:00.735492 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc268e85-d1fe-486b-9d47-7856f2bcf140 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:00.746273 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385076dd-a10a-4981-bc1e-dc07c150b7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:00.748011 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385076dd-a10a-4981-bc1e-dc07c150b7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:00.748516 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385076dd-a10a-4981-bc1e-dc07c150b7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:00.748969 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385076dd-a10a-4981-bc1e-dc07c150b7b3 admin admin] PATH_INFO: `/v3/users/82f52f79b0e04e36bd8fdc491ff2f990` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:00.750585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385076dd-a10a-4981-bc1e-dc07c150b7b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f52f79b0e04e36bd8fdc491ff2f990)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:00.753330 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385076dd-a10a-4981-bc1e-dc07c150b7b3 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:00.762741 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ac774c8c-19f9-45a9-9bb6-1566cac5eda4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b8948513140499897efc889c8dfb741'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:00.776430 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ac774c8c-19f9-45a9-9bb6-1566cac5eda4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b8948513140499897efc889c8dfb741'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:00.875277 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 854/1712] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:00 2022] DELETE /identity/v3/users/7b8948513140499897efc889c8dfb741 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:00.876576 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac774c8c-19f9-45a9-9bb6-1566cac5eda4 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:00.878081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ac774c8c-19f9-45a9-9bb6-1566cac5eda4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:00.996548 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-385076dd-a10a-4981-bc1e-dc07c150b7b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f52f79b0e04e36bd8fdc491ff2f990'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:00.998082 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-385076dd-a10a-4981-bc1e-dc07c150b7b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f52f79b0e04e36bd8fdc491ff2f990'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:00.999352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-385076dd-a10a-4981-bc1e-dc07c150b7b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f52f79b0e04e36bd8fdc491ff2f990'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:01.006093 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac774c8c-19f9-45a9-9bb6-1566cac5eda4 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:01.014408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c09dd9-144b-4031-b2f1-ed09a8e40ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:01.015582 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c09dd9-144b-4031-b2f1-ed09a8e40ada admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:01.016031 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c09dd9-144b-4031-b2f1-ed09a8e40ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:01.016459 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c09dd9-144b-4031-b2f1-ed09a8e40ada admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:01.017861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c09dd9-144b-4031-b2f1-ed09a8e40ada admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:01.022595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c09dd9-144b-4031-b2f1-ed09a8e40ada admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:01.025646 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-385076dd-a10a-4981-bc1e-dc07c150b7b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f52f79b0e04e36bd8fdc491ff2f990'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:01.176440 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-385076dd-a10a-4981-bc1e-dc07c150b7b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f52f79b0e04e36bd8fdc491ff2f990'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:01.190614 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 855/1713] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:00 2022] POST /identity/v3/users => generated 285 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:01.191989 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 859/1714] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:00 2022] DELETE /identity/v3/users/82f52f79b0e04e36bd8fdc491ff2f990 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:01.192776 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc129e61-6d15-4162-a27d-e2a1aab8dacd None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:01.192962 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385076dd-a10a-4981-bc1e-dc07c150b7b3 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:01.193943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc129e61-6d15-4162-a27d-e2a1aab8dacd None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:01.194865 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-385076dd-a10a-4981-bc1e-dc07c150b7b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:01.195489 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc129e61-6d15-4162-a27d-e2a1aab8dacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:01.243363 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-bc129e61-6d15-4162-a27d-e2a1aab8dacd None None] MFA Rules not processed for user `1f09a9a483934c88a06be690f02fba4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:01.247309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-bc129e61-6d15-4162-a27d-e2a1aab8dacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:01.267277 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:01.337770 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385076dd-a10a-4981-bc1e-dc07c150b7b3 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:01.348413 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9e25c-7a0d-4826-8ab6-05497a9bad8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '213ba948a3f34c39bce3f6db093479eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:01.352068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9e25c-7a0d-4826-8ab6-05497a9bad8d service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:01.352068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9e25c-7a0d-4826-8ab6-05497a9bad8d service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:01.352068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9e25c-7a0d-4826-8ab6-05497a9bad8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:01.352375 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 856/1715] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:01.353789 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16443d-e74c-47aa-8aca-5d25a273a917 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:01.354104 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16443d-e74c-47aa-8aca-5d25a273a917 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:01.354386 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac16443d-e74c-47aa-8aca-5d25a273a917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:01.368338 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-dfb9e25c-7a0d-4826-8ab6-05497a9bad8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:01.375307 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-ac16443d-e74c-47aa-8aca-5d25a273a917 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:01.378275 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ac16443d-e74c-47aa-8aca-5d25a273a917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:01.406441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9e25c-7a0d-4826-8ab6-05497a9bad8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:01.411796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9e25c-7a0d-4826-8ab6-05497a9bad8d service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:01.437269 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 860/1716] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:01.440890 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65830a1f-0666-49f0-b4f5-18823084fc44 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:01.442080 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65830a1f-0666-49f0-b4f5-18823084fc44 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:01.442280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65830a1f-0666-49f0-b4f5-18823084fc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:01.518829 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-65830a1f-0666-49f0-b4f5-18823084fc44 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:01.519646 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-65830a1f-0666-49f0-b4f5-18823084fc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:01.542404 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 857/1717] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:01.543313 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16443d-e74c-47aa-8aca-5d25a273a917 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:01.547728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ac16443d-e74c-47aa-8aca-5d25a273a917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:01.577093 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac16443d-e74c-47aa-8aca-5d25a273a917 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:01.591169 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:01.593679 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57586307-6fd8-4548-8960-c949c851954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:01.593679 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57586307-6fd8-4548-8960-c949c851954b admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:01.594064 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57586307-6fd8-4548-8960-c949c851954b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:01.594485 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57586307-6fd8-4548-8960-c949c851954b admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:01.595373 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57586307-6fd8-4548-8960-c949c851954b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:01.597157 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57586307-6fd8-4548-8960-c949c851954b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:01.619440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 858/1718] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:01.622477 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5270b3-4046-440c-ab64-bbde48073b78 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:01.622917 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5270b3-4046-440c-ab64-bbde48073b78 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:01.623344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5270b3-4046-440c-ab64-bbde48073b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:01.644376 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-2e5270b3-4046-440c-ab64-bbde48073b78 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:01.645846 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2e5270b3-4046-440c-ab64-bbde48073b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:01.660624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 859/1719] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:01.662213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d106f6-5692-4f79-ad5f-ff8c490d29c1 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:01.662759 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d106f6-5692-4f79-ad5f-ff8c490d29c1 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:01.663195 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d106f6-5692-4f79-ad5f-ff8c490d29c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:01.712551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-95d106f6-5692-4f79-ad5f-ff8c490d29c1 None None] MFA Rules not processed for user `6618ecc2692c40be876654dfdc4496b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:01.723230 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-95d106f6-5692-4f79-ad5f-ff8c490d29c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:01.723685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 861/1720] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:01.724646 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65830a1f-0666-49f0-b4f5-18823084fc44 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:01.726058 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-65830a1f-0666-49f0-b4f5-18823084fc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:01.741510 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65830a1f-0666-49f0-b4f5-18823084fc44 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:01.748267 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e33a6a-be7a-4905-9eea-2671012b73d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:01.751516 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e33a6a-be7a-4905-9eea-2671012b73d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:01.751516 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e33a6a-be7a-4905-9eea-2671012b73d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:01.751516 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e33a6a-be7a-4905-9eea-2671012b73d8 admin admin] PATH_INFO: `/v3/projects/1b34d96b6f05425c9eb131e4c2474490` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:01.751792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e33a6a-be7a-4905-9eea-2671012b73d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b34d96b6f05425c9eb131e4c2474490)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:01.753915 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e33a6a-be7a-4905-9eea-2671012b73d8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:01.828842 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 860/1721] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:01.838428 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d106f6-5692-4f79-ad5f-ff8c490d29c1 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:01.838428 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-95d106f6-5692-4f79-ad5f-ff8c490d29c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:01.952337 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-45e33a6a-be7a-4905-9eea-2671012b73d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b34d96b6f05425c9eb131e4c2474490', 'request_id': 'req-45e33a6a-be7a-4905-9eea-2671012b73d8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:01.955551 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-45e33a6a-be7a-4905-9eea-2671012b73d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b34d96b6f05425c9eb131e4c2474490', 'request_id': 'req-45e33a6a-be7a-4905-9eea-2671012b73d8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:01.957922 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d106f6-5692-4f79-ad5f-ff8c490d29c1 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:01.964035 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-45e33a6a-be7a-4905-9eea-2671012b73d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b34d96b6f05425c9eb131e4c2474490', 'request_id': 'req-45e33a6a-be7a-4905-9eea-2671012b73d8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:02.035546 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaaf607-0e97-43b9-8d3a-a1e29d16a322 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:02.040958 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaf607-0e97-43b9-8d3a-a1e29d16a322 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:02.040958 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaf607-0e97-43b9-8d3a-a1e29d16a322 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:02.040958 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaaf607-0e97-43b9-8d3a-a1e29d16a322 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:02.071600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-45e33a6a-be7a-4905-9eea-2671012b73d8 admin admin] The token cache is being invalidate because project 1b34d96b6f05425c9eb131e4c2474490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:02.072164 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-45e33a6a-be7a-4905-9eea-2671012b73d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:02.072846 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-45e33a6a-be7a-4905-9eea-2671012b73d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:02.075230 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 862/1722] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:01 2022] DELETE /identity/v3/projects/1b34d96b6f05425c9eb131e4c2474490 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:02.077177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e33a6a-be7a-4905-9eea-2671012b73d8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:02.080324 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-45e33a6a-be7a-4905-9eea-2671012b73d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:02.165932 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaaf607-0e97-43b9-8d3a-a1e29d16a322 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:02.168168 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaaf607-0e97-43b9-8d3a-a1e29d16a322 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:02.182253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 861/1723] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:02.182971 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaaf607-0e97-43b9-8d3a-a1e29d16a322 service nova] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:02.208880 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e33a6a-be7a-4905-9eea-2671012b73d8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:02.219779 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58adf4-b9cd-4406-9a32-52819c1c7d6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:02.222650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58adf4-b9cd-4406-9a32-52819c1c7d6e service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:02.222940 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58adf4-b9cd-4406-9a32-52819c1c7d6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:02.223222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b58adf4-b9cd-4406-9a32-52819c1c7d6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:02.225149 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9b58adf4-b9cd-4406-9a32-52819c1c7d6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:02.286930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaaf607-0e97-43b9-8d3a-a1e29d16a322 service nova] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:02.305979 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d767aee-820a-46ad-9193-ea4c5060c50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:02.308059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d767aee-820a-46ad-9193-ea4c5060c50c admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:02.308354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d767aee-820a-46ad-9193-ea4c5060c50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:02.308638 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d767aee-820a-46ad-9193-ea4c5060c50c admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:02.309444 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d767aee-820a-46ad-9193-ea4c5060c50c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:02.313746 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d767aee-820a-46ad-9193-ea4c5060c50c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:02.339114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 862/1724] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:02.342987 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d767aee-820a-46ad-9193-ea4c5060c50c admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:02.361140 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58adf4-b9cd-4406-9a32-52819c1c7d6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:02.361140 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b58adf4-b9cd-4406-9a32-52819c1c7d6e service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:02.362499 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d767aee-820a-46ad-9193-ea4c5060c50c admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:02.371724 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102479dc-10b3-462c-9b50-51d0a036cf3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:02.372283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 863/1725] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:02.373397 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58adf4-b9cd-4406-9a32-52819c1c7d6e service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:02.374289 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102479dc-10b3-462c-9b50-51d0a036cf3e service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:02.375322 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102479dc-10b3-462c-9b50-51d0a036cf3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:02.375872 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9b58adf4-b9cd-4406-9a32-52819c1c7d6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:02.376247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102479dc-10b3-462c-9b50-51d0a036cf3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:02.378825 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-102479dc-10b3-462c-9b50-51d0a036cf3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:02.390956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b58adf4-b9cd-4406-9a32-52819c1c7d6e service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:02.400935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0383d3c-b7eb-42eb-848f-732f96ba9d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:02.401592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102479dc-10b3-462c-9b50-51d0a036cf3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:02.401675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0383d3c-b7eb-42eb-848f-732f96ba9d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:02.401675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0383d3c-b7eb-42eb-848f-732f96ba9d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:02.401675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0383d3c-b7eb-42eb-848f-732f96ba9d5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:02.401675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0383d3c-b7eb-42eb-848f-732f96ba9d5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:37:02.404882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0383d3c-b7eb-42eb-848f-732f96ba9d5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:02.405215 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0383d3c-b7eb-42eb-848f-732f96ba9d5f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:02.406493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102479dc-10b3-462c-9b50-51d0a036cf3e service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:02.433278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 864/1726] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:37:02.436083 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d008a2-7669-45fe-adeb-ad7afc186dac None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:02.436528 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d008a2-7669-45fe-adeb-ad7afc186dac None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:02.437012 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d008a2-7669-45fe-adeb-ad7afc186dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:02.440239 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 863/1727] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:02.441813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ed836-38f8-4fc5-860d-bca26afa22ec None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:02.442231 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ed836-38f8-4fc5-860d-bca26afa22ec None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:02.445089 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ed836-38f8-4fc5-860d-bca26afa22ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:02.461096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-32d008a2-7669-45fe-adeb-ad7afc186dac None None] MFA Rules not processed for user `6618ecc2692c40be876654dfdc4496b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:02.462750 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-32d008a2-7669-45fe-adeb-ad7afc186dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:02.474552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-5b5ed836-38f8-4fc5-860d-bca26afa22ec None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:02.475688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5b5ed836-38f8-4fc5-860d-bca26afa22ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:02.488850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 864/1728] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:02.489871 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ed836-38f8-4fc5-860d-bca26afa22ec None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:02.491932 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5b5ed836-38f8-4fc5-860d-bca26afa22ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:02.510328 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ed836-38f8-4fc5-860d-bca26afa22ec None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:02.519881 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12267a80-34fb-42b8-a380-a7d5cbf24030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:02.522837 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12267a80-34fb-42b8-a380-a7d5cbf24030 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:02.523252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12267a80-34fb-42b8-a380-a7d5cbf24030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:02.523720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12267a80-34fb-42b8-a380-a7d5cbf24030 admin admin] PATH_INFO: `/v3/projects/1f9367d88ea04b8bacda4f7eaf195e98/users/68cafd1890fc4d08820e0bb5f0c77bc3/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:02.545808 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12267a80-34fb-42b8-a380-a7d5cbf24030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f9367d88ea04b8bacda4f7eaf195e98, user_id=68cafd1890fc4d08820e0bb5f0c77bc3, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:02.550499 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12267a80-34fb-42b8-a380-a7d5cbf24030 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:02.616742 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 865/1729] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:02.616742 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d008a2-7669-45fe-adeb-ad7afc186dac None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:02.632008 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d008a2-7669-45fe-adeb-ad7afc186dac None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:02.639743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cc55e-63f2-43b2-9aec-03bba24f1d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:02.640663 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cc55e-63f2-43b2-9aec-03bba24f1d92 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:02.641029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cc55e-63f2-43b2-9aec-03bba24f1d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:02.641476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cc55e-63f2-43b2-9aec-03bba24f1d92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:02.642260 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8cc55e-63f2-43b2-9aec-03bba24f1d92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:02.644987 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8cc55e-63f2-43b2-9aec-03bba24f1d92 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:02.674213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 865/1730] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:02 2022] PUT /identity/v3/projects/1f9367d88ea04b8bacda4f7eaf195e98/users/68cafd1890fc4d08820e0bb5f0c77bc3/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:02.676028 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c85ab2-63e8-484a-8827-b4655677bc6c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:02.677330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c85ab2-63e8-484a-8827-b4655677bc6c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:02.677668 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c85ab2-63e8-484a-8827-b4655677bc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:02.707165 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-26c85ab2-63e8-484a-8827-b4655677bc6c None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:02.708561 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-26c85ab2-63e8-484a-8827-b4655677bc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:02.752566 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:02.821523 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 866/1731] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:02 2022] POST /identity/v3/projects => generated 357 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:02.821523 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cc55e-63f2-43b2-9aec-03bba24f1d92 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:02.823288 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6a8cc55e-63f2-43b2-9aec-03bba24f1d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:02.867306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 866/1732] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:02.868807 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a602dc3-8964-44f1-bd2e-ad6bd1c6d1e2 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:02.868807 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a602dc3-8964-44f1-bd2e-ad6bd1c6d1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:02.869156 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a602dc3-8964-44f1-bd2e-ad6bd1c6d1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:02.931610 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-7a602dc3-8964-44f1-bd2e-ad6bd1c6d1e2 None None] MFA Rules not processed for user `68cafd1890fc4d08820e0bb5f0c77bc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:02.932824 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7a602dc3-8964-44f1-bd2e-ad6bd1c6d1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:02.940134 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cc55e-63f2-43b2-9aec-03bba24f1d92 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:02.971251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5b6ba-b923-4699-8b2c-3e509342f529 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:02.973234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5b6ba-b923-4699-8b2c-3e509342f529 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:02.974066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5b6ba-b923-4699-8b2c-3e509342f529 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:02.974786 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5b6ba-b923-4699-8b2c-3e509342f529 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:02.978360 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-47f5b6ba-b923-4699-8b2c-3e509342f529 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:03.093182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 867/1733] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:02 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:03.094391 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a602dc3-8964-44f1-bd2e-ad6bd1c6d1e2 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:03.165828 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:03.179018 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5b6ba-b923-4699-8b2c-3e509342f529 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:03.181976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5b6ba-b923-4699-8b2c-3e509342f529 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:03.198619 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 867/1734] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:03.199467 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5b6ba-b923-4699-8b2c-3e509342f529 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:03.254335 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a602dc3-8964-44f1-bd2e-ad6bd1c6d1e2 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:03.268086 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22799e-35f5-45ba-a775-81be89ab933a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:03.268797 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22799e-35f5-45ba-a775-81be89ab933a admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:03.269088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22799e-35f5-45ba-a775-81be89ab933a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:03.269370 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22799e-35f5-45ba-a775-81be89ab933a admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:03.270112 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22799e-35f5-45ba-a775-81be89ab933a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:03.272092 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea22799e-35f5-45ba-a775-81be89ab933a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:03.373641 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5b6ba-b923-4699-8b2c-3e509342f529 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:03.379779 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01604b-f91d-44ae-a794-2c8f0260fc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:03.384485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01604b-f91d-44ae-a794-2c8f0260fc1d admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:03.384485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01604b-f91d-44ae-a794-2c8f0260fc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:03.384485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe01604b-f91d-44ae-a794-2c8f0260fc1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:03.384485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01604b-f91d-44ae-a794-2c8f0260fc1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:37:03.384485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01604b-f91d-44ae-a794-2c8f0260fc1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:03.384485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe01604b-f91d-44ae-a794-2c8f0260fc1d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:03.406358 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 868/1735] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:37:03.419021 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 868/1736] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:03 2022] POST /identity/v3/users => generated 279 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:03.421156 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22799e-35f5-45ba-a775-81be89ab933a admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:03.421744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01604b-f91d-44ae-a794-2c8f0260fc1d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:03.442832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea22799e-35f5-45ba-a775-81be89ab933a admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:03.448646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6831cc9-81f7-401b-90bb-32f4d4a7e703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:03.449571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6831cc9-81f7-401b-90bb-32f4d4a7e703 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:03.450553 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6831cc9-81f7-401b-90bb-32f4d4a7e703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:03.451179 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6831cc9-81f7-401b-90bb-32f4d4a7e703 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:03.453043 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6831cc9-81f7-401b-90bb-32f4d4a7e703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:03.455182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6831cc9-81f7-401b-90bb-32f4d4a7e703 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:03.459862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe01604b-f91d-44ae-a794-2c8f0260fc1d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:03.475699 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a5971-6527-416f-8f76-812cb3d77865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:03.502068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a5971-6527-416f-8f76-812cb3d77865 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:03.502068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a5971-6527-416f-8f76-812cb3d77865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:03.502068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60a5971-6527-416f-8f76-812cb3d77865 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:03.505554 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a5971-6527-416f-8f76-812cb3d77865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:03.513168 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60a5971-6527-416f-8f76-812cb3d77865 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:03.585265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 869/1737] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:03 2022] POST /identity/v3/projects => generated 363 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:03.585265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6831cc9-81f7-401b-90bb-32f4d4a7e703 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:03.671238 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 869/1738] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:03 2022] POST /identity/v3/projects => generated 369 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:03.672046 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a5971-6527-416f-8f76-812cb3d77865 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:03.710180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6831cc9-81f7-401b-90bb-32f4d4a7e703 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:03.795803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60a5971-6527-416f-8f76-812cb3d77865 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:03.803708 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826346d5-54a7-4eb8-91a3-b499266f5fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:03.804539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826346d5-54a7-4eb8-91a3-b499266f5fbb admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:03.804832 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826346d5-54a7-4eb8-91a3-b499266f5fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:03.805303 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826346d5-54a7-4eb8-91a3-b499266f5fbb admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:03.806057 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826346d5-54a7-4eb8-91a3-b499266f5fbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:03.808968 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826346d5-54a7-4eb8-91a3-b499266f5fbb admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:03.833350 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e5b47-0f13-4bdf-9318-d2d1adc6b4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:03.834150 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e5b47-0f13-4bdf-9318-d2d1adc6b4f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:03.834441 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e5b47-0f13-4bdf-9318-d2d1adc6b4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:03.834722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e5b47-0f13-4bdf-9318-d2d1adc6b4f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:03.835509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e5b47-0f13-4bdf-9318-d2d1adc6b4f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:03.837616 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e5b47-0f13-4bdf-9318-d2d1adc6b4f1 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:03.849066 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 870/1739] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:03.849066 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e5b47-0f13-4bdf-9318-d2d1adc6b4f1 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:03.864050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e5b47-0f13-4bdf-9318-d2d1adc6b4f1 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:03.869086 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691e833-924b-4e06-9197-b0031b50a53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:03.869841 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691e833-924b-4e06-9197-b0031b50a53b admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:03.870105 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691e833-924b-4e06-9197-b0031b50a53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:03.870442 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6691e833-924b-4e06-9197-b0031b50a53b admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:03.871138 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691e833-924b-4e06-9197-b0031b50a53b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:03.873178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6691e833-924b-4e06-9197-b0031b50a53b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:03.970358 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 870/1740] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:03 2022] POST /identity/v3/users => generated 282 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:03.974023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826346d5-54a7-4eb8-91a3-b499266f5fbb admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:04.000299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826346d5-54a7-4eb8-91a3-b499266f5fbb admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:04.010612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 871/1741] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:03 2022] POST /identity/v3/users => generated 291 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:04.010612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691e833-924b-4e06-9197-b0031b50a53b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:04.022969 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a4f70-4d4c-463f-ae1d-34622abd5515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:04.023686 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a4f70-4d4c-463f-ae1d-34622abd5515 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:04.023960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a4f70-4d4c-463f-ae1d-34622abd5515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:04.024240 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6a4f70-4d4c-463f-ae1d-34622abd5515 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:04.025507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a4f70-4d4c-463f-ae1d-34622abd5515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:04.027180 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6a4f70-4d4c-463f-ae1d-34622abd5515 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:04.047220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6691e833-924b-4e06-9197-b0031b50a53b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:04.051134 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 871/1742] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:04.051874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a4f70-4d4c-463f-ae1d-34622abd5515 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:04.063780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3c048-fe0b-4c11-a83a-3575848ac401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:04.068395 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3c048-fe0b-4c11-a83a-3575848ac401 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:04.071767 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3c048-fe0b-4c11-a83a-3575848ac401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:04.074231 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3c048-fe0b-4c11-a83a-3575848ac401 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:04.080293 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3c048-fe0b-4c11-a83a-3575848ac401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:04.081834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6a4f70-4d4c-463f-ae1d-34622abd5515 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:04.091325 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce3c048-fe0b-4c11-a83a-3575848ac401 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:04.107049 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc899fc9-d481-441e-b870-35c863c64e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:04.107758 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc899fc9-d481-441e-b870-35c863c64e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:04.108053 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc899fc9-d481-441e-b870-35c863c64e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:04.108334 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc899fc9-d481-441e-b870-35c863c64e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:04.109078 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc899fc9-d481-441e-b870-35c863c64e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:04.110780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc899fc9-d481-441e-b870-35c863c64e89 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:04.118292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 872/1743] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:04.119181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3c048-fe0b-4c11-a83a-3575848ac401 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:04.136423 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3c048-fe0b-4c11-a83a-3575848ac401 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:04.143034 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3436fa1-9f58-4d66-99f1-b0b39cc7d4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:04.144234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3436fa1-9f58-4d66-99f1-b0b39cc7d4a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:04.144631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3436fa1-9f58-4d66-99f1-b0b39cc7d4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:04.144983 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3436fa1-9f58-4d66-99f1-b0b39cc7d4a9 admin admin] PATH_INFO: `/v3/projects/acd3cba2ea0449678ccce172afacfc83/users/ff7e1d49d0b7417eb9995e9f91310af5/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:04.157156 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 872/1744] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:04.157909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc899fc9-d481-441e-b870-35c863c64e89 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:04.182894 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3436fa1-9f58-4d66-99f1-b0b39cc7d4a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acd3cba2ea0449678ccce172afacfc83, user_id=ff7e1d49d0b7417eb9995e9f91310af5, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:04.186096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3436fa1-9f58-4d66-99f1-b0b39cc7d4a9 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:04.201139 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc899fc9-d481-441e-b870-35c863c64e89 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:04.211741 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a603db-d6ce-4fd0-a60c-cb4d02ba6a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:04.213109 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a603db-d6ce-4fd0-a60c-cb4d02ba6a2a admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:04.213502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a603db-d6ce-4fd0-a60c-cb4d02ba6a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:04.213816 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a603db-d6ce-4fd0-a60c-cb4d02ba6a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:04.214566 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a603db-d6ce-4fd0-a60c-cb4d02ba6a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:04.216976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a603db-d6ce-4fd0-a60c-cb4d02ba6a2a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:04.243726 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 873/1745] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:04.259882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a603db-d6ce-4fd0-a60c-cb4d02ba6a2a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:04.271568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a603db-d6ce-4fd0-a60c-cb4d02ba6a2a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:04.289999 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 873/1746] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:04 2022] PUT /identity/v3/projects/acd3cba2ea0449678ccce172afacfc83/users/ff7e1d49d0b7417eb9995e9f91310af5/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:04.294421 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3436fa1-9f58-4d66-99f1-b0b39cc7d4a9 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:04.294535 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296052c-07c4-4ce7-85b1-ec91ef67b536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:04.294535 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296052c-07c4-4ce7-85b1-ec91ef67b536 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:04.294535 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296052c-07c4-4ce7-85b1-ec91ef67b536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:04.294535 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296052c-07c4-4ce7-85b1-ec91ef67b536 admin admin] PATH_INFO: `/v3/projects/c656a6971d02441f809141e78602595c/users/fa29ec5e9d514de987ed87710aeeaf1e/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:04.322562 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296052c-07c4-4ce7-85b1-ec91ef67b536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c656a6971d02441f809141e78602595c, user_id=fa29ec5e9d514de987ed87710aeeaf1e, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:04.325865 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296052c-07c4-4ce7-85b1-ec91ef67b536 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:04.431321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3436fa1-9f58-4d66-99f1-b0b39cc7d4a9 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:04.445739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 874/1747] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:04 2022] PUT /identity/v3/projects/c656a6971d02441f809141e78602595c/users/fa29ec5e9d514de987ed87710aeeaf1e/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:04.447359 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ae4d8-b76e-44fe-be9e-01d215b64e4f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:04.447696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ae4d8-b76e-44fe-be9e-01d215b64e4f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:04.448063 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ae4d8-b76e-44fe-be9e-01d215b64e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:04.506953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-415ae4d8-b76e-44fe-be9e-01d215b64e4f None None] MFA Rules not processed for user `ff7e1d49d0b7417eb9995e9f91310af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:04.509041 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-415ae4d8-b76e-44fe-be9e-01d215b64e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:04.551223 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f681fac-e7ea-4031-8fde-62420d619ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:04.556606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f681fac-e7ea-4031-8fde-62420d619ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:04.556606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f681fac-e7ea-4031-8fde-62420d619ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:04.556606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f681fac-e7ea-4031-8fde-62420d619ba8 admin admin] PATH_INFO: `/v3/projects/3fed927895c44e2db1b405d4f212b29d/users/d767b3ceecad4bf990cca01a075dc9b7/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:04.576390 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f681fac-e7ea-4031-8fde-62420d619ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fed927895c44e2db1b405d4f212b29d, user_id=d767b3ceecad4bf990cca01a075dc9b7, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:04.583770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f681fac-e7ea-4031-8fde-62420d619ba8 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:04.610733 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 875/1748] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:04 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:04.612399 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da926a61-ab39-45a4-8187-566d641ed789 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:04.612696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da926a61-ab39-45a4-8187-566d641ed789 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:04.612975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da926a61-ab39-45a4-8187-566d641ed789 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:04.614831 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 876/1749] 10.222.0.64 () {54 vars in 912 bytes} [Mon Jul 18 02:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:37:04.615471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da926a61-ab39-45a4-8187-566d641ed789 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:04.629560 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da926a61-ab39-45a4-8187-566d641ed789 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:04.634767 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87537e5-474b-4a34-91d5-b557a849815d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:04.635459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87537e5-474b-4a34-91d5-b557a849815d admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:04.635754 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87537e5-474b-4a34-91d5-b557a849815d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:04.636039 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87537e5-474b-4a34-91d5-b557a849815d admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:04.636789 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87537e5-474b-4a34-91d5-b557a849815d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:04.639161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87537e5-474b-4a34-91d5-b557a849815d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:04.651072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 877/1750] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:04.651945 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87537e5-474b-4a34-91d5-b557a849815d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:04.656182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d87537e5-474b-4a34-91d5-b557a849815d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:04.671139 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87537e5-474b-4a34-91d5-b557a849815d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:04.676618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3d47f-3f8d-42e4-a00d-886bff7ed23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:04.677594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3d47f-3f8d-42e4-a00d-886bff7ed23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:04.677991 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3d47f-3f8d-42e4-a00d-886bff7ed23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:04.678475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3d47f-3f8d-42e4-a00d-886bff7ed23d admin admin] PATH_INFO: `/v3/projects/733813e673fb410aa8f2f2b13ba52938` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:04.680847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3d47f-3f8d-42e4-a00d-886bff7ed23d admin admin] RBAC: Authorizing `identity:delete_project(project_id=733813e673fb410aa8f2f2b13ba52938)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:04.682918 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c3d47f-3f8d-42e4-a00d-886bff7ed23d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:04.787958 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 874/1751] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:04 2022] PUT /identity/v3/projects/3fed927895c44e2db1b405d4f212b29d/users/d767b3ceecad4bf990cca01a075dc9b7/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:04.794199 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f681fac-e7ea-4031-8fde-62420d619ba8 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:04.803711 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7f681fac-e7ea-4031-8fde-62420d619ba8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:04.898732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-96c3d47f-3f8d-42e4-a00d-886bff7ed23d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '733813e673fb410aa8f2f2b13ba52938', 'request_id': 'req-96c3d47f-3f8d-42e4-a00d-886bff7ed23d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:04.913369 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-96c3d47f-3f8d-42e4-a00d-886bff7ed23d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '733813e673fb410aa8f2f2b13ba52938', 'request_id': 'req-96c3d47f-3f8d-42e4-a00d-886bff7ed23d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:04.935966 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-96c3d47f-3f8d-42e4-a00d-886bff7ed23d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '733813e673fb410aa8f2f2b13ba52938', 'request_id': 'req-96c3d47f-3f8d-42e4-a00d-886bff7ed23d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:04.960063 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f681fac-e7ea-4031-8fde-62420d619ba8 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:05.063260 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-96c3d47f-3f8d-42e4-a00d-886bff7ed23d admin admin] The token cache is being invalidate because project 733813e673fb410aa8f2f2b13ba52938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:05.063260 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-96c3d47f-3f8d-42e4-a00d-886bff7ed23d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:05.063260 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-96c3d47f-3f8d-42e4-a00d-886bff7ed23d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:05.064135 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 878/1752] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:04 2022] DELETE /identity/v3/projects/733813e673fb410aa8f2f2b13ba52938 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:05.064706 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3d47f-3f8d-42e4-a00d-886bff7ed23d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:05.066763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-96c3d47f-3f8d-42e4-a00d-886bff7ed23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:05.068407 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea5c71-1cab-4617-992d-c794a039e0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:05.069546 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea5c71-1cab-4617-992d-c794a039e0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:05.071075 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea5c71-1cab-4617-992d-c794a039e0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:05.071554 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea5c71-1cab-4617-992d-c794a039e0af admin admin] PATH_INFO: `/v3/projects/450ba5c3ca6747269c941d33591e24ff` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:05.073553 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea5c71-1cab-4617-992d-c794a039e0af admin admin] RBAC: Authorizing `identity:delete_project(project_id=450ba5c3ca6747269c941d33591e24ff)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:05.076416 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea5c71-1cab-4617-992d-c794a039e0af admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:05.095513 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3d47f-3f8d-42e4-a00d-886bff7ed23d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:05.103883 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842167fb-b117-4459-9c3b-5b6e528a6361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:05.104978 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842167fb-b117-4459-9c3b-5b6e528a6361 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:05.105449 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842167fb-b117-4459-9c3b-5b6e528a6361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:05.106379 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842167fb-b117-4459-9c3b-5b6e528a6361 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:05.107280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842167fb-b117-4459-9c3b-5b6e528a6361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:05.109523 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842167fb-b117-4459-9c3b-5b6e528a6361 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:05.205870 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-82ea5c71-1cab-4617-992d-c794a039e0af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '450ba5c3ca6747269c941d33591e24ff', 'request_id': 'req-82ea5c71-1cab-4617-992d-c794a039e0af'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:05.212783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-82ea5c71-1cab-4617-992d-c794a039e0af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '450ba5c3ca6747269c941d33591e24ff', 'request_id': 'req-82ea5c71-1cab-4617-992d-c794a039e0af'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:05.224072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-82ea5c71-1cab-4617-992d-c794a039e0af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '450ba5c3ca6747269c941d33591e24ff', 'request_id': 'req-82ea5c71-1cab-4617-992d-c794a039e0af'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:05.230164 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 879/1753] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:05 2022] POST /identity/v3/projects => generated 355 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:05.232094 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93378b00-ad67-4e54-bada-2c2d3333ecd8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:05.232385 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93378b00-ad67-4e54-bada-2c2d3333ecd8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:05.232700 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93378b00-ad67-4e54-bada-2c2d3333ecd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:05.256762 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-93378b00-ad67-4e54-bada-2c2d3333ecd8 None None] MFA Rules not processed for user `fa9e6d3fe3e740e6aedab33d727ec478`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:05.261642 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-93378b00-ad67-4e54-bada-2c2d3333ecd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:05.318020 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 880/1754] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jul 18 02:37:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:05.318885 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93378b00-ad67-4e54-bada-2c2d3333ecd8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:05.322652 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:05.323827 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-93378b00-ad67-4e54-bada-2c2d3333ecd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:05.384499 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-82ea5c71-1cab-4617-992d-c794a039e0af admin admin] The token cache is being invalidate because project 450ba5c3ca6747269c941d33591e24ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:05.384796 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-82ea5c71-1cab-4617-992d-c794a039e0af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:05.388748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-82ea5c71-1cab-4617-992d-c794a039e0af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:05.392058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 875/1755] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:04 2022] DELETE /identity/v3/projects/450ba5c3ca6747269c941d33591e24ff => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:05.396563 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6f4ee-a222-4175-933b-2801e2f0544b None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:05.396872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6f4ee-a222-4175-933b-2801e2f0544b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:05.397993 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb6f4ee-a222-4175-933b-2801e2f0544b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:05.428642 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93378b00-ad67-4e54-bada-2c2d3333ecd8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:05.443153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97defc0f-bdcf-48bb-921a-36ae674ad957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:05.444303 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97defc0f-bdcf-48bb-921a-36ae674ad957 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:05.444599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97defc0f-bdcf-48bb-921a-36ae674ad957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:05.444948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97defc0f-bdcf-48bb-921a-36ae674ad957 admin admin] PATH_INFO: `/v3/projects/c656a6971d02441f809141e78602595c/users/fa29ec5e9d514de987ed87710aeeaf1e/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:05.447417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97defc0f-bdcf-48bb-921a-36ae674ad957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c656a6971d02441f809141e78602595c, user_id=fa29ec5e9d514de987ed87710aeeaf1e, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:05.452862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97defc0f-bdcf-48bb-921a-36ae674ad957 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:05.462980 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:05.477921 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 881/1756] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:05 2022] PUT /identity/v3/projects/c656a6971d02441f809141e78602595c/users/fa29ec5e9d514de987ed87710aeeaf1e/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:05.479772 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb4b0c-02e1-437e-99cd-12da40f5273a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:05.480277 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb4b0c-02e1-437e-99cd-12da40f5273a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:05.489753 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb4b0c-02e1-437e-99cd-12da40f5273a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:05.493017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-6eb6f4ee-a222-4175-933b-2801e2f0544b None None] MFA Rules not processed for user `d767b3ceecad4bf990cca01a075dc9b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:05.501627 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6eb6f4ee-a222-4175-933b-2801e2f0544b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:05.515166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-04bb4b0c-02e1-437e-99cd-12da40f5273a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:05.516946 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-04bb4b0c-02e1-437e-99cd-12da40f5273a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:05.611193 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 876/1757] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:05 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:05.613245 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6f4ee-a222-4175-933b-2801e2f0544b None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:05.615723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6eb6f4ee-a222-4175-933b-2801e2f0544b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:05.652483 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 882/1758] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:05.653667 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb4b0c-02e1-437e-99cd-12da40f5273a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:05.659191 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-04bb4b0c-02e1-437e-99cd-12da40f5273a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:05.704404 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb6f4ee-a222-4175-933b-2801e2f0544b None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:05.709848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34ce6b7-aa92-40c3-904c-3df1d17329ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:05.710816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ce6b7-aa92-40c3-904c-3df1d17329ea admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:05.711105 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ce6b7-aa92-40c3-904c-3df1d17329ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:05.711389 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34ce6b7-aa92-40c3-904c-3df1d17329ea admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:05.712095 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ce6b7-aa92-40c3-904c-3df1d17329ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:05.714086 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34ce6b7-aa92-40c3-904c-3df1d17329ea admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:05.725713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb4b0c-02e1-437e-99cd-12da40f5273a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:05.729620 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d68a6b-f9ec-4a5c-a72c-2e623ed33fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:05.730356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d68a6b-f9ec-4a5c-a72c-2e623ed33fbd service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:05.730708 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d68a6b-f9ec-4a5c-a72c-2e623ed33fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:05.730995 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d68a6b-f9ec-4a5c-a72c-2e623ed33fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:05.732869 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-91d68a6b-f9ec-4a5c-a72c-2e623ed33fbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:05.742777 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d68a6b-f9ec-4a5c-a72c-2e623ed33fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:05.744219 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d68a6b-f9ec-4a5c-a72c-2e623ed33fbd service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:05.752890 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 883/1759] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:05.753839 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d68a6b-f9ec-4a5c-a72c-2e623ed33fbd service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:05.755171 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-91d68a6b-f9ec-4a5c-a72c-2e623ed33fbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:05.770637 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d68a6b-f9ec-4a5c-a72c-2e623ed33fbd service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:05.776670 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f949c-0c8e-4305-a65a-ce039f14dfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:05.779595 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f949c-0c8e-4305-a65a-ce039f14dfe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:05.779595 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f949c-0c8e-4305-a65a-ce039f14dfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:05.779595 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f949c-0c8e-4305-a65a-ce039f14dfe1 admin admin] PATH_INFO: `/v3/users/8db367a357bb46c38cb6803aa8070635` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:05.779832 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f949c-0c8e-4305-a65a-ce039f14dfe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8db367a357bb46c38cb6803aa8070635)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:05.781593 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f949c-0c8e-4305-a65a-ce039f14dfe1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:05.887394 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 877/1760] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:05 2022] POST /identity/v3/users => generated 284 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:05.892085 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6489258-7f9a-46d2-9cea-6dd040042e1d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:05.892534 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6489258-7f9a-46d2-9cea-6dd040042e1d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:05.892917 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6489258-7f9a-46d2-9cea-6dd040042e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:05.933028 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-f6489258-7f9a-46d2-9cea-6dd040042e1d None None] MFA Rules not processed for user `fa29ec5e9d514de987ed87710aeeaf1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:05.935384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f6489258-7f9a-46d2-9cea-6dd040042e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:06.084808 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 878/1761] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:05 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:06.085776 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6489258-7f9a-46d2-9cea-6dd040042e1d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:06.091813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f6489258-7f9a-46d2-9cea-6dd040042e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:06.096625 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-684f949c-0c8e-4305-a65a-ce039f14dfe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8db367a357bb46c38cb6803aa8070635'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:06.097436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-684f949c-0c8e-4305-a65a-ce039f14dfe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8db367a357bb46c38cb6803aa8070635'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:06.098159 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-684f949c-0c8e-4305-a65a-ce039f14dfe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8db367a357bb46c38cb6803aa8070635'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:06.107074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6489258-7f9a-46d2-9cea-6dd040042e1d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:06.112252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2e2f8-0a80-44fc-bbd6-54b1e361608a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:06.114312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2e2f8-0a80-44fc-bbd6-54b1e361608a admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:06.114611 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2e2f8-0a80-44fc-bbd6-54b1e361608a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:06.115212 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2e2f8-0a80-44fc-bbd6-54b1e361608a admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:06.116101 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2e2f8-0a80-44fc-bbd6-54b1e361608a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:06.117577 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-684f949c-0c8e-4305-a65a-ce039f14dfe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8db367a357bb46c38cb6803aa8070635'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:06.118326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2e2f8-0a80-44fc-bbd6-54b1e361608a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:06.209026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-684f949c-0c8e-4305-a65a-ce039f14dfe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8db367a357bb46c38cb6803aa8070635'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:06.227571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 879/1762] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:06 2022] POST /identity/v3/projects => generated 363 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:06.229286 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010bd0b-63fc-4dd3-a0c9-6eaa27353a39 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:06.230174 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010bd0b-63fc-4dd3-a0c9-6eaa27353a39 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:06.230655 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010bd0b-63fc-4dd3-a0c9-6eaa27353a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:06.234108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 884/1763] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:05 2022] DELETE /identity/v3/users/8db367a357bb46c38cb6803aa8070635 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:06.235175 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f949c-0c8e-4305-a65a-ce039f14dfe1 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:06.239104 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-684f949c-0c8e-4305-a65a-ce039f14dfe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:06.264941 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-8010bd0b-63fc-4dd3-a0c9-6eaa27353a39 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:06.266587 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8010bd0b-63fc-4dd3-a0c9-6eaa27353a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:06.358934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f949c-0c8e-4305-a65a-ce039f14dfe1 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:06.365290 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cfc9d-1456-4047-b9b6-c7794ae58e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:06.366012 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cfc9d-1456-4047-b9b6-c7794ae58e7c admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:06.366295 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cfc9d-1456-4047-b9b6-c7794ae58e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:06.366569 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756cfc9d-1456-4047-b9b6-c7794ae58e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:06.367595 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756cfc9d-1456-4047-b9b6-c7794ae58e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:06.369422 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756cfc9d-1456-4047-b9b6-c7794ae58e7c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:06.374124 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 880/1764] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:06.383983 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010bd0b-63fc-4dd3-a0c9-6eaa27353a39 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:06.383983 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8010bd0b-63fc-4dd3-a0c9-6eaa27353a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:06.396449 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 885/1765] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:06.396565 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cfc9d-1456-4047-b9b6-c7794ae58e7c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:06.400880 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-756cfc9d-1456-4047-b9b6-c7794ae58e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:06.427971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756cfc9d-1456-4047-b9b6-c7794ae58e7c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:06.442639 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5d2b2-35b8-4167-8080-2f9bf5c541da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:06.442639 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5d2b2-35b8-4167-8080-2f9bf5c541da admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:06.442639 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5d2b2-35b8-4167-8080-2f9bf5c541da admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:06.442639 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5d2b2-35b8-4167-8080-2f9bf5c541da admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:06.442997 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5d2b2-35b8-4167-8080-2f9bf5c541da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:06.442997 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5d2b2-35b8-4167-8080-2f9bf5c541da admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:06.478713 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010bd0b-63fc-4dd3-a0c9-6eaa27353a39 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:06.483115 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3724a-2a84-4ab9-9300-73c6f3581c1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:06.483317 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3724a-2a84-4ab9-9300-73c6f3581c1c service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:06.483579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3724a-2a84-4ab9-9300-73c6f3581c1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:06.483859 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3724a-2a84-4ab9-9300-73c6f3581c1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:06.485689 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7fe3724a-2a84-4ab9-9300-73c6f3581c1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:06.579569 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3724a-2a84-4ab9-9300-73c6f3581c1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:06.583186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3724a-2a84-4ab9-9300-73c6f3581c1c service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:06.594801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 881/1766] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:06 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:06.595869 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3724a-2a84-4ab9-9300-73c6f3581c1c service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:06.607848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3724a-2a84-4ab9-9300-73c6f3581c1c service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:06.615450 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f56f1-ad82-49d6-a9d7-8380d93affc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:06.620530 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f56f1-ad82-49d6-a9d7-8380d93affc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:06.628203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 886/1767] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:06 2022] POST /identity/v3/users => generated 288 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:06.629146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5d2b2-35b8-4167-8080-2f9bf5c541da admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:06.637744 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f56f1-ad82-49d6-a9d7-8380d93affc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:06.637744 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f56f1-ad82-49d6-a9d7-8380d93affc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:06.637744 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f56f1-ad82-49d6-a9d7-8380d93affc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:37:06.638265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f56f1-ad82-49d6-a9d7-8380d93affc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:06.643029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5d2b2-35b8-4167-8080-2f9bf5c541da admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:06.644385 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f56f1-ad82-49d6-a9d7-8380d93affc6 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:06.649444 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d25b7-f79e-49c7-8dbb-11c0bc242d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:06.651196 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d25b7-f79e-49c7-8dbb-11c0bc242d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:06.651554 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d25b7-f79e-49c7-8dbb-11c0bc242d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:06.651905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389d25b7-f79e-49c7-8dbb-11c0bc242d9b admin admin] PATH_INFO: `/v3/projects/86c89000d6504fc7939c2d1df19cfdf9/users/17b99c6ceb8342daaca682992125c123/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:06.664507 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 882/1768] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:37:06.666520 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c089b5b-28ce-45a3-b2fc-79f82eacab3c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:06.674139 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c089b5b-28ce-45a3-b2fc-79f82eacab3c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:06.674139 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c089b5b-28ce-45a3-b2fc-79f82eacab3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:06.686106 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d25b7-f79e-49c7-8dbb-11c0bc242d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=86c89000d6504fc7939c2d1df19cfdf9, user_id=17b99c6ceb8342daaca682992125c123, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:06.691092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389d25b7-f79e-49c7-8dbb-11c0bc242d9b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:06.706811 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-2c089b5b-28ce-45a3-b2fc-79f82eacab3c None None] MFA Rules not processed for user `6618ecc2692c40be876654dfdc4496b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:06.714510 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2c089b5b-28ce-45a3-b2fc-79f82eacab3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:06.816731 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 887/1769] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:06 2022] PUT /identity/v3/projects/86c89000d6504fc7939c2d1df19cfdf9/users/17b99c6ceb8342daaca682992125c123/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:06.821828 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d25b7-f79e-49c7-8dbb-11c0bc242d9b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:06.827972 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 883/1770] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:06.827972 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c089b5b-28ce-45a3-b2fc-79f82eacab3c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:06.842157 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c089b5b-28ce-45a3-b2fc-79f82eacab3c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:06.956813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4cdbe8-7124-4035-bb29-02ed07c99d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:06.957963 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cdbe8-7124-4035-bb29-02ed07c99d3c admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:06.958647 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cdbe8-7124-4035-bb29-02ed07c99d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:06.958932 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4cdbe8-7124-4035-bb29-02ed07c99d3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:06.959652 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4cdbe8-7124-4035-bb29-02ed07c99d3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:06.962343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4cdbe8-7124-4035-bb29-02ed07c99d3c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:07.005037 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:07.012517 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389d25b7-f79e-49c7-8dbb-11c0bc242d9b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:07.019381 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edbf485-76fb-43d3-82e0-951f5278855a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:07.020185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbf485-76fb-43d3-82e0-951f5278855a admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:07.020475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbf485-76fb-43d3-82e0-951f5278855a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:07.020784 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edbf485-76fb-43d3-82e0-951f5278855a admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:07.021527 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbf485-76fb-43d3-82e0-951f5278855a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:07.023376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edbf485-76fb-43d3-82e0-951f5278855a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:07.035881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 888/1771] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:07.037254 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ca84b-39fb-4850-bf71-5bf3bb9e3847 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:07.037547 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ca84b-39fb-4850-bf71-5bf3bb9e3847 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:07.037905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ca84b-39fb-4850-bf71-5bf3bb9e3847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:07.061059 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-815ca84b-39fb-4850-bf71-5bf3bb9e3847 None None] MFA Rules not processed for user `1f09a9a483934c88a06be690f02fba4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:07.063374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-815ca84b-39fb-4850-bf71-5bf3bb9e3847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:07.125370 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 884/1772] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:06 2022] POST /identity/v3/projects => generated 379 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:07.127477 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898403e-f018-4d37-9c10-b9eab481868a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:07.128081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898403e-f018-4d37-9c10-b9eab481868a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:07.138174 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898403e-f018-4d37-9c10-b9eab481868a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:07.173346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 889/1773] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:07.174578 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ca84b-39fb-4850-bf71-5bf3bb9e3847 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:07.193580 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ca84b-39fb-4850-bf71-5bf3bb9e3847 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:07.252762 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-1898403e-f018-4d37-9c10-b9eab481868a None None] MFA Rules not processed for user `01113a3f8cbf46b09fb5fcf4315a219b`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:07.267362 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1898403e-f018-4d37-9c10-b9eab481868a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:07.305903 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f079d-6459-4559-8e0e-f99c102deaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:07.306722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f079d-6459-4559-8e0e-f99c102deaf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:07.307791 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f079d-6459-4559-8e0e-f99c102deaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:07.308078 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f079d-6459-4559-8e0e-f99c102deaf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:07.309684 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f079d-6459-4559-8e0e-f99c102deaf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:07.313064 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2f079d-6459-4559-8e0e-f99c102deaf0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:07.328238 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 890/1774] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:07.329392 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f079d-6459-4559-8e0e-f99c102deaf0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:07.354170 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2f079d-6459-4559-8e0e-f99c102deaf0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:07.360804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53858b-cc0c-4919-bab3-1fdb7c05c435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:07.361149 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53858b-cc0c-4919-bab3-1fdb7c05c435 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:07.361645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53858b-cc0c-4919-bab3-1fdb7c05c435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:07.362231 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f53858b-cc0c-4919-bab3-1fdb7c05c435 admin admin] PATH_INFO: `/v3/projects/263e7d75fc8048db99bb8606756acb3e/users/c457b682f9c8404baf9b1d957dacf4ad/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:07.385568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53858b-cc0c-4919-bab3-1fdb7c05c435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=263e7d75fc8048db99bb8606756acb3e, user_id=c457b682f9c8404baf9b1d957dacf4ad, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:07.389545 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f53858b-cc0c-4919-bab3-1fdb7c05c435 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:07.436763 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 885/1775] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jul 18 02:37:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:07.437789 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898403e-f018-4d37-9c10-b9eab481868a None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:07.449618 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898403e-f018-4d37-9c10-b9eab481868a None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:07.455640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6b25b-48b7-438c-9249-5bc934718971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:07.456328 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6b25b-48b7-438c-9249-5bc934718971 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:07.456613 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6b25b-48b7-438c-9249-5bc934718971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:07.456892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6b25b-48b7-438c-9249-5bc934718971 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:07.457583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6b25b-48b7-438c-9249-5bc934718971 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:07.460495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6b25b-48b7-438c-9249-5bc934718971 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:07.571501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 891/1776] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:07 2022] PUT /identity/v3/projects/263e7d75fc8048db99bb8606756acb3e/users/c457b682f9c8404baf9b1d957dacf4ad/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:07.572721 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53858b-cc0c-4919-bab3-1fdb7c05c435 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:07.580655 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3f53858b-cc0c-4919-bab3-1fdb7c05c435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:07.621590 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 886/1777] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:07 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:07.621590 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6b25b-48b7-438c-9249-5bc934718971 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:07.635215 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6b25b-48b7-438c-9249-5bc934718971 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:07.747980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f53858b-cc0c-4919-bab3-1fdb7c05c435 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:07.757269 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831b378-162b-413a-a4a4-8ce6cb40ce38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:07.758479 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831b378-162b-413a-a4a4-8ce6cb40ce38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:07.758479 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831b378-162b-413a-a4a4-8ce6cb40ce38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:07.758787 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831b378-162b-413a-a4a4-8ce6cb40ce38 admin admin] PATH_INFO: `/v3/projects/86c89000d6504fc7939c2d1df19cfdf9/users/17b99c6ceb8342daaca682992125c123/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:07.759655 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000209b-d073-4664-88c2-cbb82380ea8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:07.760541 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000209b-d073-4664-88c2-cbb82380ea8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:07.760824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000209b-d073-4664-88c2-cbb82380ea8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:07.761102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000209b-d073-4664-88c2-cbb82380ea8c admin admin] PATH_INFO: `/v3/projects/ef830e8e94c14ee498a0218fda8710eb` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:07.763680 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000209b-d073-4664-88c2-cbb82380ea8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef830e8e94c14ee498a0218fda8710eb)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:07.765612 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000209b-d073-4664-88c2-cbb82380ea8c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:07.768625 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831b378-162b-413a-a4a4-8ce6cb40ce38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86c89000d6504fc7939c2d1df19cfdf9, user_id=17b99c6ceb8342daaca682992125c123, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:07.771356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831b378-162b-413a-a4a4-8ce6cb40ce38 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:07.787198 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 887/1778] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:07 2022] PUT /identity/v3/projects/86c89000d6504fc7939c2d1df19cfdf9/users/17b99c6ceb8342daaca682992125c123/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:07.789078 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831b378-162b-413a-a4a4-8ce6cb40ce38 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:07.937731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831b378-162b-413a-a4a4-8ce6cb40ce38 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:07.955611 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385f9a7-695d-444b-8a80-dbd203836b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:07.956597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385f9a7-695d-444b-8a80-dbd203836b56 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:07.958441 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385f9a7-695d-444b-8a80-dbd203836b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:07.958734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385f9a7-695d-444b-8a80-dbd203836b56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:07.960401 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385f9a7-695d-444b-8a80-dbd203836b56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:07.971646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5385f9a7-695d-444b-8a80-dbd203836b56 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:07.993243 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a000209b-d073-4664-88c2-cbb82380ea8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef830e8e94c14ee498a0218fda8710eb', 'request_id': 'req-a000209b-d073-4664-88c2-cbb82380ea8c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:07.995211 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 888/1779] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:07.996683 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385f9a7-695d-444b-8a80-dbd203836b56 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:08.017480 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5385f9a7-695d-444b-8a80-dbd203836b56 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:08.026549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a000209b-d073-4664-88c2-cbb82380ea8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef830e8e94c14ee498a0218fda8710eb', 'request_id': 'req-a000209b-d073-4664-88c2-cbb82380ea8c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:08.051251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a000209b-d073-4664-88c2-cbb82380ea8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef830e8e94c14ee498a0218fda8710eb', 'request_id': 'req-a000209b-d073-4664-88c2-cbb82380ea8c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:08.135258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a000209b-d073-4664-88c2-cbb82380ea8c admin admin] The token cache is being invalidate because project ef830e8e94c14ee498a0218fda8710eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:08.135424 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a000209b-d073-4664-88c2-cbb82380ea8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:08.136315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a000209b-d073-4664-88c2-cbb82380ea8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:08.138849 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 892/1780] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:07 2022] DELETE /identity/v3/projects/ef830e8e94c14ee498a0218fda8710eb => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:08.148641 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3aacf-fae5-4844-96fe-cae9b2608928 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:08.149113 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3aacf-fae5-4844-96fe-cae9b2608928 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:08.149634 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3aacf-fae5-4844-96fe-cae9b2608928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:08.159960 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15654b71-07c4-4a7a-89a6-d7f1acd37eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:08.159960 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15654b71-07c4-4a7a-89a6-d7f1acd37eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:08.159960 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15654b71-07c4-4a7a-89a6-d7f1acd37eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:08.159960 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15654b71-07c4-4a7a-89a6-d7f1acd37eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:08.160995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15654b71-07c4-4a7a-89a6-d7f1acd37eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:08.160995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15654b71-07c4-4a7a-89a6-d7f1acd37eb0 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:08.174725 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 889/1781] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:08.175936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15654b71-07c4-4a7a-89a6-d7f1acd37eb0 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:08.179466 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-15654b71-07c4-4a7a-89a6-d7f1acd37eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:08.199693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-59c3aacf-fae5-4844-96fe-cae9b2608928 None None] MFA Rules not processed for user `17b99c6ceb8342daaca682992125c123`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:08.201113 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-59c3aacf-fae5-4844-96fe-cae9b2608928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:08.276953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:08.340477 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15654b71-07c4-4a7a-89a6-d7f1acd37eb0 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:08.345046 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e09e93-68f1-415d-ad06-9c8b3297a86f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4e51f478874d99a7fc4ee2dea77caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:08.345744 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e09e93-68f1-415d-ad06-9c8b3297a86f service swift] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:08.346125 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e09e93-68f1-415d-ad06-9c8b3297a86f service swift] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:08.346303 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e09e93-68f1-415d-ad06-9c8b3297a86f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:08.348181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d2e09e93-68f1-415d-ad06-9c8b3297a86f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:08.390694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 893/1782] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:08 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:08.392962 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19b049-5baf-4136-a3e4-41df09367ad4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:08.393424 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19b049-5baf-4136-a3e4-41df09367ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:08.393911 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19b049-5baf-4136-a3e4-41df09367ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:08.415940 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3c19b049-5baf-4136-a3e4-41df09367ad4 None None] MFA Rules not processed for user `fa9e6d3fe3e740e6aedab33d727ec478`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:08.431989 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3c19b049-5baf-4136-a3e4-41df09367ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:08.461646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e09e93-68f1-415d-ad06-9c8b3297a86f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:08.463377 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e09e93-68f1-415d-ad06-9c8b3297a86f service swift] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:08.472873 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 890/1783] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jul 18 02:37:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 02:37:08.473790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e09e93-68f1-415d-ad06-9c8b3297a86f service swift] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:08.475402 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d2e09e93-68f1-415d-ad06-9c8b3297a86f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:08.490947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e09e93-68f1-415d-ad06-9c8b3297a86f service swift] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:08.494354 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 894/1784] 10.222.0.75 () {58 vars in 1015 bytes} [Mon Jul 18 02:37:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:08.495815 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b626b48-12d3-490f-9218-3a8058d3bd85 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:08.496146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b626b48-12d3-490f-9218-3a8058d3bd85 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:08.496276 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fca8c-0e24-4783-8179-f7522d4efd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:08.496429 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b626b48-12d3-490f-9218-3a8058d3bd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:08.497080 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fca8c-0e24-4783-8179-f7522d4efd3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:08.497370 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fca8c-0e24-4783-8179-f7522d4efd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:08.497651 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fca8c-0e24-4783-8179-f7522d4efd3b admin admin] PATH_INFO: `/v3/projects/263e7d75fc8048db99bb8606756acb3e/users/c457b682f9c8404baf9b1d957dacf4ad/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:08.499769 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fca8c-0e24-4783-8179-f7522d4efd3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=263e7d75fc8048db99bb8606756acb3e, user_id=c457b682f9c8404baf9b1d957dacf4ad, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:08.502630 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fca8c-0e24-4783-8179-f7522d4efd3b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:08.519531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5b626b48-12d3-490f-9218-3a8058d3bd85 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:08.520752 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 891/1785] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:08 2022] PUT /identity/v3/projects/263e7d75fc8048db99bb8606756acb3e/users/c457b682f9c8404baf9b1d957dacf4ad/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:08.521275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5b626b48-12d3-490f-9218-3a8058d3bd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:08.521870 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fca8c-0e24-4783-8179-f7522d4efd3b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:08.523751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c13fca8c-0e24-4783-8179-f7522d4efd3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:08.703088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 895/1786] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:08.703980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b626b48-12d3-490f-9218-3a8058d3bd85 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:08.705427 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5b626b48-12d3-490f-9218-3a8058d3bd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:08.780008 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fca8c-0e24-4783-8179-f7522d4efd3b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:08.798532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639d88c-dbd2-4eff-990a-eab3011ae8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:08.799243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639d88c-dbd2-4eff-990a-eab3011ae8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:08.802721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639d88c-dbd2-4eff-990a-eab3011ae8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:08.803065 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639d88c-dbd2-4eff-990a-eab3011ae8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:08.807669 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639d88c-dbd2-4eff-990a-eab3011ae8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:08.815171 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639d88c-dbd2-4eff-990a-eab3011ae8a7 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:08.861438 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b626b48-12d3-490f-9218-3a8058d3bd85 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:08.868252 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8973371c-5876-41d8-a4df-74c1e30cb877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:08.868443 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 892/1787] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:08.868584 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973371c-5876-41d8-a4df-74c1e30cb877 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:08.868584 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973371c-5876-41d8-a4df-74c1e30cb877 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:08.868865 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8973371c-5876-41d8-a4df-74c1e30cb877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:08.870356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639d88c-dbd2-4eff-990a-eab3011ae8a7 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:08.873820 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5639d88c-dbd2-4eff-990a-eab3011ae8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:09.092126 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639d88c-dbd2-4eff-990a-eab3011ae8a7 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:09.100354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c3c0f-2252-453f-8ece-09f2f73874f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:09.101096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c3c0f-2252-453f-8ece-09f2f73874f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:09.101392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c3c0f-2252-453f-8ece-09f2f73874f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:09.101672 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c3c0f-2252-453f-8ece-09f2f73874f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:09.113298 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973371c-5876-41d8-a4df-74c1e30cb877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:09.114815 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c3c0f-2252-453f-8ece-09f2f73874f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:09.117695 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c3c0f-2252-453f-8ece-09f2f73874f3 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:09.119377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8973371c-5876-41d8-a4df-74c1e30cb877 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:09.147819 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 893/1788] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:09.151102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3224fa9-df60-401e-af5d-9a80c19fde78 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:09.155440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3224fa9-df60-401e-af5d-9a80c19fde78 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:09.155440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3224fa9-df60-401e-af5d-9a80c19fde78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:09.159041 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 896/1789] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:08 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:09.162214 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b38c9-9d99-409f-b68c-f390b2207648 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:09.162214 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b38c9-9d99-409f-b68c-f390b2207648 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:09.162214 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81b38c9-9d99-409f-b68c-f390b2207648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:09.214019 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d81b38c9-9d99-409f-b68c-f390b2207648 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:09.216452 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d81b38c9-9d99-409f-b68c-f390b2207648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:09.247423 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c3224fa9-df60-401e-af5d-9a80c19fde78 None None] MFA Rules not processed for user `c457b682f9c8404baf9b1d957dacf4ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:09.248753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c3224fa9-df60-401e-af5d-9a80c19fde78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:09.249098 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 897/1790] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:09.250365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b38c9-9d99-409f-b68c-f390b2207648 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:09.289007 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81b38c9-9d99-409f-b68c-f390b2207648 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:09.315522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80492fc-1f09-4eca-a1a9-d9fdaf52e518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:09.317836 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80492fc-1f09-4eca-a1a9-d9fdaf52e518 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:09.319398 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80492fc-1f09-4eca-a1a9-d9fdaf52e518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:09.319717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80492fc-1f09-4eca-a1a9-d9fdaf52e518 admin admin] PATH_INFO: `/v3/projects/712264effe3a4c7e887555d90c3e6796/users/cabe1125fb484c28a9844bb5bb22841e/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:09.366356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80492fc-1f09-4eca-a1a9-d9fdaf52e518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=712264effe3a4c7e887555d90c3e6796, user_id=cabe1125fb484c28a9844bb5bb22841e, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:09.369426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80492fc-1f09-4eca-a1a9-d9fdaf52e518 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:09.401265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 894/1791] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:09 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:09.417123 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3224fa9-df60-401e-af5d-9a80c19fde78 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:09.466296 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3224fa9-df60-401e-af5d-9a80c19fde78 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:09.483909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad546c0-003c-46b1-99f9-a9aeee27a849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:09.484602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad546c0-003c-46b1-99f9-a9aeee27a849 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:09.485224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad546c0-003c-46b1-99f9-a9aeee27a849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:09.485514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad546c0-003c-46b1-99f9-a9aeee27a849 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:09.486294 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad546c0-003c-46b1-99f9-a9aeee27a849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:37:09.486752 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad546c0-003c-46b1-99f9-a9aeee27a849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:09.488452 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad546c0-003c-46b1-99f9-a9aeee27a849 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:09.518333 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 895/1792] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:37:09.518333 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad546c0-003c-46b1-99f9-a9aeee27a849 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:09.520204 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2ad546c0-003c-46b1-99f9-a9aeee27a849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:09.535488 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad546c0-003c-46b1-99f9-a9aeee27a849 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:09.540806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833ff37-da9a-4411-80c0-b257e7103790 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:09.540994 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833ff37-da9a-4411-80c0-b257e7103790 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:09.541182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833ff37-da9a-4411-80c0-b257e7103790 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:09.541415 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833ff37-da9a-4411-80c0-b257e7103790 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:09.578347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 898/1793] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:09 2022] PUT /identity/v3/projects/712264effe3a4c7e887555d90c3e6796/users/cabe1125fb484c28a9844bb5bb22841e/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:09.584349 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833ff37-da9a-4411-80c0-b257e7103790 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:09.587460 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833ff37-da9a-4411-80c0-b257e7103790 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:09.590961 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80492fc-1f09-4eca-a1a9-d9fdaf52e518 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:09.612476 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 896/1794] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:09 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:09.614528 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9a309-416a-4f39-ad94-adc679125d7d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:09.615116 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9a309-416a-4f39-ad94-adc679125d7d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:09.615626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9a309-416a-4f39-ad94-adc679125d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:09.660129 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9db9a309-416a-4f39-ad94-adc679125d7d None None] MFA Rules not processed for user `cabe1125fb484c28a9844bb5bb22841e`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:09.662720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9db9a309-416a-4f39-ad94-adc679125d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:09.747726 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80492fc-1f09-4eca-a1a9-d9fdaf52e518 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:09.775480 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22ed22-d89e-4d0a-a95d-7c8dd314d289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:09.776741 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22ed22-d89e-4d0a-a95d-7c8dd314d289 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:09.776741 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22ed22-d89e-4d0a-a95d-7c8dd314d289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:09.776741 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22ed22-d89e-4d0a-a95d-7c8dd314d289 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:09.778076 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22ed22-d89e-4d0a-a95d-7c8dd314d289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:09.780047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22ed22-d89e-4d0a-a95d-7c8dd314d289 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:09.882761 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 897/1795] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:09.883702 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9a309-416a-4f39-ad94-adc679125d7d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:09.975171 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9a309-416a-4f39-ad94-adc679125d7d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:09.980699 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e8dc6-535e-45e1-8f25-396fc8d31095 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:09.981726 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e8dc6-535e-45e1-8f25-396fc8d31095 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:09.982437 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e8dc6-535e-45e1-8f25-396fc8d31095 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:09.982970 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98e8dc6-535e-45e1-8f25-396fc8d31095 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:09.985560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e98e8dc6-535e-45e1-8f25-396fc8d31095 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:09.998393 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 899/1796] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:09 2022] POST /identity/v3/projects => generated 363 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:10.000865 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22ed22-d89e-4d0a-a95d-7c8dd314d289 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:10.026833 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:10.209785 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e8dc6-535e-45e1-8f25-396fc8d31095 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:10.209785 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98e8dc6-535e-45e1-8f25-396fc8d31095 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:10.210632 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22ed22-d89e-4d0a-a95d-7c8dd314d289 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:10.210632 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106eb0f-97b0-47c8-ae96-3d54b3ebacde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:10.210632 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106eb0f-97b0-47c8-ae96-3d54b3ebacde admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:10.210632 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106eb0f-97b0-47c8-ae96-3d54b3ebacde admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:10.211189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106eb0f-97b0-47c8-ae96-3d54b3ebacde admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:10.211189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106eb0f-97b0-47c8-ae96-3d54b3ebacde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:10.211352 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 898/1797] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:09 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:10.211352 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e8dc6-535e-45e1-8f25-396fc8d31095 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:10.211529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106eb0f-97b0-47c8-ae96-3d54b3ebacde admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:10.211617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98e8dc6-535e-45e1-8f25-396fc8d31095 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:10.211617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde6cb5-3b67-4a1a-a9d1-843418d96172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:10.211617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde6cb5-3b67-4a1a-a9d1-843418d96172 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:10.211617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde6cb5-3b67-4a1a-a9d1-843418d96172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:10.211937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcde6cb5-3b67-4a1a-a9d1-843418d96172 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:10.211937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde6cb5-3b67-4a1a-a9d1-843418d96172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:10.211937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcde6cb5-3b67-4a1a-a9d1-843418d96172 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:10.527384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 899/1798] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:10 2022] POST /identity/v3/users => generated 282 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:10.533560 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 900/1799] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:09 2022] POST /identity/v3/projects => generated 379 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:10.534839 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106eb0f-97b0-47c8-ae96-3d54b3ebacde admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:10.542034 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde6cb5-3b67-4a1a-a9d1-843418d96172 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:10.571750 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcde6cb5-3b67-4a1a-a9d1-843418d96172 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:10.643551 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106eb0f-97b0-47c8-ae96-3d54b3ebacde admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:10.652254 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43767405-0adb-487a-ba59-3e13ea653d73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:10.652947 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43767405-0adb-487a-ba59-3e13ea653d73 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:10.653238 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43767405-0adb-487a-ba59-3e13ea653d73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:10.653695 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43767405-0adb-487a-ba59-3e13ea653d73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:10.658228 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-43767405-0adb-487a-ba59-3e13ea653d73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:10.746910 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:10.765376 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30650b-dbe1-4ea9-b5dd-52f983efb8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:10.766376 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30650b-dbe1-4ea9-b5dd-52f983efb8fc admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:10.766782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30650b-dbe1-4ea9-b5dd-52f983efb8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:10.767164 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30650b-dbe1-4ea9-b5dd-52f983efb8fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:10.768217 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30650b-dbe1-4ea9-b5dd-52f983efb8fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:10.771525 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30650b-dbe1-4ea9-b5dd-52f983efb8fc admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:10.831049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 900/1800] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:10.838469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30650b-dbe1-4ea9-b5dd-52f983efb8fc admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:10.858649 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43767405-0adb-487a-ba59-3e13ea653d73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:10.861830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43767405-0adb-487a-ba59-3e13ea653d73 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:10.884497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 901/1801] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:10 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:10.884716 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30650b-dbe1-4ea9-b5dd-52f983efb8fc admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:10.885583 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43767405-0adb-487a-ba59-3e13ea653d73 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:10.891246 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d8935-20b1-4c9e-a8c8-d3fa23d1eb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:10.892287 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d8935-20b1-4c9e-a8c8-d3fa23d1eb63 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:10.893594 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d8935-20b1-4c9e-a8c8-d3fa23d1eb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:10.894063 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679d8935-20b1-4c9e-a8c8-d3fa23d1eb63 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:10.898718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d8935-20b1-4c9e-a8c8-d3fa23d1eb63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:10.898718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679d8935-20b1-4c9e-a8c8-d3fa23d1eb63 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:10.910780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43767405-0adb-487a-ba59-3e13ea653d73 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:10.946620 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8bd28-1089-47eb-b99d-3479c4370ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:10.946620 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8bd28-1089-47eb-b99d-3479c4370ddd admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:10.946620 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8bd28-1089-47eb-b99d-3479c4370ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:10.946620 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8bd28-1089-47eb-b99d-3479c4370ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:10.946956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8bd28-1089-47eb-b99d-3479c4370ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:10.950317 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8bd28-1089-47eb-b99d-3479c4370ddd admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:10.968038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 902/1802] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:10.969404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8bd28-1089-47eb-b99d-3479c4370ddd admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:10.984393 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8bd28-1089-47eb-b99d-3479c4370ddd admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:10.994224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308d10e-fd76-4873-81e9-0f6b3ecd01c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:10.997089 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308d10e-fd76-4873-81e9-0f6b3ecd01c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:10.997818 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308d10e-fd76-4873-81e9-0f6b3ecd01c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:10.998412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308d10e-fd76-4873-81e9-0f6b3ecd01c0 admin admin] PATH_INFO: `/v3/projects/286238a6a014405b9277acc79bf06c48/users/ec07945499c7408191b9e2b8e255ab4a/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:11.034638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308d10e-fd76-4873-81e9-0f6b3ecd01c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=286238a6a014405b9277acc79bf06c48, user_id=ec07945499c7408191b9e2b8e255ab4a, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:11.038223 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308d10e-fd76-4873-81e9-0f6b3ecd01c0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:11.055609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 901/1803] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:10 2022] POST /identity/v3/users => generated 296 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:11.057608 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d8935-20b1-4c9e-a8c8-d3fa23d1eb63 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:11.076360 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679d8935-20b1-4c9e-a8c8-d3fa23d1eb63 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:11.082873 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28583ec9-31bb-4970-8c9a-628de3efb613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:11.086493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28583ec9-31bb-4970-8c9a-628de3efb613 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:11.086493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28583ec9-31bb-4970-8c9a-628de3efb613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:11.086493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28583ec9-31bb-4970-8c9a-628de3efb613 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:11.086493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28583ec9-31bb-4970-8c9a-628de3efb613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:11.088353 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28583ec9-31bb-4970-8c9a-628de3efb613 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:11.113063 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 902/1804] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:11.114405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28583ec9-31bb-4970-8c9a-628de3efb613 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:11.134420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28583ec9-31bb-4970-8c9a-628de3efb613 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:11.158895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7425d-6821-4bc5-94be-6ad171c33fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:11.159895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7425d-6821-4bc5-94be-6ad171c33fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:11.160187 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7425d-6821-4bc5-94be-6ad171c33fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:11.160469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b7425d-6821-4bc5-94be-6ad171c33fe5 admin admin] PATH_INFO: `/v3/projects/12cccea47e4f4f6cb4a87577a1cc4cdc/users/75c3aa3294f14578aa0442d0697615eb/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:11.181327 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 903/1805] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:10 2022] PUT /identity/v3/projects/286238a6a014405b9277acc79bf06c48/users/ec07945499c7408191b9e2b8e255ab4a/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:11.192305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103dd64-8bb2-48d1-9211-720b09fbf94b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:11.193995 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103dd64-8bb2-48d1-9211-720b09fbf94b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:11.194558 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9103dd64-8bb2-48d1-9211-720b09fbf94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:11.210246 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7425d-6821-4bc5-94be-6ad171c33fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12cccea47e4f4f6cb4a87577a1cc4cdc, user_id=75c3aa3294f14578aa0442d0697615eb, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:11.213370 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b7425d-6821-4bc5-94be-6ad171c33fe5 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:11.295327 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-9103dd64-8bb2-48d1-9211-720b09fbf94b None None] MFA Rules not processed for user `ec07945499c7408191b9e2b8e255ab4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:11.296695 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9103dd64-8bb2-48d1-9211-720b09fbf94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:11.326327 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 903/1806] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:11 2022] PUT /identity/v3/projects/12cccea47e4f4f6cb4a87577a1cc4cdc/users/75c3aa3294f14578aa0442d0697615eb/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:11.330800 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7425d-6821-4bc5-94be-6ad171c33fe5 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:11.516080 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 904/1807] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:11 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:11.516080 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fe9c7-3781-4f1c-8815-a6e21f5d7911 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:11.522567 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fe9c7-3781-4f1c-8815-a6e21f5d7911 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:11.522567 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fe9c7-3781-4f1c-8815-a6e21f5d7911 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:11.522567 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 905/1808] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jul 18 02:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:37:11.523431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fe9c7-3781-4f1c-8815-a6e21f5d7911 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:11.533108 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b7425d-6821-4bc5-94be-6ad171c33fe5 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:11.538253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff970436-f381-4382-9f7c-7a3b9456c527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:11.539141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff970436-f381-4382-9f7c-7a3b9456c527 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:11.539506 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff970436-f381-4382-9f7c-7a3b9456c527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:11.539857 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff970436-f381-4382-9f7c-7a3b9456c527 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:11.540665 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff970436-f381-4382-9f7c-7a3b9456c527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:11.542683 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff970436-f381-4382-9f7c-7a3b9456c527 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:11.547937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fe9c7-3781-4f1c-8815-a6e21f5d7911 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:11.558064 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 904/1809] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:37:11.558064 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fa6b2-8447-4d54-9c02-c4d297e6ed22 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:11.558064 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fa6b2-8447-4d54-9c02-c4d297e6ed22 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:11.558064 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fa6b2-8447-4d54-9c02-c4d297e6ed22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:11.563167 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b826ee-e946-4a27-bbad-3c5f0a6cc1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:11.564228 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b826ee-e946-4a27-bbad-3c5f0a6cc1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:11.564789 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b826ee-e946-4a27-bbad-3c5f0a6cc1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:11.565229 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b826ee-e946-4a27-bbad-3c5f0a6cc1c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:11.566199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b826ee-e946-4a27-bbad-3c5f0a6cc1c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:11.570120 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b826ee-e946-4a27-bbad-3c5f0a6cc1c0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:11.585466 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-591fa6b2-8447-4d54-9c02-c4d297e6ed22 None None] MFA Rules not processed for user `6f51aae36f0b42868567840fa957ffe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:11.586820 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-591fa6b2-8447-4d54-9c02-c4d297e6ed22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:11.692734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:11.723633 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 906/1810] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:11 2022] POST /identity/v3/projects => generated 361 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:11.728153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b826ee-e946-4a27-bbad-3c5f0a6cc1c0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:11.756690 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 905/1811] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jul 18 02:37:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:11.758807 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fa6b2-8447-4d54-9c02-c4d297e6ed22 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:11.769206 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fa6b2-8447-4d54-9c02-c4d297e6ed22 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:11.840958 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b826ee-e946-4a27-bbad-3c5f0a6cc1c0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:11.858519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c75f8-5a04-41b1-9c88-26c5c1f6cb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:11.861640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4037a-e0b1-48e4-a0ca-0fd806e78df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:11.861896 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c75f8-5a04-41b1-9c88-26c5c1f6cb20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:11.861896 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c75f8-5a04-41b1-9c88-26c5c1f6cb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:11.861896 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c75f8-5a04-41b1-9c88-26c5c1f6cb20 admin admin] PATH_INFO: `/v3/projects/12cccea47e4f4f6cb4a87577a1cc4cdc/users/75c3aa3294f14578aa0442d0697615eb/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:11.862168 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4037a-e0b1-48e4-a0ca-0fd806e78df4 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:11.862168 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4037a-e0b1-48e4-a0ca-0fd806e78df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:11.862168 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4037a-e0b1-48e4-a0ca-0fd806e78df4 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:11.862168 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4037a-e0b1-48e4-a0ca-0fd806e78df4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:11.862439 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c75f8-5a04-41b1-9c88-26c5c1f6cb20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12cccea47e4f4f6cb4a87577a1cc4cdc, user_id=75c3aa3294f14578aa0442d0697615eb, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:11.863824 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4037a-e0b1-48e4-a0ca-0fd806e78df4 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:11.865645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c75f8-5a04-41b1-9c88-26c5c1f6cb20 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:11.895717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 907/1812] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:11 2022] PUT /identity/v3/projects/12cccea47e4f4f6cb4a87577a1cc4cdc/users/75c3aa3294f14578aa0442d0697615eb/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:11.895717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c75f8-5a04-41b1-9c88-26c5c1f6cb20 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:11.895717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c56c75f8-5a04-41b1-9c88-26c5c1f6cb20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:11.984940 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c75f8-5a04-41b1-9c88-26c5c1f6cb20 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:11.992723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7418d01-a108-4785-ba4b-e848c2ff33be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:11.993507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7418d01-a108-4785-ba4b-e848c2ff33be service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:11.993950 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7418d01-a108-4785-ba4b-e848c2ff33be service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:11.994384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7418d01-a108-4785-ba4b-e848c2ff33be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:12.007662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7418d01-a108-4785-ba4b-e848c2ff33be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:12.009745 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7418d01-a108-4785-ba4b-e848c2ff33be service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:12.011712 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 906/1813] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:11 2022] POST /identity/v3/users => generated 287 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:12.013009 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381e9f2-df75-4151-98de-129632d5f496 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:12.013412 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381e9f2-df75-4151-98de-129632d5f496 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:12.013830 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381e9f2-df75-4151-98de-129632d5f496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:12.023209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 908/1814] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:12.036883 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7418d01-a108-4785-ba4b-e848c2ff33be service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:12.057196 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c381e9f2-df75-4151-98de-129632d5f496 None None] MFA Rules not processed for user `75c3aa3294f14578aa0442d0697615eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:12.059195 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c381e9f2-df75-4151-98de-129632d5f496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:12.157856 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7418d01-a108-4785-ba4b-e848c2ff33be service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:12.166225 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de6960-a0f3-49b2-b490-4c062ff42f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:12.168561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de6960-a0f3-49b2-b490-4c062ff42f0e admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:12.168853 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de6960-a0f3-49b2-b490-4c062ff42f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:12.169136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de6960-a0f3-49b2-b490-4c062ff42f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:12.169901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de6960-a0f3-49b2-b490-4c062ff42f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:12.174912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de6960-a0f3-49b2-b490-4c062ff42f0e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:12.184121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 909/1815] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:12.188042 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de6960-a0f3-49b2-b490-4c062ff42f0e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:12.199972 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de6960-a0f3-49b2-b490-4c062ff42f0e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:12.206008 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16399a6d-8114-48f9-8028-e3fc9ffff8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:12.218660 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16399a6d-8114-48f9-8028-e3fc9ffff8cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:12.219185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16399a6d-8114-48f9-8028-e3fc9ffff8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:12.220296 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 907/1816] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:12.220739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16399a6d-8114-48f9-8028-e3fc9ffff8cc admin admin] PATH_INFO: `/v3/projects/571e6fb2633a4aea8b47bab9b5431e21/users/d2a8164e43154a1b8480b1fda5a24133/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:12.228465 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381e9f2-df75-4151-98de-129632d5f496 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:12.253102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16399a6d-8114-48f9-8028-e3fc9ffff8cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=571e6fb2633a4aea8b47bab9b5431e21, user_id=d2a8164e43154a1b8480b1fda5a24133, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:12.257501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16399a6d-8114-48f9-8028-e3fc9ffff8cc admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:12.326759 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381e9f2-df75-4151-98de-129632d5f496 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:12.338078 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 910/1817] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:12 2022] PUT /identity/v3/projects/571e6fb2633a4aea8b47bab9b5431e21/users/d2a8164e43154a1b8480b1fda5a24133/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:12.354388 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16399a6d-8114-48f9-8028-e3fc9ffff8cc admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:12.495301 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16399a6d-8114-48f9-8028-e3fc9ffff8cc admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:12.500375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976155ca-dcb0-4d75-ab75-3aeb21a8fd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:12.501170 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976155ca-dcb0-4d75-ab75-3aeb21a8fd32 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:12.501379 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b6c7a-c570-4ad8-bba6-1f1126a62bcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:12.501549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976155ca-dcb0-4d75-ab75-3aeb21a8fd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:12.502012 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976155ca-dcb0-4d75-ab75-3aeb21a8fd32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:12.502599 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b6c7a-c570-4ad8-bba6-1f1126a62bcb service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:12.502901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976155ca-dcb0-4d75-ab75-3aeb21a8fd32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:12.503268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b6c7a-c570-4ad8-bba6-1f1126a62bcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:12.503724 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b6c7a-c570-4ad8-bba6-1f1126a62bcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:12.505855 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976155ca-dcb0-4d75-ab75-3aeb21a8fd32 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:12.521750 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 911/1818] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:12.526408 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976155ca-dcb0-4d75-ab75-3aeb21a8fd32 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:12.553628 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976155ca-dcb0-4d75-ab75-3aeb21a8fd32 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:12.583139 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620cb12a-1349-4eae-a938-dee7426df742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:12.591630 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cb12a-1349-4eae-a938-dee7426df742 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:12.591630 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cb12a-1349-4eae-a938-dee7426df742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:12.591630 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620cb12a-1349-4eae-a938-dee7426df742 admin admin] PATH_INFO: `/v3/projects/571e6fb2633a4aea8b47bab9b5431e21/users/d2a8164e43154a1b8480b1fda5a24133/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:12.612690 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620cb12a-1349-4eae-a938-dee7426df742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=571e6fb2633a4aea8b47bab9b5431e21, user_id=d2a8164e43154a1b8480b1fda5a24133, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:12.618774 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620cb12a-1349-4eae-a938-dee7426df742 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:12.654679 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 912/1819] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:12 2022] PUT /identity/v3/projects/571e6fb2633a4aea8b47bab9b5431e21/users/d2a8164e43154a1b8480b1fda5a24133/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:37:12.670868 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4094705-dfc0-4bf9-b78b-220cebc18f1b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:12.671834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4094705-dfc0-4bf9-b78b-220cebc18f1b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:12.671834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4094705-dfc0-4bf9-b78b-220cebc18f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:12.718094 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b6c7a-c570-4ad8-bba6-1f1126a62bcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:12.719628 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b6c7a-c570-4ad8-bba6-1f1126a62bcb service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:12.746783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 908/1820] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:12.786375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b4094705-dfc0-4bf9-b78b-220cebc18f1b None None] MFA Rules not processed for user `d2a8164e43154a1b8480b1fda5a24133`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:12.787758 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b4094705-dfc0-4bf9-b78b-220cebc18f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:12.919432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 913/1821] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:12 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:13.910330 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:14.144538 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b6c7a-c570-4ad8-bba6-1f1126a62bcb service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:14.154974 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b6c7a-c570-4ad8-bba6-1f1126a62bcb service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:14.223061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ad819-51ac-42ff-aa86-cec92c451bf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:14.224148 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ad819-51ac-42ff-aa86-cec92c451bf3 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:14.224628 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ad819-51ac-42ff-aa86-cec92c451bf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:14.225123 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ad819-51ac-42ff-aa86-cec92c451bf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:14.254922 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ad819-51ac-42ff-aa86-cec92c451bf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:14.256971 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ad819-51ac-42ff-aa86-cec92c451bf3 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:14.265009 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:14.271267 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 909/1822] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:14 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:14.888619 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4094705-dfc0-4bf9-b78b-220cebc18f1b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:14.921461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4094705-dfc0-4bf9-b78b-220cebc18f1b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:14.929493 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1c48a-d9a6-4ebc-949d-86d2c38b8c16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:14.930416 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1c48a-d9a6-4ebc-949d-86d2c38b8c16 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:14.930736 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1c48a-d9a6-4ebc-949d-86d2c38b8c16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:14.931135 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1c48a-d9a6-4ebc-949d-86d2c38b8c16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:15.034288 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1c48a-d9a6-4ebc-949d-86d2c38b8c16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:15.036008 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1c48a-d9a6-4ebc-949d-86d2c38b8c16 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:15.049047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 914/1823] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:14 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:16.279557 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ad819-51ac-42ff-aa86-cec92c451bf3 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:16.290024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ad819-51ac-42ff-aa86-cec92c451bf3 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:16.296172 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf088ed0-49fa-483d-af51-259bd5b3cbd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:16.297091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf088ed0-49fa-483d-af51-259bd5b3cbd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:16.297576 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf088ed0-49fa-483d-af51-259bd5b3cbd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:16.298038 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf088ed0-49fa-483d-af51-259bd5b3cbd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:16.438702 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:16.444089 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf088ed0-49fa-483d-af51-259bd5b3cbd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:16.445971 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf088ed0-49fa-483d-af51-259bd5b3cbd6 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:16.446458 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1c48a-d9a6-4ebc-949d-86d2c38b8c16 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:16.451424 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-05c1c48a-d9a6-4ebc-949d-86d2c38b8c16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:16.485798 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 910/1824] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:16.524990 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1c48a-d9a6-4ebc-949d-86d2c38b8c16 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:16.530799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb99cd-7768-4b22-829c-3c4c7f4835c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:16.531887 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb99cd-7768-4b22-829c-3c4c7f4835c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:16.532464 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb99cd-7768-4b22-829c-3c4c7f4835c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:16.535805 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb99cd-7768-4b22-829c-3c4c7f4835c9 admin admin] PATH_INFO: `/v3/users/68cafd1890fc4d08820e0bb5f0c77bc3` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:16.539134 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb99cd-7768-4b22-829c-3c4c7f4835c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68cafd1890fc4d08820e0bb5f0c77bc3)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:16.544636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb99cd-7768-4b22-829c-3c4c7f4835c9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:16.790092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36bb99cd-7768-4b22-829c-3c4c7f4835c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68cafd1890fc4d08820e0bb5f0c77bc3'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:16.790092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36bb99cd-7768-4b22-829c-3c4c7f4835c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68cafd1890fc4d08820e0bb5f0c77bc3'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:16.790092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36bb99cd-7768-4b22-829c-3c4c7f4835c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68cafd1890fc4d08820e0bb5f0c77bc3'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:16.816655 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36bb99cd-7768-4b22-829c-3c4c7f4835c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68cafd1890fc4d08820e0bb5f0c77bc3'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:16.882653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:17.009722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36bb99cd-7768-4b22-829c-3c4c7f4835c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68cafd1890fc4d08820e0bb5f0c77bc3'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:17.033078 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 915/1825] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:16 2022] DELETE /identity/v3/users/68cafd1890fc4d08820e0bb5f0c77bc3 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:17.034825 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8a38f-e2a3-4b79-872b-574f92bcafb4 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:17.034825 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8a38f-e2a3-4b79-872b-574f92bcafb4 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:17.035344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d8a38f-e2a3-4b79-872b-574f92bcafb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:17.053809 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-23d8a38f-e2a3-4b79-872b-574f92bcafb4 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:17.060701 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-23d8a38f-e2a3-4b79-872b-574f92bcafb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:17.163905 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 911/1826] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:37:17.175616 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb99cd-7768-4b22-829c-3c4c7f4835c9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:17.177330 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-36bb99cd-7768-4b22-829c-3c4c7f4835c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:17.249128 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb99cd-7768-4b22-829c-3c4c7f4835c9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:17.253536 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98335da2-eaa6-4484-8a3b-2a1009737e4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:17.254447 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98335da2-eaa6-4484-8a3b-2a1009737e4b service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:17.254973 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98335da2-eaa6-4484-8a3b-2a1009737e4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:17.255433 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98335da2-eaa6-4484-8a3b-2a1009737e4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:17.273328 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98335da2-eaa6-4484-8a3b-2a1009737e4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:17.275740 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98335da2-eaa6-4484-8a3b-2a1009737e4b service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:17.294347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 916/1827] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:17.972005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8a38f-e2a3-4b79-872b-574f92bcafb4 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:17.975674 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-23d8a38f-e2a3-4b79-872b-574f92bcafb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:17.995051 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d8a38f-e2a3-4b79-872b-574f92bcafb4 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:18.001973 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483c1c5-dc67-45d3-a64e-3ff58b959318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:18.003313 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483c1c5-dc67-45d3-a64e-3ff58b959318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:18.003796 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483c1c5-dc67-45d3-a64e-3ff58b959318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:18.004332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483c1c5-dc67-45d3-a64e-3ff58b959318 admin admin] PATH_INFO: `/v3/projects/1f9367d88ea04b8bacda4f7eaf195e98` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:18.006192 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483c1c5-dc67-45d3-a64e-3ff58b959318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f9367d88ea04b8bacda4f7eaf195e98)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:18.012962 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483c1c5-dc67-45d3-a64e-3ff58b959318 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:18.071430 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:18.226089 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f483c1c5-dc67-45d3-a64e-3ff58b959318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f9367d88ea04b8bacda4f7eaf195e98', 'request_id': 'req-f483c1c5-dc67-45d3-a64e-3ff58b959318'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:18.232071 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f483c1c5-dc67-45d3-a64e-3ff58b959318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f9367d88ea04b8bacda4f7eaf195e98', 'request_id': 'req-f483c1c5-dc67-45d3-a64e-3ff58b959318'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:18.240046 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f483c1c5-dc67-45d3-a64e-3ff58b959318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f9367d88ea04b8bacda4f7eaf195e98', 'request_id': 'req-f483c1c5-dc67-45d3-a64e-3ff58b959318'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:18.350952 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f483c1c5-dc67-45d3-a64e-3ff58b959318 admin admin] The token cache is being invalidate because project 1f9367d88ea04b8bacda4f7eaf195e98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:18.351554 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f483c1c5-dc67-45d3-a64e-3ff58b959318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:18.353007 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f483c1c5-dc67-45d3-a64e-3ff58b959318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:18.355825 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 912/1828] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:17 2022] DELETE /identity/v3/projects/1f9367d88ea04b8bacda4f7eaf195e98 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:18.361000 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98335da2-eaa6-4484-8a3b-2a1009737e4b service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:18.382018 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98335da2-eaa6-4484-8a3b-2a1009737e4b service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:18.518211 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a7358d-0f77-4486-a261-0d65fa22a3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:18.519933 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7358d-0f77-4486-a261-0d65fa22a3a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:18.520385 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7358d-0f77-4486-a261-0d65fa22a3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:18.520860 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a7358d-0f77-4486-a261-0d65fa22a3a0 admin admin] PATH_INFO: `/v3/users/fa29ec5e9d514de987ed87710aeeaf1e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:18.522462 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7358d-0f77-4486-a261-0d65fa22a3a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa29ec5e9d514de987ed87710aeeaf1e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:18.525439 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a7358d-0f77-4486-a261-0d65fa22a3a0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:18.755235 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483c1c5-dc67-45d3-a64e-3ff58b959318 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:18.756772 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f483c1c5-dc67-45d3-a64e-3ff58b959318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:18.781655 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483c1c5-dc67-45d3-a64e-3ff58b959318 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:18.787496 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843bf26-81a3-4aee-8723-323d11de7437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:18.789130 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843bf26-81a3-4aee-8723-323d11de7437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:18.789312 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-03a7358d-0f77-4486-a261-0d65fa22a3a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa29ec5e9d514de987ed87710aeeaf1e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:18.789834 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843bf26-81a3-4aee-8723-323d11de7437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:18.790184 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843bf26-81a3-4aee-8723-323d11de7437 admin admin] PATH_INFO: `/v3/users/d767b3ceecad4bf990cca01a075dc9b7` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:18.790728 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-03a7358d-0f77-4486-a261-0d65fa22a3a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa29ec5e9d514de987ed87710aeeaf1e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:18.791678 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843bf26-81a3-4aee-8723-323d11de7437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d767b3ceecad4bf990cca01a075dc9b7)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:18.792280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-03a7358d-0f77-4486-a261-0d65fa22a3a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa29ec5e9d514de987ed87710aeeaf1e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:18.794096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843bf26-81a3-4aee-8723-323d11de7437 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:18.808308 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-03a7358d-0f77-4486-a261-0d65fa22a3a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa29ec5e9d514de987ed87710aeeaf1e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:19.071663 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-03a7358d-0f77-4486-a261-0d65fa22a3a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa29ec5e9d514de987ed87710aeeaf1e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:19.094110 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 917/1829] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:18 2022] DELETE /identity/v3/users/fa29ec5e9d514de987ed87710aeeaf1e => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:19.138230 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:19.188300 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b843bf26-81a3-4aee-8723-323d11de7437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd767b3ceecad4bf990cca01a075dc9b7'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:19.189728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b843bf26-81a3-4aee-8723-323d11de7437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd767b3ceecad4bf990cca01a075dc9b7'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:19.190677 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b843bf26-81a3-4aee-8723-323d11de7437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd767b3ceecad4bf990cca01a075dc9b7'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:19.228856 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b843bf26-81a3-4aee-8723-323d11de7437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd767b3ceecad4bf990cca01a075dc9b7'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:19.248868 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b843bf26-81a3-4aee-8723-323d11de7437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd767b3ceecad4bf990cca01a075dc9b7'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:19.406299 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 913/1830] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:18 2022] DELETE /identity/v3/users/d767b3ceecad4bf990cca01a075dc9b7 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:19.411393 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af932642-b446-4ab6-b8ad-804f39ba1ab1 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:19.411904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af932642-b446-4ab6-b8ad-804f39ba1ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:19.411996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af932642-b446-4ab6-b8ad-804f39ba1ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:19.464779 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-af932642-b446-4ab6-b8ad-804f39ba1ab1 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:19.468582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-af932642-b446-4ab6-b8ad-804f39ba1ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:19.575108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 918/1831] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:37:19.595873 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843bf26-81a3-4aee-8723-323d11de7437 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:19.597382 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b843bf26-81a3-4aee-8723-323d11de7437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:19.734775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843bf26-81a3-4aee-8723-323d11de7437 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:19.742741 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138dbe52-88cc-4588-81c2-68a86148fd33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:19.744076 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dbe52-88cc-4588-81c2-68a86148fd33 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:19.744602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dbe52-88cc-4588-81c2-68a86148fd33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:19.745770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138dbe52-88cc-4588-81c2-68a86148fd33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:19.757876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138dbe52-88cc-4588-81c2-68a86148fd33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:19.759774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138dbe52-88cc-4588-81c2-68a86148fd33 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:19.779404 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 914/1832] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:20.856227 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af932642-b446-4ab6-b8ad-804f39ba1ab1 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:20.858589 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-af932642-b446-4ab6-b8ad-804f39ba1ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:20.875687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138dbe52-88cc-4588-81c2-68a86148fd33 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:20.881158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-138dbe52-88cc-4588-81c2-68a86148fd33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:20.888514 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af932642-b446-4ab6-b8ad-804f39ba1ab1 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:20.908542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138dbe52-88cc-4588-81c2-68a86148fd33 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:20.911337 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e05d18-7368-4a1f-92a6-b723db61dfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:20.912226 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e05d18-7368-4a1f-92a6-b723db61dfa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:20.915636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e05d18-7368-4a1f-92a6-b723db61dfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:20.915636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e05d18-7368-4a1f-92a6-b723db61dfa9 admin admin] PATH_INFO: `/v3/projects/3fed927895c44e2db1b405d4f212b29d` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:20.922552 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e05d18-7368-4a1f-92a6-b723db61dfa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fed927895c44e2db1b405d4f212b29d)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:20.928303 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e05d18-7368-4a1f-92a6-b723db61dfa9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:20.933412 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab36c3-27d4-47d8-8323-4ea2d9736254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:20.935683 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab36c3-27d4-47d8-8323-4ea2d9736254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:20.936156 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab36c3-27d4-47d8-8323-4ea2d9736254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:20.943236 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab36c3-27d4-47d8-8323-4ea2d9736254 admin admin] PATH_INFO: `/v3/projects/c656a6971d02441f809141e78602595c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:20.949012 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab36c3-27d4-47d8-8323-4ea2d9736254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c656a6971d02441f809141e78602595c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:20.952966 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab36c3-27d4-47d8-8323-4ea2d9736254 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:21.119102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d6ab36c3-27d4-47d8-8323-4ea2d9736254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c656a6971d02441f809141e78602595c', 'request_id': 'req-d6ab36c3-27d4-47d8-8323-4ea2d9736254'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:21.126047 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d6ab36c3-27d4-47d8-8323-4ea2d9736254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c656a6971d02441f809141e78602595c', 'request_id': 'req-d6ab36c3-27d4-47d8-8323-4ea2d9736254'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:21.133724 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d6ab36c3-27d4-47d8-8323-4ea2d9736254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c656a6971d02441f809141e78602595c', 'request_id': 'req-d6ab36c3-27d4-47d8-8323-4ea2d9736254'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:21.192300 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-86e05d18-7368-4a1f-92a6-b723db61dfa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fed927895c44e2db1b405d4f212b29d', 'request_id': 'req-86e05d18-7368-4a1f-92a6-b723db61dfa9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:21.199148 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-86e05d18-7368-4a1f-92a6-b723db61dfa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fed927895c44e2db1b405d4f212b29d', 'request_id': 'req-86e05d18-7368-4a1f-92a6-b723db61dfa9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:21.206210 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-86e05d18-7368-4a1f-92a6-b723db61dfa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fed927895c44e2db1b405d4f212b29d', 'request_id': 'req-86e05d18-7368-4a1f-92a6-b723db61dfa9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:21.266030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d6ab36c3-27d4-47d8-8323-4ea2d9736254 admin admin] The token cache is being invalidate because project c656a6971d02441f809141e78602595c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:21.266301 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d6ab36c3-27d4-47d8-8323-4ea2d9736254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:21.267065 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d6ab36c3-27d4-47d8-8323-4ea2d9736254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:21.268684 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 915/1833] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:20 2022] DELETE /identity/v3/projects/c656a6971d02441f809141e78602595c => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:21.273447 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed6305-c8ad-44cc-bc6f-2e6fb1766931 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:21.273782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed6305-c8ad-44cc-bc6f-2e6fb1766931 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:21.274328 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ed6305-c8ad-44cc-bc6f-2e6fb1766931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:21.294704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-f2ed6305-c8ad-44cc-bc6f-2e6fb1766931 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:21.296132 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f2ed6305-c8ad-44cc-bc6f-2e6fb1766931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:21.358722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 916/1834] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:37:21.366471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf197d-29a3-40bf-9647-6360683e878e None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:21.366998 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf197d-29a3-40bf-9647-6360683e878e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:21.367113 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cf197d-29a3-40bf-9647-6360683e878e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:21.386009 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-e6cf197d-29a3-40bf-9647-6360683e878e None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:21.387210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e6cf197d-29a3-40bf-9647-6360683e878e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:21.395629 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 917/1835] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:37:21.400070 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf197d-29a3-40bf-9647-6360683e878e None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:21.410403 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cf197d-29a3-40bf-9647-6360683e878e None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:21.419735 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe34b46-3797-463f-938d-15d5179d4426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:21.420467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe34b46-3797-463f-938d-15d5179d4426 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:21.420761 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe34b46-3797-463f-938d-15d5179d4426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:21.421066 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe34b46-3797-463f-938d-15d5179d4426 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:21.422516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe34b46-3797-463f-938d-15d5179d4426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:37:21.422516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe34b46-3797-463f-938d-15d5179d4426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:21.424428 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe34b46-3797-463f-938d-15d5179d4426 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:21.425559 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-86e05d18-7368-4a1f-92a6-b723db61dfa9 admin admin] The token cache is being invalidate because project 3fed927895c44e2db1b405d4f212b29d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:21.429619 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-86e05d18-7368-4a1f-92a6-b723db61dfa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:21.435351 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-86e05d18-7368-4a1f-92a6-b723db61dfa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:21.439130 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 918/1837] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:37:21.441204 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe34b46-3797-463f-938d-15d5179d4426 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:21.442932 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cbe34b46-3797-463f-938d-15d5179d4426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:21.444117 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 919/1837] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:20 2022] DELETE /identity/v3/projects/3fed927895c44e2db1b405d4f212b29d => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:21.445218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e05d18-7368-4a1f-92a6-b723db61dfa9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:21.446662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-86e05d18-7368-4a1f-92a6-b723db61dfa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:21.459365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe34b46-3797-463f-938d-15d5179d4426 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:21.466164 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422d9fe-2a48-45cf-a87e-81aaf4e666d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:21.467340 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422d9fe-2a48-45cf-a87e-81aaf4e666d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:21.467635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422d9fe-2a48-45cf-a87e-81aaf4e666d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:21.467906 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422d9fe-2a48-45cf-a87e-81aaf4e666d2 admin admin] PATH_INFO: `/v3/users/c457b682f9c8404baf9b1d957dacf4ad` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:21.471617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422d9fe-2a48-45cf-a87e-81aaf4e666d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c457b682f9c8404baf9b1d957dacf4ad)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:21.473602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422d9fe-2a48-45cf-a87e-81aaf4e666d2 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:21.477953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e05d18-7368-4a1f-92a6-b723db61dfa9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:21.482678 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70853d6f-086c-4d45-99fe-2a94430ae7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:21.483419 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70853d6f-086c-4d45-99fe-2a94430ae7da admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:21.483776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70853d6f-086c-4d45-99fe-2a94430ae7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:21.484278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70853d6f-086c-4d45-99fe-2a94430ae7da admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:21.485680 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70853d6f-086c-4d45-99fe-2a94430ae7da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:21.487802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70853d6f-086c-4d45-99fe-2a94430ae7da admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:21.710790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 920/1838] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:21 2022] POST /identity/v3/projects => generated 387 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:21.716630 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70853d6f-086c-4d45-99fe-2a94430ae7da admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:21.815446 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70853d6f-086c-4d45-99fe-2a94430ae7da admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:21.823593 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8d3fe-66d1-4a18-b874-7e77468bc22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:21.824826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8d3fe-66d1-4a18-b874-7e77468bc22b admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:21.825279 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8d3fe-66d1-4a18-b874-7e77468bc22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:21.825736 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8d3fe-66d1-4a18-b874-7e77468bc22b admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:21.826870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8d3fe-66d1-4a18-b874-7e77468bc22b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:21.829647 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c8d3fe-66d1-4a18-b874-7e77468bc22b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:21.862215 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d422d9fe-2a48-45cf-a87e-81aaf4e666d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c457b682f9c8404baf9b1d957dacf4ad'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:21.863923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d422d9fe-2a48-45cf-a87e-81aaf4e666d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c457b682f9c8404baf9b1d957dacf4ad'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:21.871461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d422d9fe-2a48-45cf-a87e-81aaf4e666d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c457b682f9c8404baf9b1d957dacf4ad'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:21.899613 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d422d9fe-2a48-45cf-a87e-81aaf4e666d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c457b682f9c8404baf9b1d957dacf4ad'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:21.913644 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d422d9fe-2a48-45cf-a87e-81aaf4e666d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c457b682f9c8404baf9b1d957dacf4ad'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:21.954032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 921/1839] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:21 2022] POST /identity/v3/users => generated 294 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:21.956924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8d3fe-66d1-4a18-b874-7e77468bc22b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:21.959274 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e0c8d3fe-66d1-4a18-b874-7e77468bc22b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:21.978168 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8d3fe-66d1-4a18-b874-7e77468bc22b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:21.995136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b89943-95f0-4e32-8b79-cacd61d3c515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:21.995136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b89943-95f0-4e32-8b79-cacd61d3c515 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:21.995136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b89943-95f0-4e32-8b79-cacd61d3c515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:21.995136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b89943-95f0-4e32-8b79-cacd61d3c515 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:21.995474 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b89943-95f0-4e32-8b79-cacd61d3c515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:21.998146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b89943-95f0-4e32-8b79-cacd61d3c515 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:22.018396 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 922/1840] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:22.026687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 919/1841] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:21 2022] DELETE /identity/v3/users/c457b682f9c8404baf9b1d957dacf4ad => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:37:22.026788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b89943-95f0-4e32-8b79-cacd61d3c515 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:22.052624 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b89943-95f0-4e32-8b79-cacd61d3c515 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:22.059808 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:22.178251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08bf99-daaf-481d-a642-fddae8e83ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:22.178847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08bf99-daaf-481d-a642-fddae8e83ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:22.179143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08bf99-daaf-481d-a642-fddae8e83ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:22.179426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b08bf99-daaf-481d-a642-fddae8e83ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:22.180171 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08bf99-daaf-481d-a642-fddae8e83ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:22.181972 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b08bf99-daaf-481d-a642-fddae8e83ef1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:22.202789 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 923/1842] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:22.206049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422d9fe-2a48-45cf-a87e-81aaf4e666d2 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:22.224852 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422d9fe-2a48-45cf-a87e-81aaf4e666d2 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:22.242326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38ed8e-f2d6-4705-a413-9d5db3dea62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:22.243510 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38ed8e-f2d6-4705-a413-9d5db3dea62f admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:22.245578 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38ed8e-f2d6-4705-a413-9d5db3dea62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:22.246054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38ed8e-f2d6-4705-a413-9d5db3dea62f admin admin] PATH_INFO: `/v3/projects/161fc220ac3344359597120933e9f3ae/users/2c21878e0c7f4bcba6c2425a7b68f9c2/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:22.272744 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38ed8e-f2d6-4705-a413-9d5db3dea62f admin admin] RBAC: Authorizing `identity:create_grant(project_id=161fc220ac3344359597120933e9f3ae, user_id=2c21878e0c7f4bcba6c2425a7b68f9c2, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:22.277077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38ed8e-f2d6-4705-a413-9d5db3dea62f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:22.328754 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08bf99-daaf-481d-a642-fddae8e83ef1 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:22.330558 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1b08bf99-daaf-481d-a642-fddae8e83ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:22.350779 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b08bf99-daaf-481d-a642-fddae8e83ef1 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:22.356607 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739559da-1fd3-40ec-a3e6-49c2b9334b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:22.357689 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739559da-1fd3-40ec-a3e6-49c2b9334b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:22.358245 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739559da-1fd3-40ec-a3e6-49c2b9334b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:22.359228 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739559da-1fd3-40ec-a3e6-49c2b9334b16 admin admin] PATH_INFO: `/v3/users/cabe1125fb484c28a9844bb5bb22841e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:22.360633 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739559da-1fd3-40ec-a3e6-49c2b9334b16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cabe1125fb484c28a9844bb5bb22841e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:22.363042 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739559da-1fd3-40ec-a3e6-49c2b9334b16 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:22.380754 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:22.391734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 920/1843] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:22 2022] PUT /identity/v3/projects/161fc220ac3344359597120933e9f3ae/users/2c21878e0c7f4bcba6c2425a7b68f9c2/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:22.413253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554fdd9-bb3e-41b2-9132-f8a364658173 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:22.413253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554fdd9-bb3e-41b2-9132-f8a364658173 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:22.413253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554fdd9-bb3e-41b2-9132-f8a364658173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:22.448291 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9554fdd9-bb3e-41b2-9132-f8a364658173 None None] MFA Rules not processed for user `2c21878e0c7f4bcba6c2425a7b68f9c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:22.452158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9554fdd9-bb3e-41b2-9132-f8a364658173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:22.533609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 921/1844] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:22.533609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554fdd9-bb3e-41b2-9132-f8a364658173 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:22.628238 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-739559da-1fd3-40ec-a3e6-49c2b9334b16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cabe1125fb484c28a9844bb5bb22841e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:22.629437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-739559da-1fd3-40ec-a3e6-49c2b9334b16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cabe1125fb484c28a9844bb5bb22841e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:22.651810 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-739559da-1fd3-40ec-a3e6-49c2b9334b16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cabe1125fb484c28a9844bb5bb22841e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:22.663280 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554fdd9-bb3e-41b2-9132-f8a364658173 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:22.675465 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5412e-7238-42a7-bb87-58dab8d88769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:22.676249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5412e-7238-42a7-bb87-58dab8d88769 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:22.676615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5412e-7238-42a7-bb87-58dab8d88769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:22.676985 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5412e-7238-42a7-bb87-58dab8d88769 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:22.678255 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5412e-7238-42a7-bb87-58dab8d88769 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:22.680437 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5412e-7238-42a7-bb87-58dab8d88769 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:22.684531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-739559da-1fd3-40ec-a3e6-49c2b9334b16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cabe1125fb484c28a9844bb5bb22841e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:22.820298 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-739559da-1fd3-40ec-a3e6-49c2b9334b16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cabe1125fb484c28a9844bb5bb22841e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:22.830079 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 922/1845] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:22 2022] POST /identity/v3/projects => generated 385 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:22.834102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5412e-7238-42a7-bb87-58dab8d88769 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:22.836105 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e0f5412e-7238-42a7-bb87-58dab8d88769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:22.841332 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 924/1846] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:22 2022] DELETE /identity/v3/users/cabe1125fb484c28a9844bb5bb22841e => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:37:22.846487 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a2e40-f452-46ea-a319-6428b95e27fd None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:22.846953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a2e40-f452-46ea-a319-6428b95e27fd None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:22.847539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a2e40-f452-46ea-a319-6428b95e27fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:22.867508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-0b9a2e40-f452-46ea-a319-6428b95e27fd None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:22.870242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0b9a2e40-f452-46ea-a319-6428b95e27fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:22.911339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5412e-7238-42a7-bb87-58dab8d88769 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:22.987042 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 925/1847] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:22.987931 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a2e40-f452-46ea-a319-6428b95e27fd None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:22.990668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0b9a2e40-f452-46ea-a319-6428b95e27fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:23.016534 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a2e40-f452-46ea-a319-6428b95e27fd None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:23.026503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b0787-2ff6-4833-8e4e-73a71add7636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:23.032043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b0787-2ff6-4833-8e4e-73a71add7636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:23.032043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b0787-2ff6-4833-8e4e-73a71add7636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:23.032043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b0787-2ff6-4833-8e4e-73a71add7636 admin admin] PATH_INFO: `/v3/projects/263e7d75fc8048db99bb8606756acb3e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:23.034786 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b0787-2ff6-4833-8e4e-73a71add7636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=263e7d75fc8048db99bb8606756acb3e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:23.036546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b0787-2ff6-4833-8e4e-73a71add7636 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:23.070873 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ed6c9-c980-4fa9-ba68-d3f33351ed46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:23.071955 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ed6c9-c980-4fa9-ba68-d3f33351ed46 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:23.072456 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ed6c9-c980-4fa9-ba68-d3f33351ed46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:23.073454 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ed6c9-c980-4fa9-ba68-d3f33351ed46 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:23.074397 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ed6c9-c980-4fa9-ba68-d3f33351ed46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:23.076621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ed6c9-c980-4fa9-ba68-d3f33351ed46 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:23.219060 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 923/1848] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:22 2022] POST /identity/v3/users => generated 299 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:37:23.220267 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ed6c9-c980-4fa9-ba68-d3f33351ed46 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:23.222221 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d61ed6c9-c980-4fa9-ba68-d3f33351ed46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:23.228481 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-379b0787-2ff6-4833-8e4e-73a71add7636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '263e7d75fc8048db99bb8606756acb3e', 'request_id': 'req-379b0787-2ff6-4833-8e4e-73a71add7636'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:23.234686 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-379b0787-2ff6-4833-8e4e-73a71add7636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '263e7d75fc8048db99bb8606756acb3e', 'request_id': 'req-379b0787-2ff6-4833-8e4e-73a71add7636'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:23.244718 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-379b0787-2ff6-4833-8e4e-73a71add7636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '263e7d75fc8048db99bb8606756acb3e', 'request_id': 'req-379b0787-2ff6-4833-8e4e-73a71add7636'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:23.282123 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ed6c9-c980-4fa9-ba68-d3f33351ed46 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:23.333217 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9485a-13e2-4e75-a48d-f6ea8f6e5358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:23.333860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9485a-13e2-4e75-a48d-f6ea8f6e5358 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:23.334149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9485a-13e2-4e75-a48d-f6ea8f6e5358 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:23.334427 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9485a-13e2-4e75-a48d-f6ea8f6e5358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:23.400702 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-379b0787-2ff6-4833-8e4e-73a71add7636 admin admin] The token cache is being invalidate because project 263e7d75fc8048db99bb8606756acb3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:23.401618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-379b0787-2ff6-4833-8e4e-73a71add7636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:23.402719 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-379b0787-2ff6-4833-8e4e-73a71add7636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:23.407809 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 926/1849] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:22 2022] DELETE /identity/v3/projects/263e7d75fc8048db99bb8606756acb3e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:23.407809 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b0787-2ff6-4833-8e4e-73a71add7636 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:23.407809 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-379b0787-2ff6-4833-8e4e-73a71add7636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:23.408724 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9485a-13e2-4e75-a48d-f6ea8f6e5358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:23.410227 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9485a-13e2-4e75-a48d-f6ea8f6e5358 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:23.422914 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 924/1850] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:23.424387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0105160-6b26-4898-9ec7-2df1399d5603 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:23.425887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0105160-6b26-4898-9ec7-2df1399d5603 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:23.425887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0105160-6b26-4898-9ec7-2df1399d5603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:23.454974 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b0787-2ff6-4833-8e4e-73a71add7636 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:23.467003 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0169949-cb4a-4167-b998-eea3828ba589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:23.467723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0169949-cb4a-4167-b998-eea3828ba589 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:23.470206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0169949-cb4a-4167-b998-eea3828ba589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:23.470520 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0169949-cb4a-4167-b998-eea3828ba589 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:23.472813 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0169949-cb4a-4167-b998-eea3828ba589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:23.478767 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0169949-cb4a-4167-b998-eea3828ba589 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:23.480306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a0105160-6b26-4898-9ec7-2df1399d5603 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:23.482024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a0105160-6b26-4898-9ec7-2df1399d5603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:23.492670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 925/1851] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:23.512763 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d4750-198d-4225-beef-50ab6e438abe None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:23.513156 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 927/1852] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:23.513283 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d4750-198d-4225-beef-50ab6e438abe None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:23.514077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0169949-cb4a-4167-b998-eea3828ba589 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:23.514346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5d4750-198d-4225-beef-50ab6e438abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:23.525229 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0169949-cb4a-4167-b998-eea3828ba589 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:23.531528 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c40a3-33ea-451d-bb26-f7faf00a2074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:23.531712 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c40a3-33ea-451d-bb26-f7faf00a2074 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:23.531954 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c40a3-33ea-451d-bb26-f7faf00a2074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:23.532228 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3c40a3-33ea-451d-bb26-f7faf00a2074 admin admin] PATH_INFO: `/v3/projects/27fdf6a134064a7c99daa350f0d0b630/users/920a40e3ffb54a178bbcd4899bc62d40/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:23.549992 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c40a3-33ea-451d-bb26-f7faf00a2074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27fdf6a134064a7c99daa350f0d0b630, user_id=920a40e3ffb54a178bbcd4899bc62d40, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:23.552812 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3c40a3-33ea-451d-bb26-f7faf00a2074 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:23.560035 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-8b5d4750-198d-4225-beef-50ab6e438abe None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:23.563719 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8b5d4750-198d-4225-beef-50ab6e438abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:23.589988 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 926/1853] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:37:23.594904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d4750-198d-4225-beef-50ab6e438abe None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:23.608332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5d4750-198d-4225-beef-50ab6e438abe None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:23.614228 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857f5fb-6d88-4d33-bc3e-28d42688c769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:23.614827 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857f5fb-6d88-4d33-bc3e-28d42688c769 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:23.615120 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857f5fb-6d88-4d33-bc3e-28d42688c769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:23.615398 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3857f5fb-6d88-4d33-bc3e-28d42688c769 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:23.631821 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857f5fb-6d88-4d33-bc3e-28d42688c769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:37:23.631821 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857f5fb-6d88-4d33-bc3e-28d42688c769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:23.631821 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3857f5fb-6d88-4d33-bc3e-28d42688c769 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:23.638825 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 927/1854] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:37:23.642856 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857f5fb-6d88-4d33-bc3e-28d42688c769 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:23.653613 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3857f5fb-6d88-4d33-bc3e-28d42688c769 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:23.665472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 928/1855] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:23 2022] PUT /identity/v3/projects/27fdf6a134064a7c99daa350f0d0b630/users/920a40e3ffb54a178bbcd4899bc62d40/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:23.666517 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c40a3-33ea-451d-bb26-f7faf00a2074 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:23.743595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12578214-1f85-4037-b167-05a6cb412a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:23.743595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12578214-1f85-4037-b167-05a6cb412a1d admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:23.746692 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12578214-1f85-4037-b167-05a6cb412a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:23.746692 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12578214-1f85-4037-b167-05a6cb412a1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:23.746692 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12578214-1f85-4037-b167-05a6cb412a1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:23.777846 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12578214-1f85-4037-b167-05a6cb412a1d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:23.778210 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3c40a3-33ea-451d-bb26-f7faf00a2074 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:23.795971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05431d32-4b09-4076-aba0-6ca2b8202cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:23.798198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05431d32-4b09-4076-aba0-6ca2b8202cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:23.798198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05431d32-4b09-4076-aba0-6ca2b8202cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:23.798198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05431d32-4b09-4076-aba0-6ca2b8202cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:23.798685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05431d32-4b09-4076-aba0-6ca2b8202cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:23.800771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05431d32-4b09-4076-aba0-6ca2b8202cd0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:23.820963 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 929/1856] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:23.821919 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05431d32-4b09-4076-aba0-6ca2b8202cd0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:23.840396 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05431d32-4b09-4076-aba0-6ca2b8202cd0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:23.848250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639fad6-8338-436e-8335-512298185b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:23.849394 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639fad6-8338-436e-8335-512298185b65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:23.855792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639fad6-8338-436e-8335-512298185b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:23.855792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639fad6-8338-436e-8335-512298185b65 admin admin] PATH_INFO: `/v3/projects/27fdf6a134064a7c99daa350f0d0b630/users/920a40e3ffb54a178bbcd4899bc62d40/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:23.855792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639fad6-8338-436e-8335-512298185b65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27fdf6a134064a7c99daa350f0d0b630, user_id=920a40e3ffb54a178bbcd4899bc62d40, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:23.858345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639fad6-8338-436e-8335-512298185b65 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:23.878275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 930/1857] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:23 2022] PUT /identity/v3/projects/27fdf6a134064a7c99daa350f0d0b630/users/920a40e3ffb54a178bbcd4899bc62d40/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:23.889321 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ca823-ac3c-4820-9ec5-ff141a6dc89f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:23.893777 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ca823-ac3c-4820-9ec5-ff141a6dc89f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:23.893777 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ca823-ac3c-4820-9ec5-ff141a6dc89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:23.926607 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ac7ca823-ac3c-4820-9ec5-ff141a6dc89f None None] MFA Rules not processed for user `920a40e3ffb54a178bbcd4899bc62d40`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:23.930219 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ac7ca823-ac3c-4820-9ec5-ff141a6dc89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:23.984351 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 928/1858] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:23 2022] POST /identity/v3/projects => generated 385 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:37:23.989482 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12578214-1f85-4037-b167-05a6cb412a1d admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:24.029627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 931/1859] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:37:24.042484 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ca823-ac3c-4820-9ec5-ff141a6dc89f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:24.044203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ac7ca823-ac3c-4820-9ec5-ff141a6dc89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:24.113632 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12578214-1f85-4037-b167-05a6cb412a1d admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:24.120633 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cb378-bae1-448c-9def-6e7b814a31ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:24.121329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cb378-bae1-448c-9def-6e7b814a31ad admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:24.122391 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cb378-bae1-448c-9def-6e7b814a31ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:24.123077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752cb378-bae1-448c-9def-6e7b814a31ad admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:24.123979 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752cb378-bae1-448c-9def-6e7b814a31ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:24.127071 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752cb378-bae1-448c-9def-6e7b814a31ad admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:24.130394 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ca823-ac3c-4820-9ec5-ff141a6dc89f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:24.228875 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 929/1860] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:23 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:24.235238 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b81dd7-1cba-404e-94fd-bbd70c2edba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:24.235238 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b81dd7-1cba-404e-94fd-bbd70c2edba7 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:24.235560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cb378-bae1-448c-9def-6e7b814a31ad admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:24.235645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b81dd7-1cba-404e-94fd-bbd70c2edba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:24.235645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b81dd7-1cba-404e-94fd-bbd70c2edba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:24.241451 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752cb378-bae1-448c-9def-6e7b814a31ad admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:24.253148 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2195577-b403-497f-8fc7-4f70f84cd684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:24.254473 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2195577-b403-497f-8fc7-4f70f84cd684 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:24.254473 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2195577-b403-497f-8fc7-4f70f84cd684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:24.255202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2195577-b403-497f-8fc7-4f70f84cd684 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:24.255988 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2195577-b403-497f-8fc7-4f70f84cd684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:24.258228 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2195577-b403-497f-8fc7-4f70f84cd684 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:24.274713 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 930/1861] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:24.276507 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2195577-b403-497f-8fc7-4f70f84cd684 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:24.289443 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2195577-b403-497f-8fc7-4f70f84cd684 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:24.308312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee9a13-7fb4-45f7-b1fc-a6d49653826c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:24.309858 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee9a13-7fb4-45f7-b1fc-a6d49653826c admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:24.310553 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee9a13-7fb4-45f7-b1fc-a6d49653826c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:24.311027 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee9a13-7fb4-45f7-b1fc-a6d49653826c admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:24.312409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee9a13-7fb4-45f7-b1fc-a6d49653826c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:24.314714 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee9a13-7fb4-45f7-b1fc-a6d49653826c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:24.332062 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b81dd7-1cba-404e-94fd-bbd70c2edba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:24.333430 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b81dd7-1cba-404e-94fd-bbd70c2edba7 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:24.339957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 931/1862] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:24.343848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee9a13-7fb4-45f7-b1fc-a6d49653826c admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:24.357925 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 932/1863] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:37:24.361878 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee9a13-7fb4-45f7-b1fc-a6d49653826c admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:24.367478 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1125c1a1-bbe6-445a-957f-710ad684efd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:24.368684 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125c1a1-bbe6-445a-957f-710ad684efd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:24.368976 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125c1a1-bbe6-445a-957f-710ad684efd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:24.369439 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1125c1a1-bbe6-445a-957f-710ad684efd9 admin admin] PATH_INFO: `/v3/projects/20cfc469028b4fa082f8070de7a3396e/users/600d7586ed234e328f7748438194fbfd/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:24.392060 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b81dd7-1cba-404e-94fd-bbd70c2edba7 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:24.404472 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125c1a1-bbe6-445a-957f-710ad684efd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20cfc469028b4fa082f8070de7a3396e, user_id=600d7586ed234e328f7748438194fbfd, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:24.405479 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b81dd7-1cba-404e-94fd-bbd70c2edba7 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:24.409634 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1125c1a1-bbe6-445a-957f-710ad684efd9 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:24.414035 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c981257-e460-4a2e-bbb9-5e4c99cd3f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:24.415062 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c981257-e460-4a2e-bbb9-5e4c99cd3f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:24.415334 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c981257-e460-4a2e-bbb9-5e4c99cd3f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:24.415644 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c981257-e460-4a2e-bbb9-5e4c99cd3f5e admin admin] PATH_INFO: `/v3/users/2c21878e0c7f4bcba6c2425a7b68f9c2` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:24.417673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c981257-e460-4a2e-bbb9-5e4c99cd3f5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c21878e0c7f4bcba6c2425a7b68f9c2)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:24.419775 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c981257-e460-4a2e-bbb9-5e4c99cd3f5e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:24.506449 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 932/1864] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:24 2022] PUT /identity/v3/projects/20cfc469028b4fa082f8070de7a3396e/users/600d7586ed234e328f7748438194fbfd/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:24.508193 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12b24a-68d6-4726-bb97-7fed07692c78 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:24.508532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12b24a-68d6-4726-bb97-7fed07692c78 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:24.510572 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe12b24a-68d6-4726-bb97-7fed07692c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:24.593289 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-fe12b24a-68d6-4726-bb97-7fed07692c78 None None] MFA Rules not processed for user `600d7586ed234e328f7748438194fbfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:24.602808 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-fe12b24a-68d6-4726-bb97-7fed07692c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:24.661095 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6c981257-e460-4a2e-bbb9-5e4c99cd3f5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c21878e0c7f4bcba6c2425a7b68f9c2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:24.661965 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6c981257-e460-4a2e-bbb9-5e4c99cd3f5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c21878e0c7f4bcba6c2425a7b68f9c2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:24.662612 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6c981257-e460-4a2e-bbb9-5e4c99cd3f5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c21878e0c7f4bcba6c2425a7b68f9c2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:24.721760 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6c981257-e460-4a2e-bbb9-5e4c99cd3f5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c21878e0c7f4bcba6c2425a7b68f9c2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:24.794334 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 933/1865] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:24.797089 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12b24a-68d6-4726-bb97-7fed07692c78 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:24.800257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-fe12b24a-68d6-4726-bb97-7fed07692c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:24.836668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6c981257-e460-4a2e-bbb9-5e4c99cd3f5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c21878e0c7f4bcba6c2425a7b68f9c2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:24.867873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 933/1866] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:24 2022] DELETE /identity/v3/users/2c21878e0c7f4bcba6c2425a7b68f9c2 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:37:24.869861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e35dec-9451-47a8-b854-16c09d7d8424 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:24.870016 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e35dec-9451-47a8-b854-16c09d7d8424 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:24.872374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e35dec-9451-47a8-b854-16c09d7d8424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:24.916499 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-38e35dec-9451-47a8-b854-16c09d7d8424 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:24.919333 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-38e35dec-9451-47a8-b854-16c09d7d8424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:24.956974 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe12b24a-68d6-4726-bb97-7fed07692c78 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:25.035891 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 934/1867] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:25.053762 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e35dec-9451-47a8-b854-16c09d7d8424 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:25.053762 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-38e35dec-9451-47a8-b854-16c09d7d8424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:25.054827 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd20b3f-fb26-438e-a634-682c80f0e4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:25.056407 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd20b3f-fb26-438e-a634-682c80f0e4a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:25.059187 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd20b3f-fb26-438e-a634-682c80f0e4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:25.059663 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd20b3f-fb26-438e-a634-682c80f0e4a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:25.061019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd20b3f-fb26-438e-a634-682c80f0e4a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:25.063663 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd20b3f-fb26-438e-a634-682c80f0e4a9 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:25.132531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e35dec-9451-47a8-b854-16c09d7d8424 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:25.132531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfa3c7-5e88-48ee-a507-50406f324ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:25.132531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfa3c7-5e88-48ee-a507-50406f324ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:25.132531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfa3c7-5e88-48ee-a507-50406f324ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:25.132992 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfa3c7-5e88-48ee-a507-50406f324ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:25.167442 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfa3c7-5e88-48ee-a507-50406f324ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:25.169874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfa3c7-5e88-48ee-a507-50406f324ff6 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:25.180943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 935/1868] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:37:25.182444 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfa3c7-5e88-48ee-a507-50406f324ff6 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:25.183918 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2ebfa3c7-5e88-48ee-a507-50406f324ff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:25.197255 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfa3c7-5e88-48ee-a507-50406f324ff6 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:25.203016 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7403230-fdac-4489-9300-0f9b171870ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:25.203920 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7403230-fdac-4489-9300-0f9b171870ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:25.204207 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7403230-fdac-4489-9300-0f9b171870ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:25.204490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7403230-fdac-4489-9300-0f9b171870ec admin admin] PATH_INFO: `/v3/projects/712264effe3a4c7e887555d90c3e6796` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:25.205674 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7403230-fdac-4489-9300-0f9b171870ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=712264effe3a4c7e887555d90c3e6796)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:25.207703 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7403230-fdac-4489-9300-0f9b171870ec admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:25.281993 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 934/1869] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:24 2022] POST /identity/v3/projects => generated 385 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:37:25.283134 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd20b3f-fb26-438e-a634-682c80f0e4a9 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:25.347824 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd20b3f-fb26-438e-a634-682c80f0e4a9 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:25.360847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a7403230-fdac-4489-9300-0f9b171870ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '712264effe3a4c7e887555d90c3e6796', 'request_id': 'req-a7403230-fdac-4489-9300-0f9b171870ec'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:25.367795 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a7403230-fdac-4489-9300-0f9b171870ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '712264effe3a4c7e887555d90c3e6796', 'request_id': 'req-a7403230-fdac-4489-9300-0f9b171870ec'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:25.374541 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a7403230-fdac-4489-9300-0f9b171870ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '712264effe3a4c7e887555d90c3e6796', 'request_id': 'req-a7403230-fdac-4489-9300-0f9b171870ec'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:25.427691 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f73c0c-ecc4-43ac-88bb-e754f0fe0976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:25.428535 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f73c0c-ecc4-43ac-88bb-e754f0fe0976 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:25.428829 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f73c0c-ecc4-43ac-88bb-e754f0fe0976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:25.429110 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f73c0c-ecc4-43ac-88bb-e754f0fe0976 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:25.429967 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f73c0c-ecc4-43ac-88bb-e754f0fe0976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:25.432077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f73c0c-ecc4-43ac-88bb-e754f0fe0976 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:25.521998 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a7403230-fdac-4489-9300-0f9b171870ec admin admin] The token cache is being invalidate because project 712264effe3a4c7e887555d90c3e6796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:25.522793 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a7403230-fdac-4489-9300-0f9b171870ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:25.524949 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a7403230-fdac-4489-9300-0f9b171870ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:25.529152 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 936/1870] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:25 2022] DELETE /identity/v3/projects/712264effe3a4c7e887555d90c3e6796 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:25.533004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7403230-fdac-4489-9300-0f9b171870ec admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:25.534741 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a7403230-fdac-4489-9300-0f9b171870ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:25.553859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7403230-fdac-4489-9300-0f9b171870ec admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:25.565792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa582ff-0bcc-466f-b223-b72b0e1bfdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:25.565792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa582ff-0bcc-466f-b223-b72b0e1bfdea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:25.565792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa582ff-0bcc-466f-b223-b72b0e1bfdea admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:25.565792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa582ff-0bcc-466f-b223-b72b0e1bfdea admin admin] PATH_INFO: `/v3/users/75c3aa3294f14578aa0442d0697615eb` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:25.566265 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa582ff-0bcc-466f-b223-b72b0e1bfdea admin admin] RBAC: Authorizing `identity:delete_user(user_id=75c3aa3294f14578aa0442d0697615eb)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:25.578891 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa582ff-0bcc-466f-b223-b72b0e1bfdea admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:25.608623 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 935/1871] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:25 2022] POST /identity/v3/users => generated 299 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:25.613066 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f73c0c-ecc4-43ac-88bb-e754f0fe0976 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:25.617555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d6f73c0c-ecc4-43ac-88bb-e754f0fe0976 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:25.651903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:25.659588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f73c0c-ecc4-43ac-88bb-e754f0fe0976 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:25.665058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfc1e8-70b4-49ee-8c6e-e9b13f10463e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:25.666338 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfc1e8-70b4-49ee-8c6e-e9b13f10463e admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:25.666338 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfc1e8-70b4-49ee-8c6e-e9b13f10463e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:25.666572 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfc1e8-70b4-49ee-8c6e-e9b13f10463e admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:25.667432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfc1e8-70b4-49ee-8c6e-e9b13f10463e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:25.669254 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfc1e8-70b4-49ee-8c6e-e9b13f10463e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:25.690934 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 936/1872] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:25.699023 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfc1e8-70b4-49ee-8c6e-e9b13f10463e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:25.718455 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfc1e8-70b4-49ee-8c6e-e9b13f10463e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:25.726678 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ead60f-0a44-4c12-8607-b2dc8a1c411c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:25.729072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ead60f-0a44-4c12-8607-b2dc8a1c411c admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:25.729573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ead60f-0a44-4c12-8607-b2dc8a1c411c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:25.730094 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ead60f-0a44-4c12-8607-b2dc8a1c411c admin admin] PATH_INFO: `/v3/projects/09b0e653cec4489b880bda246ce56c5d/users/e40eb961e4cb43acad6bcbf9e8c87a39/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:25.754605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ead60f-0a44-4c12-8607-b2dc8a1c411c admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b0e653cec4489b880bda246ce56c5d, user_id=e40eb961e4cb43acad6bcbf9e8c87a39, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:25.757521 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ead60f-0a44-4c12-8607-b2dc8a1c411c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:25.847718 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dfa582ff-0bcc-466f-b223-b72b0e1bfdea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75c3aa3294f14578aa0442d0697615eb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:25.848431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dfa582ff-0bcc-466f-b223-b72b0e1bfdea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75c3aa3294f14578aa0442d0697615eb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:25.849142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dfa582ff-0bcc-466f-b223-b72b0e1bfdea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75c3aa3294f14578aa0442d0697615eb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:25.876899 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dfa582ff-0bcc-466f-b223-b72b0e1bfdea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75c3aa3294f14578aa0442d0697615eb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:25.953369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 937/1873] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:25 2022] PUT /identity/v3/projects/09b0e653cec4489b880bda246ce56c5d/users/e40eb961e4cb43acad6bcbf9e8c87a39/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:25.959848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ead60f-0a44-4c12-8607-b2dc8a1c411c admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:25.966873 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f0ead60f-0a44-4c12-8607-b2dc8a1c411c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:26.007765 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dfa582ff-0bcc-466f-b223-b72b0e1bfdea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75c3aa3294f14578aa0442d0697615eb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:26.023560 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 937/1874] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:25 2022] DELETE /identity/v3/users/75c3aa3294f14578aa0442d0697615eb => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:26.024781 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa582ff-0bcc-466f-b223-b72b0e1bfdea admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:26.026266 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-dfa582ff-0bcc-466f-b223-b72b0e1bfdea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:26.050048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ead60f-0a44-4c12-8607-b2dc8a1c411c admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:26.136857 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6190bde-533f-49ad-9865-deff809442e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:26.139226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6190bde-533f-49ad-9865-deff809442e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:26.139226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6190bde-533f-49ad-9865-deff809442e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:26.139226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6190bde-533f-49ad-9865-deff809442e8 admin admin] PATH_INFO: `/v3/projects/161fc220ac3344359597120933e9f3ae` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:26.139468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa582ff-0bcc-466f-b223-b72b0e1bfdea admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:26.139814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6190bde-533f-49ad-9865-deff809442e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=161fc220ac3344359597120933e9f3ae)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:26.142303 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6190bde-533f-49ad-9865-deff809442e8 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:26.145065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716326e-faf5-4595-a52c-fe30ffe6dc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:26.146010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716326e-faf5-4595-a52c-fe30ffe6dc70 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:26.146486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716326e-faf5-4595-a52c-fe30ffe6dc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:26.146876 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716326e-faf5-4595-a52c-fe30ffe6dc70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:26.147621 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716326e-faf5-4595-a52c-fe30ffe6dc70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:26.150069 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f716326e-faf5-4595-a52c-fe30ffe6dc70 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:26.163098 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 938/1875] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:26.164764 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fba6e-375a-411a-bc6b-c03e50d133cb None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:26.164907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fba6e-375a-411a-bc6b-c03e50d133cb None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:26.165116 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58fba6e-375a-411a-bc6b-c03e50d133cb None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:26.167161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 939/1876] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jul 18 02:37:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:37:26.167891 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fba6e-375a-411a-bc6b-c03e50d133cb None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:26.187719 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58fba6e-375a-411a-bc6b-c03e50d133cb None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:26.193420 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd2ae0-9345-4b0b-878c-88cf9619106c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:26.194352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd2ae0-9345-4b0b-878c-88cf9619106c admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:26.198025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd2ae0-9345-4b0b-878c-88cf9619106c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:26.198025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd2ae0-9345-4b0b-878c-88cf9619106c admin admin] PATH_INFO: `/v3/projects/09b0e653cec4489b880bda246ce56c5d/users/e40eb961e4cb43acad6bcbf9e8c87a39/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:26.198400 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd2ae0-9345-4b0b-878c-88cf9619106c admin admin] RBAC: Authorizing `identity:create_grant(project_id=09b0e653cec4489b880bda246ce56c5d, user_id=e40eb961e4cb43acad6bcbf9e8c87a39, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:26.202999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd2ae0-9345-4b0b-878c-88cf9619106c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:26.219466 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 940/1877] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:26 2022] PUT /identity/v3/projects/09b0e653cec4489b880bda246ce56c5d/users/e40eb961e4cb43acad6bcbf9e8c87a39/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:26.219466 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9154cb-c320-4f00-9869-399513d08cca None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:26.219466 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9154cb-c320-4f00-9869-399513d08cca None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:26.219466 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9154cb-c320-4f00-9869-399513d08cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:26.245457 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-9d9154cb-c320-4f00-9869-399513d08cca None None] MFA Rules not processed for user `6f51aae36f0b42868567840fa957ffe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:26.246991 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9d9154cb-c320-4f00-9869-399513d08cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:26.325638 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b6190bde-533f-49ad-9865-deff809442e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '161fc220ac3344359597120933e9f3ae', 'request_id': 'req-b6190bde-533f-49ad-9865-deff809442e8'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:26.334325 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b6190bde-533f-49ad-9865-deff809442e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '161fc220ac3344359597120933e9f3ae', 'request_id': 'req-b6190bde-533f-49ad-9865-deff809442e8'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:26.351071 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b6190bde-533f-49ad-9865-deff809442e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '161fc220ac3344359597120933e9f3ae', 'request_id': 'req-b6190bde-533f-49ad-9865-deff809442e8'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:26.394035 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 941/1878] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jul 18 02:37:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:26.399715 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fe0da-ffcd-4a50-a3a5-74cdc4dc1fe8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:26.400588 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fe0da-ffcd-4a50-a3a5-74cdc4dc1fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:26.401585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44fe0da-ffcd-4a50-a3a5-74cdc4dc1fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:26.433968 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b44fe0da-ffcd-4a50-a3a5-74cdc4dc1fe8 None None] MFA Rules not processed for user `e40eb961e4cb43acad6bcbf9e8c87a39`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:26.435797 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b44fe0da-ffcd-4a50-a3a5-74cdc4dc1fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:26.445535 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b6190bde-533f-49ad-9865-deff809442e8 admin admin] The token cache is being invalidate because project 161fc220ac3344359597120933e9f3ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:26.449633 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b6190bde-533f-49ad-9865-deff809442e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:26.451179 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b6190bde-533f-49ad-9865-deff809442e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:26.453185 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 938/1879] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:25 2022] DELETE /identity/v3/projects/161fc220ac3344359597120933e9f3ae => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:26.454079 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6190bde-533f-49ad-9865-deff809442e8 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:26.457921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b6190bde-533f-49ad-9865-deff809442e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:26.530497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 942/1880] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:26.531505 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fe0da-ffcd-4a50-a3a5-74cdc4dc1fe8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:26.532808 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b44fe0da-ffcd-4a50-a3a5-74cdc4dc1fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:26.559255 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6190bde-533f-49ad-9865-deff809442e8 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:26.566503 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac051d83-37d4-4dcb-8ff0-c52d76136bb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:26.566968 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac051d83-37d4-4dcb-8ff0-c52d76136bb3 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:26.567255 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac051d83-37d4-4dcb-8ff0-c52d76136bb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:26.567534 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac051d83-37d4-4dcb-8ff0-c52d76136bb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:26.569529 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ac051d83-37d4-4dcb-8ff0-c52d76136bb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:26.585140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac051d83-37d4-4dcb-8ff0-c52d76136bb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:26.587096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac051d83-37d4-4dcb-8ff0-c52d76136bb3 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:26.600034 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 939/1881] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:26.601110 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac051d83-37d4-4dcb-8ff0-c52d76136bb3 service nova] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:26.602905 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ac051d83-37d4-4dcb-8ff0-c52d76136bb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:26.609249 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44fe0da-ffcd-4a50-a3a5-74cdc4dc1fe8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:26.619263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f7b6c-f870-476d-bcb9-b9c61091857b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:26.620065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f7b6c-f870-476d-bcb9-b9c61091857b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:26.620338 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f7b6c-f870-476d-bcb9-b9c61091857b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:26.620610 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f7b6c-f870-476d-bcb9-b9c61091857b admin admin] PATH_INFO: `/v3/users/920a40e3ffb54a178bbcd4899bc62d40` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:26.624617 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f7b6c-f870-476d-bcb9-b9c61091857b admin admin] RBAC: Authorizing `identity:delete_user(user_id=920a40e3ffb54a178bbcd4899bc62d40)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:26.626606 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695f7b6c-f870-476d-bcb9-b9c61091857b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:26.705938 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac051d83-37d4-4dcb-8ff0-c52d76136bb3 service nova] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:26.719789 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a121a-597c-4fe4-87be-73f1ed76a518 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:26.721217 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a121a-597c-4fe4-87be-73f1ed76a518 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:26.721506 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a121a-597c-4fe4-87be-73f1ed76a518 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:26.722222 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a121a-597c-4fe4-87be-73f1ed76a518 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:26.733187 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a121a-597c-4fe4-87be-73f1ed76a518 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:26.734893 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a121a-597c-4fe4-87be-73f1ed76a518 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:26.752299 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 940/1882] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:26.753731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a121a-597c-4fe4-87be-73f1ed76a518 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:26.756048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a14a121a-597c-4fe4-87be-73f1ed76a518 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:26.779499 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a121a-597c-4fe4-87be-73f1ed76a518 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:26.795777 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9605a3-1c99-41bd-85c5-b87cb500fe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:26.796704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9605a3-1c99-41bd-85c5-b87cb500fe88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:26.797000 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9605a3-1c99-41bd-85c5-b87cb500fe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:26.797280 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9605a3-1c99-41bd-85c5-b87cb500fe88 admin admin] PATH_INFO: `/v3/projects/12cccea47e4f4f6cb4a87577a1cc4cdc` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:26.798924 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9605a3-1c99-41bd-85c5-b87cb500fe88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12cccea47e4f4f6cb4a87577a1cc4cdc)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:26.801266 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9605a3-1c99-41bd-85c5-b87cb500fe88 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:26.948295 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-695f7b6c-f870-476d-bcb9-b9c61091857b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '920a40e3ffb54a178bbcd4899bc62d40'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:26.948895 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-695f7b6c-f870-476d-bcb9-b9c61091857b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '920a40e3ffb54a178bbcd4899bc62d40'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:26.949726 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-695f7b6c-f870-476d-bcb9-b9c61091857b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '920a40e3ffb54a178bbcd4899bc62d40'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:26.966868 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-695f7b6c-f870-476d-bcb9-b9c61091857b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '920a40e3ffb54a178bbcd4899bc62d40'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:27.012911 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bd9605a3-1c99-41bd-85c5-b87cb500fe88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12cccea47e4f4f6cb4a87577a1cc4cdc', 'request_id': 'req-bd9605a3-1c99-41bd-85c5-b87cb500fe88'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:27.020696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bd9605a3-1c99-41bd-85c5-b87cb500fe88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12cccea47e4f4f6cb4a87577a1cc4cdc', 'request_id': 'req-bd9605a3-1c99-41bd-85c5-b87cb500fe88'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:27.034317 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bd9605a3-1c99-41bd-85c5-b87cb500fe88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12cccea47e4f4f6cb4a87577a1cc4cdc', 'request_id': 'req-bd9605a3-1c99-41bd-85c5-b87cb500fe88'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:27.119635 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-695f7b6c-f870-476d-bcb9-b9c61091857b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '920a40e3ffb54a178bbcd4899bc62d40'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:27.139727 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 943/1883] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:26 2022] DELETE /identity/v3/users/920a40e3ffb54a178bbcd4899bc62d40 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:27.141541 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f7b6c-f870-476d-bcb9-b9c61091857b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:27.143514 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-695f7b6c-f870-476d-bcb9-b9c61091857b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:27.235746 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bd9605a3-1c99-41bd-85c5-b87cb500fe88 admin admin] The token cache is being invalidate because project 12cccea47e4f4f6cb4a87577a1cc4cdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:27.235746 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bd9605a3-1c99-41bd-85c5-b87cb500fe88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:27.238102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bd9605a3-1c99-41bd-85c5-b87cb500fe88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:27.243096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 941/1884] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:26 2022] DELETE /identity/v3/projects/12cccea47e4f4f6cb4a87577a1cc4cdc => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:27.245123 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da17a64-5414-4428-a571-39a444bf94c4 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:27.245419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da17a64-5414-4428-a571-39a444bf94c4 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:27.245790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da17a64-5414-4428-a571-39a444bf94c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:27.266987 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f7b6c-f870-476d-bcb9-b9c61091857b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:27.277034 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-1da17a64-5414-4428-a571-39a444bf94c4 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:27.278430 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1da17a64-5414-4428-a571-39a444bf94c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:27.284982 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e9be7-ac99-4f0f-83d5-f3f2a12cebf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:27.284982 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e9be7-ac99-4f0f-83d5-f3f2a12cebf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:27.284982 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e9be7-ac99-4f0f-83d5-f3f2a12cebf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:27.285294 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e9be7-ac99-4f0f-83d5-f3f2a12cebf6 admin admin] PATH_INFO: `/v3/users/600d7586ed234e328f7748438194fbfd` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:27.286380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e9be7-ac99-4f0f-83d5-f3f2a12cebf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=600d7586ed234e328f7748438194fbfd)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:27.288481 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 942/1885] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:27.289247 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6e9be7-ac99-4f0f-83d5-f3f2a12cebf6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:27.296134 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd2aa4-d15f-451c-8cd5-5753d10e3483 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:27.296441 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd2aa4-d15f-451c-8cd5-5753d10e3483 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:27.297509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd2aa4-d15f-451c-8cd5-5753d10e3483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:27.298732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:27.321202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-accd2aa4-d15f-451c-8cd5-5753d10e3483 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:27.323316 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-accd2aa4-d15f-451c-8cd5-5753d10e3483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:27.331906 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 943/1886] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:27.336183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd2aa4-d15f-451c-8cd5-5753d10e3483 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:27.346009 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd2aa4-d15f-451c-8cd5-5753d10e3483 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:27.350838 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff24b1-5588-4f64-8ecc-4a6492358abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:27.351506 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff24b1-5588-4f64-8ecc-4a6492358abc admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:27.351830 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff24b1-5588-4f64-8ecc-4a6492358abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:27.352123 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff24b1-5588-4f64-8ecc-4a6492358abc admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:27.352988 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff24b1-5588-4f64-8ecc-4a6492358abc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:37:27.353310 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff24b1-5588-4f64-8ecc-4a6492358abc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:27.354993 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff24b1-5588-4f64-8ecc-4a6492358abc admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:27.372369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 944/1887] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:37:27.377169 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff24b1-5588-4f64-8ecc-4a6492358abc admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:27.391325 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff24b1-5588-4f64-8ecc-4a6492358abc admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:27.396337 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e387fe9-a39e-438a-b8ed-5adb753c9f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:27.397035 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e387fe9-a39e-438a-b8ed-5adb753c9f9a admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:27.397370 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e387fe9-a39e-438a-b8ed-5adb753c9f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:27.397654 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e387fe9-a39e-438a-b8ed-5adb753c9f9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:27.398561 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e387fe9-a39e-438a-b8ed-5adb753c9f9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:27.400824 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e387fe9-a39e-438a-b8ed-5adb753c9f9a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:27.500197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8e6e9be7-ac99-4f0f-83d5-f3f2a12cebf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '600d7586ed234e328f7748438194fbfd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:27.500861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8e6e9be7-ac99-4f0f-83d5-f3f2a12cebf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '600d7586ed234e328f7748438194fbfd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:27.502058 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8e6e9be7-ac99-4f0f-83d5-f3f2a12cebf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '600d7586ed234e328f7748438194fbfd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:27.516864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8e6e9be7-ac99-4f0f-83d5-f3f2a12cebf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '600d7586ed234e328f7748438194fbfd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:27.531759 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 945/1888] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:27 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:27.535940 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e387fe9-a39e-438a-b8ed-5adb753c9f9a admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:27.538132 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3e387fe9-a39e-438a-b8ed-5adb753c9f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:27.627512 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e387fe9-a39e-438a-b8ed-5adb753c9f9a admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:27.632048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc46b7-bc01-4636-85a7-b6f57256b023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:27.633212 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc46b7-bc01-4636-85a7-b6f57256b023 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:27.633464 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc46b7-bc01-4636-85a7-b6f57256b023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:27.634392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dc46b7-bc01-4636-85a7-b6f57256b023 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:27.634852 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc46b7-bc01-4636-85a7-b6f57256b023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:27.637132 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dc46b7-bc01-4636-85a7-b6f57256b023 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:27.651804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8e6e9be7-ac99-4f0f-83d5-f3f2a12cebf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '600d7586ed234e328f7748438194fbfd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:27.680983 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 944/1889] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:27 2022] DELETE /identity/v3/users/600d7586ed234e328f7748438194fbfd => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:27.686372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc5190-33d0-4bf1-996e-223e2fe235de None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:27.686667 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc5190-33d0-4bf1-996e-223e2fe235de None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:27.687158 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc5190-33d0-4bf1-996e-223e2fe235de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:27.699700 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:27.706967 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c8dc5190-33d0-4bf1-996e-223e2fe235de None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:27.708850 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c8dc5190-33d0-4bf1-996e-223e2fe235de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:27.788433 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 945/1890] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:27.795271 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc5190-33d0-4bf1-996e-223e2fe235de None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:27.796687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c8dc5190-33d0-4bf1-996e-223e2fe235de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:27.820140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 946/1891] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:27 2022] POST /identity/v3/users => generated 291 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:37:27.830000 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc46b7-bc01-4636-85a7-b6f57256b023 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:27.851747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dc46b7-bc01-4636-85a7-b6f57256b023 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:27.865124 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b60ff2-ed49-4ed2-8586-a16520846451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:27.865124 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b60ff2-ed49-4ed2-8586-a16520846451 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:27.865124 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b60ff2-ed49-4ed2-8586-a16520846451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:27.865124 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b60ff2-ed49-4ed2-8586-a16520846451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:27.865479 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b60ff2-ed49-4ed2-8586-a16520846451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:27.865479 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b60ff2-ed49-4ed2-8586-a16520846451 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:27.874606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 947/1892] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:37:27.875822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b60ff2-ed49-4ed2-8586-a16520846451 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:27.885537 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc5190-33d0-4bf1-996e-223e2fe235de None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:27.886365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b60ff2-ed49-4ed2-8586-a16520846451 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:27.889382 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e764757-7bce-465f-8780-328af115657d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:27.890287 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e764757-7bce-465f-8780-328af115657d service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:27.890654 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e764757-7bce-465f-8780-328af115657d service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:27.890916 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a5e27-e61e-419c-9930-aee4a0894b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:27.891042 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e764757-7bce-465f-8780-328af115657d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:27.891578 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a5e27-e61e-419c-9930-aee4a0894b73 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:27.891862 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a5e27-e61e-419c-9930-aee4a0894b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:27.892135 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a5e27-e61e-419c-9930-aee4a0894b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:27.892851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a5e27-e61e-419c-9930-aee4a0894b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:27.895104 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a5e27-e61e-419c-9930-aee4a0894b73 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:27.906314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e764757-7bce-465f-8780-328af115657d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:27.908251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e764757-7bce-465f-8780-328af115657d service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:27.910630 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 948/1893] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:27.915345 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a5e27-e61e-419c-9930-aee4a0894b73 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:27.920127 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 946/1894] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:37:27.926445 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a5e27-e61e-419c-9930-aee4a0894b73 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:27.931443 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47841b-6f89-4ce5-8931-a93d2251a2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:27.933123 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47841b-6f89-4ce5-8931-a93d2251a2bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:27.933566 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47841b-6f89-4ce5-8931-a93d2251a2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:27.933885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47841b-6f89-4ce5-8931-a93d2251a2bd admin admin] PATH_INFO: `/v3/projects/014788c32a8c4f99bff2b7de86fa1ae7/users/5804ae7a29ec4e98a6d0380265462b70/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:27.950357 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47841b-6f89-4ce5-8931-a93d2251a2bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=014788c32a8c4f99bff2b7de86fa1ae7, user_id=5804ae7a29ec4e98a6d0380265462b70, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:27.953195 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47841b-6f89-4ce5-8931-a93d2251a2bd admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:28.048349 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e764757-7bce-465f-8780-328af115657d service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:28.049938 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6e764757-7bce-465f-8780-328af115657d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:28.064411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e764757-7bce-465f-8780-328af115657d service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:28.069612 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1a974-6516-4c02-85d0-57b1b5a6f663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:28.070544 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1a974-6516-4c02-85d0-57b1b5a6f663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:28.070833 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1a974-6516-4c02-85d0-57b1b5a6f663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:28.071113 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1a974-6516-4c02-85d0-57b1b5a6f663 admin admin] PATH_INFO: `/v3/projects/27fdf6a134064a7c99daa350f0d0b630` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:28.072515 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1a974-6516-4c02-85d0-57b1b5a6f663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27fdf6a134064a7c99daa350f0d0b630)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:28.074721 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1a974-6516-4c02-85d0-57b1b5a6f663 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:28.097846 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 949/1895] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:27 2022] PUT /identity/v3/projects/014788c32a8c4f99bff2b7de86fa1ae7/users/5804ae7a29ec4e98a6d0380265462b70/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:28.110187 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be15e1-a196-47ee-8845-7393701523fb None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:28.110483 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be15e1-a196-47ee-8845-7393701523fb None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:28.110771 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70be15e1-a196-47ee-8845-7393701523fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:28.142407 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-70be15e1-a196-47ee-8845-7393701523fb None None] MFA Rules not processed for user `5804ae7a29ec4e98a6d0380265462b70`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:28.144254 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-70be15e1-a196-47ee-8845-7393701523fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:28.213188 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 950/1896] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:37:28.217598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be15e1-a196-47ee-8845-7393701523fb None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:28.281685 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70be15e1-a196-47ee-8845-7393701523fb None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:28.286307 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db0a9d-ffe1-4e16-ab7e-cc47c4c37231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:28.286977 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db0a9d-ffe1-4e16-ab7e-cc47c4c37231 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:28.287270 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db0a9d-ffe1-4e16-ab7e-cc47c4c37231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:28.287555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db0a9d-ffe1-4e16-ab7e-cc47c4c37231 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:28.288297 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db0a9d-ffe1-4e16-ab7e-cc47c4c37231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:28.290252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db0a9d-ffe1-4e16-ab7e-cc47c4c37231 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:28.324537 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5de1a974-6516-4c02-85d0-57b1b5a6f663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27fdf6a134064a7c99daa350f0d0b630', 'request_id': 'req-5de1a974-6516-4c02-85d0-57b1b5a6f663'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:28.362979 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5de1a974-6516-4c02-85d0-57b1b5a6f663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27fdf6a134064a7c99daa350f0d0b630', 'request_id': 'req-5de1a974-6516-4c02-85d0-57b1b5a6f663'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:28.377793 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5de1a974-6516-4c02-85d0-57b1b5a6f663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27fdf6a134064a7c99daa350f0d0b630', 'request_id': 'req-5de1a974-6516-4c02-85d0-57b1b5a6f663'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:28.521463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5de1a974-6516-4c02-85d0-57b1b5a6f663 admin admin] The token cache is being invalidate because project 27fdf6a134064a7c99daa350f0d0b630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:28.521785 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5de1a974-6516-4c02-85d0-57b1b5a6f663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:28.522496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5de1a974-6516-4c02-85d0-57b1b5a6f663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:28.524173 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 951/1897] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:28 2022] POST /identity/v3/projects => generated 381 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:37:28.532600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 947/1898] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:28 2022] DELETE /identity/v3/projects/27fdf6a134064a7c99daa350f0d0b630 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:37:28.532836 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db0a9d-ffe1-4e16-ab7e-cc47c4c37231 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:28.532836 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-73db0a9d-ffe1-4e16-ab7e-cc47c4c37231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:28.533013 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f9af2-cdeb-4bc4-88c5-271f10d2cd7a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:28.533013 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f9af2-cdeb-4bc4-88c5-271f10d2cd7a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:28.533013 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f9af2-cdeb-4bc4-88c5-271f10d2cd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:28.551424 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8d0f9af2-cdeb-4bc4-88c5-271f10d2cd7a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:28.552827 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8d0f9af2-cdeb-4bc4-88c5-271f10d2cd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:28.600933 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db0a9d-ffe1-4e16-ab7e-cc47c4c37231 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:28.606377 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817c6ab-3cc7-4ae2-bf59-eaba2eacda41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:28.607061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817c6ab-3cc7-4ae2-bf59-eaba2eacda41 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:28.607347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817c6ab-3cc7-4ae2-bf59-eaba2eacda41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:28.607738 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817c6ab-3cc7-4ae2-bf59-eaba2eacda41 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:28.608450 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817c6ab-3cc7-4ae2-bf59-eaba2eacda41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:28.610795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3817c6ab-3cc7-4ae2-bf59-eaba2eacda41 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:28.624487 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 948/1899] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:28.632443 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e5702-cb9b-4934-82ab-bfc5c7dc3e4d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:28.632742 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e5702-cb9b-4934-82ab-bfc5c7dc3e4d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:28.633104 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e5702-cb9b-4934-82ab-bfc5c7dc3e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:28.653981 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8e9e5702-cb9b-4934-82ab-bfc5c7dc3e4d None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:28.655426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8e9e5702-cb9b-4934-82ab-bfc5c7dc3e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:28.668254 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 949/1900] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:37:28.668254 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e5702-cb9b-4934-82ab-bfc5c7dc3e4d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:28.670365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8e9e5702-cb9b-4934-82ab-bfc5c7dc3e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:28.684608 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e5702-cb9b-4934-82ab-bfc5c7dc3e4d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:28.690108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db188cd9-f324-4c6a-8410-4bdc7a16c1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:28.691004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db188cd9-f324-4c6a-8410-4bdc7a16c1c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:28.691296 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db188cd9-f324-4c6a-8410-4bdc7a16c1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:28.691586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db188cd9-f324-4c6a-8410-4bdc7a16c1c4 admin admin] PATH_INFO: `/v3/projects/20cfc469028b4fa082f8070de7a3396e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:28.693026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db188cd9-f324-4c6a-8410-4bdc7a16c1c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20cfc469028b4fa082f8070de7a3396e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:28.695049 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db188cd9-f324-4c6a-8410-4bdc7a16c1c4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:28.706490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 952/1901] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:28 2022] POST /identity/v3/users => generated 297 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:37:28.707522 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817c6ab-3cc7-4ae2-bf59-eaba2eacda41 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:28.721592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817c6ab-3cc7-4ae2-bf59-eaba2eacda41 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:28.727420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998772ba-b1e1-46d5-8b4d-f8496fe50639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:28.728487 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998772ba-b1e1-46d5-8b4d-f8496fe50639 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:28.729421 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998772ba-b1e1-46d5-8b4d-f8496fe50639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:28.730258 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998772ba-b1e1-46d5-8b4d-f8496fe50639 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:28.740421 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998772ba-b1e1-46d5-8b4d-f8496fe50639 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:37:28.740421 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998772ba-b1e1-46d5-8b4d-f8496fe50639 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:28.740421 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998772ba-b1e1-46d5-8b4d-f8496fe50639 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:28.762861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 953/1902] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:37:28.762861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998772ba-b1e1-46d5-8b4d-f8496fe50639 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:28.770722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998772ba-b1e1-46d5-8b4d-f8496fe50639 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:28.776574 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87042078-63a4-448d-9ec8-32d53b58cdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:28.777219 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87042078-63a4-448d-9ec8-32d53b58cdf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:28.777510 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87042078-63a4-448d-9ec8-32d53b58cdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:28.777981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87042078-63a4-448d-9ec8-32d53b58cdf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:28.778746 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87042078-63a4-448d-9ec8-32d53b58cdf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:28.780444 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87042078-63a4-448d-9ec8-32d53b58cdf2 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:28.793916 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 954/1903] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:28.793916 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87042078-63a4-448d-9ec8-32d53b58cdf2 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:28.804867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87042078-63a4-448d-9ec8-32d53b58cdf2 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:28.810182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79dbc40-ef78-46d7-8154-465a03c4ee0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:28.810849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dbc40-ef78-46d7-8154-465a03c4ee0f admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:28.811189 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dbc40-ef78-46d7-8154-465a03c4ee0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:28.811476 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dbc40-ef78-46d7-8154-465a03c4ee0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:28.812174 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79dbc40-ef78-46d7-8154-465a03c4ee0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:28.814128 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79dbc40-ef78-46d7-8154-465a03c4ee0f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:28.846643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-db188cd9-f324-4c6a-8410-4bdc7a16c1c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20cfc469028b4fa082f8070de7a3396e', 'request_id': 'req-db188cd9-f324-4c6a-8410-4bdc7a16c1c4'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:28.851929 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-db188cd9-f324-4c6a-8410-4bdc7a16c1c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20cfc469028b4fa082f8070de7a3396e', 'request_id': 'req-db188cd9-f324-4c6a-8410-4bdc7a16c1c4'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:28.858495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-db188cd9-f324-4c6a-8410-4bdc7a16c1c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20cfc469028b4fa082f8070de7a3396e', 'request_id': 'req-db188cd9-f324-4c6a-8410-4bdc7a16c1c4'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:28.915804 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 955/1904] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:28 2022] POST /identity/v3/projects => generated 385 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:28.916841 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79dbc40-ef78-46d7-8154-465a03c4ee0f admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:28.974466 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-db188cd9-f324-4c6a-8410-4bdc7a16c1c4 admin admin] The token cache is being invalidate because project 20cfc469028b4fa082f8070de7a3396e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:28.974766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-db188cd9-f324-4c6a-8410-4bdc7a16c1c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:28.975471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-db188cd9-f324-4c6a-8410-4bdc7a16c1c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:28.980269 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 950/1905] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:28 2022] DELETE /identity/v3/projects/20cfc469028b4fa082f8070de7a3396e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:28.980269 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db188cd9-f324-4c6a-8410-4bdc7a16c1c4 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:28.980269 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-db188cd9-f324-4c6a-8410-4bdc7a16c1c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:28.983648 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79dbc40-ef78-46d7-8154-465a03c4ee0f admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:28.990593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdfe9a-4fcb-4dac-adc4-e402406a4399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:28.991738 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdfe9a-4fcb-4dac-adc4-e402406a4399 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:28.992055 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdfe9a-4fcb-4dac-adc4-e402406a4399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:28.992337 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdfe9a-4fcb-4dac-adc4-e402406a4399 admin admin] PATH_INFO: `/v3/projects/b0fe24df435142a9b420dcd9cb87a87d/users/8134642b117c4e3d8b1a106db2709a20/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:29.010236 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdfe9a-4fcb-4dac-adc4-e402406a4399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0fe24df435142a9b420dcd9cb87a87d, user_id=8134642b117c4e3d8b1a106db2709a20, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:29.012939 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdfe9a-4fcb-4dac-adc4-e402406a4399 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:29.051739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db188cd9-f324-4c6a-8410-4bdc7a16c1c4 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:29.057161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8322cd3-f948-4a2d-9a2b-f60e0df54653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:29.057892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8322cd3-f948-4a2d-9a2b-f60e0df54653 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:29.058183 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8322cd3-f948-4a2d-9a2b-f60e0df54653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:29.058460 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8322cd3-f948-4a2d-9a2b-f60e0df54653 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:29.059164 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8322cd3-f948-4a2d-9a2b-f60e0df54653 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:29.061173 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8322cd3-f948-4a2d-9a2b-f60e0df54653 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:29.108473 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 956/1906] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:28 2022] PUT /identity/v3/projects/b0fe24df435142a9b420dcd9cb87a87d/users/8134642b117c4e3d8b1a106db2709a20/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:29.109303 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdfe9a-4fcb-4dac-adc4-e402406a4399 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:29.110919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-99fdfe9a-4fcb-4dac-adc4-e402406a4399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:29.162941 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 951/1907] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:28 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:29.162941 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8322cd3-f948-4a2d-9a2b-f60e0df54653 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:29.174417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c8322cd3-f948-4a2d-9a2b-f60e0df54653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:29.176449 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdfe9a-4fcb-4dac-adc4-e402406a4399 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:29.182193 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52c9b9-36e6-4e79-b139-a1582537f65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:29.184356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52c9b9-36e6-4e79-b139-a1582537f65e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:29.184356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52c9b9-36e6-4e79-b139-a1582537f65e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:29.184356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52c9b9-36e6-4e79-b139-a1582537f65e admin admin] PATH_INFO: `/v3/users/e40eb961e4cb43acad6bcbf9e8c87a39` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:29.186399 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52c9b9-36e6-4e79-b139-a1582537f65e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e40eb961e4cb43acad6bcbf9e8c87a39)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:29.188090 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8322cd3-f948-4a2d-9a2b-f60e0df54653 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:29.188661 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc52c9b9-36e6-4e79-b139-a1582537f65e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:29.193267 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad42ce-025b-47e1-8e9d-b6e5be88525d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:29.194000 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad42ce-025b-47e1-8e9d-b6e5be88525d admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:29.194327 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad42ce-025b-47e1-8e9d-b6e5be88525d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:29.194609 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad42ce-025b-47e1-8e9d-b6e5be88525d admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:29.195351 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad42ce-025b-47e1-8e9d-b6e5be88525d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:29.197304 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad42ce-025b-47e1-8e9d-b6e5be88525d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:29.208359 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 952/1908] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:29.212477 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad42ce-025b-47e1-8e9d-b6e5be88525d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:29.224535 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad42ce-025b-47e1-8e9d-b6e5be88525d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:29.232755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f3c0d-4325-4127-abe1-c84d744aa5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:29.233834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f3c0d-4325-4127-abe1-c84d744aa5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:29.233834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f3c0d-4325-4127-abe1-c84d744aa5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:29.234026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f3c0d-4325-4127-abe1-c84d744aa5c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:29.235379 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f3c0d-4325-4127-abe1-c84d744aa5c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:29.237010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f3c0d-4325-4127-abe1-c84d744aa5c7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:29.249869 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 953/1909] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:29.251643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f3c0d-4325-4127-abe1-c84d744aa5c7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:29.268823 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f3c0d-4325-4127-abe1-c84d744aa5c7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:29.275337 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb72ef-1f79-4015-946a-0aa8fd29c2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:29.277054 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb72ef-1f79-4015-946a-0aa8fd29c2cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:29.277595 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb72ef-1f79-4015-946a-0aa8fd29c2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:29.278264 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeb72ef-1f79-4015-946a-0aa8fd29c2cf admin admin] PATH_INFO: `/v3/projects/b0fe24df435142a9b420dcd9cb87a87d/users/8134642b117c4e3d8b1a106db2709a20/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:29.280601 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb72ef-1f79-4015-946a-0aa8fd29c2cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0fe24df435142a9b420dcd9cb87a87d, user_id=8134642b117c4e3d8b1a106db2709a20, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:29.283721 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeb72ef-1f79-4015-946a-0aa8fd29c2cf admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:29.300551 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 954/1910] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:29 2022] PUT /identity/v3/projects/b0fe24df435142a9b420dcd9cb87a87d/users/8134642b117c4e3d8b1a106db2709a20/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:29.302261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb72ef-1f79-4015-946a-0aa8fd29c2cf admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:29.384851 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeb72ef-1f79-4015-946a-0aa8fd29c2cf admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:29.391323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4eced-7b03-4af6-9924-e8031d7aab2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:29.392088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4eced-7b03-4af6-9924-e8031d7aab2e admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:29.392382 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4eced-7b03-4af6-9924-e8031d7aab2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:29.392662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4eced-7b03-4af6-9924-e8031d7aab2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:29.395354 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4eced-7b03-4af6-9924-e8031d7aab2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:29.397839 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4eced-7b03-4af6-9924-e8031d7aab2e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:29.414370 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 955/1911] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:29.416510 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f08eba-cf15-4dd7-ac5d-309e5aa2195d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:29.416899 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f08eba-cf15-4dd7-ac5d-309e5aa2195d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:29.417251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f08eba-cf15-4dd7-ac5d-309e5aa2195d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:29.419966 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-cc52c9b9-36e6-4e79-b139-a1582537f65e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e40eb961e4cb43acad6bcbf9e8c87a39'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:29.420875 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-cc52c9b9-36e6-4e79-b139-a1582537f65e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e40eb961e4cb43acad6bcbf9e8c87a39'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:29.421633 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-cc52c9b9-36e6-4e79-b139-a1582537f65e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e40eb961e4cb43acad6bcbf9e8c87a39'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:29.437506 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-cc52c9b9-36e6-4e79-b139-a1582537f65e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e40eb961e4cb43acad6bcbf9e8c87a39'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:29.445062 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-cc52c9b9-36e6-4e79-b139-a1582537f65e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e40eb961e4cb43acad6bcbf9e8c87a39'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:29.448674 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d0f08eba-cf15-4dd7-ac5d-309e5aa2195d None None] MFA Rules not processed for user `8134642b117c4e3d8b1a106db2709a20`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:29.457727 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d0f08eba-cf15-4dd7-ac5d-309e5aa2195d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:29.528906 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 956/1912] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:29.529880 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f08eba-cf15-4dd7-ac5d-309e5aa2195d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:29.531262 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d0f08eba-cf15-4dd7-ac5d-309e5aa2195d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:29.548841 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f08eba-cf15-4dd7-ac5d-309e5aa2195d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:29.553040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4924de-976f-496e-840f-c53096f301d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:29.554416 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4924de-976f-496e-840f-c53096f301d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:29.554712 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4924de-976f-496e-840f-c53096f301d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:29.554985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4924de-976f-496e-840f-c53096f301d4 admin admin] PATH_INFO: `/v3/projects/dfc75d8ae2f942148a961282d367a1df/users/49f0803b480a4d23933a7f0e6f86aa2f/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:29.573799 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 957/1913] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:29 2022] DELETE /identity/v3/users/e40eb961e4cb43acad6bcbf9e8c87a39 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:29.573799 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52c9b9-36e6-4e79-b139-a1582537f65e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:29.573799 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cc52c9b9-36e6-4e79-b139-a1582537f65e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:29.590504 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4924de-976f-496e-840f-c53096f301d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfc75d8ae2f942148a961282d367a1df, user_id=49f0803b480a4d23933a7f0e6f86aa2f, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:29.592125 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4924de-976f-496e-840f-c53096f301d4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:29.658660 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52c9b9-36e6-4e79-b139-a1582537f65e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:29.665143 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd88463f-5d72-4cd1-a07c-75d516420447 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:29.666403 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88463f-5d72-4cd1-a07c-75d516420447 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:29.666737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88463f-5d72-4cd1-a07c-75d516420447 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:29.667376 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88463f-5d72-4cd1-a07c-75d516420447 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:29.731386 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88463f-5d72-4cd1-a07c-75d516420447 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:29.732912 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd88463f-5d72-4cd1-a07c-75d516420447 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:29.743221 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 958/1914] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:29.779516 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 957/1915] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:29 2022] PUT /identity/v3/projects/dfc75d8ae2f942148a961282d367a1df/users/49f0803b480a4d23933a7f0e6f86aa2f/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:29.791273 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247a700-22cc-4aee-a4f2-6b15313cde70 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:29.791914 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247a700-22cc-4aee-a4f2-6b15313cde70 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:29.792367 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247a700-22cc-4aee-a4f2-6b15313cde70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:29.821031 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-6247a700-22cc-4aee-a4f2-6b15313cde70 None None] MFA Rules not processed for user `49f0803b480a4d23933a7f0e6f86aa2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:29.822918 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6247a700-22cc-4aee-a4f2-6b15313cde70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:29.877991 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4924de-976f-496e-840f-c53096f301d4 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:29.880054 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2e4924de-976f-496e-840f-c53096f301d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:29.928301 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 959/1916] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:29.933612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247a700-22cc-4aee-a4f2-6b15313cde70 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:29.969506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4924de-976f-496e-840f-c53096f301d4 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:29.975253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b37d9-73e6-4594-b630-68cc24f7f5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:29.976720 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b37d9-73e6-4594-b630-68cc24f7f5e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:29.977164 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b37d9-73e6-4594-b630-68cc24f7f5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:29.977592 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b37d9-73e6-4594-b630-68cc24f7f5e7 admin admin] PATH_INFO: `/v3/users/ec07945499c7408191b9e2b8e255ab4a` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:29.980547 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b37d9-73e6-4594-b630-68cc24f7f5e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec07945499c7408191b9e2b8e255ab4a)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:29.983546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b37d9-73e6-4594-b630-68cc24f7f5e7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:30.010569 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247a700-22cc-4aee-a4f2-6b15313cde70 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:30.016304 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e434f8-82fc-49fc-be0d-cb0ed971f633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:30.017368 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e434f8-82fc-49fc-be0d-cb0ed971f633 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:30.017817 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e434f8-82fc-49fc-be0d-cb0ed971f633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:30.018205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e434f8-82fc-49fc-be0d-cb0ed971f633 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:30.019023 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e434f8-82fc-49fc-be0d-cb0ed971f633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:30.021248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e434f8-82fc-49fc-be0d-cb0ed971f633 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:30.154863 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 960/1917] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:29 2022] POST /identity/v3/projects => generated 385 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:37:30.155799 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e434f8-82fc-49fc-be0d-cb0ed971f633 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:30.235781 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ba2b37d9-73e6-4594-b630-68cc24f7f5e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec07945499c7408191b9e2b8e255ab4a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:30.236500 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ba2b37d9-73e6-4594-b630-68cc24f7f5e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec07945499c7408191b9e2b8e255ab4a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:30.242075 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ba2b37d9-73e6-4594-b630-68cc24f7f5e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec07945499c7408191b9e2b8e255ab4a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:30.260118 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ba2b37d9-73e6-4594-b630-68cc24f7f5e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec07945499c7408191b9e2b8e255ab4a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:30.260539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e434f8-82fc-49fc-be0d-cb0ed971f633 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:30.267505 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ba42a-9481-4ca2-8c00-72f668fcfd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:30.268334 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ba42a-9481-4ca2-8c00-72f668fcfd05 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:30.268632 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ba42a-9481-4ca2-8c00-72f668fcfd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:30.269029 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ba42a-9481-4ca2-8c00-72f668fcfd05 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:30.269668 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ba42a-9481-4ca2-8c00-72f668fcfd05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:30.272014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ba42a-9481-4ca2-8c00-72f668fcfd05 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:30.345008 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ba2b37d9-73e6-4594-b630-68cc24f7f5e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec07945499c7408191b9e2b8e255ab4a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:30.366155 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 958/1918] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:29 2022] DELETE /identity/v3/users/ec07945499c7408191b9e2b8e255ab4a => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:37:30.367775 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae647e6-2fed-45dd-ba25-7ccd2c815a42 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:30.368332 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae647e6-2fed-45dd-ba25-7ccd2c815a42 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:30.368647 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae647e6-2fed-45dd-ba25-7ccd2c815a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:30.409352 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 961/1919] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:30 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:30.411207 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ba42a-9481-4ca2-8c00-72f668fcfd05 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:30.412842 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5ae647e6-2fed-45dd-ba25-7ccd2c815a42 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:30.414290 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5ae647e6-2fed-45dd-ba25-7ccd2c815a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:30.415377 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-545ba42a-9481-4ca2-8c00-72f668fcfd05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:30.434327 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ba42a-9481-4ca2-8c00-72f668fcfd05 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:30.536113 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42feec-b159-478d-86f7-4f3c2567c4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:30.536892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42feec-b159-478d-86f7-4f3c2567c4ea admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:30.537250 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42feec-b159-478d-86f7-4f3c2567c4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:30.537529 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42feec-b159-478d-86f7-4f3c2567c4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:30.538305 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42feec-b159-478d-86f7-4f3c2567c4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:30.540385 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42feec-b159-478d-86f7-4f3c2567c4ea admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:30.546828 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 959/1920] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:30.547916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae647e6-2fed-45dd-ba25-7ccd2c815a42 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:30.554120 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5ae647e6-2fed-45dd-ba25-7ccd2c815a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:30.554481 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 962/1921] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:37:30.558616 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42feec-b159-478d-86f7-4f3c2567c4ea admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:30.573562 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae647e6-2fed-45dd-ba25-7ccd2c815a42 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:30.573801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42feec-b159-478d-86f7-4f3c2567c4ea admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:30.579031 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485b27b-5417-4997-87e4-694da024a128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:30.579172 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680e594-fb3f-466b-affb-078b10131fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:30.579732 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680e594-fb3f-466b-affb-078b10131fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:30.580134 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485b27b-5417-4997-87e4-694da024a128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:30.580245 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680e594-fb3f-466b-affb-078b10131fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:30.580479 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4680e594-fb3f-466b-affb-078b10131fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:30.580583 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485b27b-5417-4997-87e4-694da024a128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:30.580939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485b27b-5417-4997-87e4-694da024a128 admin admin] PATH_INFO: `/v3/projects/09b0e653cec4489b880bda246ce56c5d` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:30.581198 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680e594-fb3f-466b-affb-078b10131fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:30.583874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485b27b-5417-4997-87e4-694da024a128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09b0e653cec4489b880bda246ce56c5d)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:30.585404 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4680e594-fb3f-466b-affb-078b10131fd2 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:30.585921 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485b27b-5417-4997-87e4-694da024a128 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:30.611152 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 963/1922] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:30.611152 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680e594-fb3f-466b-affb-078b10131fd2 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:30.611152 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4680e594-fb3f-466b-affb-078b10131fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:30.680029 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4680e594-fb3f-466b-affb-078b10131fd2 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:30.684719 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae1849-b5fa-4d0b-9c2a-05f181770ce1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:30.685380 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae1849-b5fa-4d0b-9c2a-05f181770ce1 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:30.685732 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae1849-b5fa-4d0b-9c2a-05f181770ce1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:30.685981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ae1849-b5fa-4d0b-9c2a-05f181770ce1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:30.695442 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae1849-b5fa-4d0b-9c2a-05f181770ce1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:30.697406 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ae1849-b5fa-4d0b-9c2a-05f181770ce1 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:30.707541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 964/1923] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:30.708303 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae1849-b5fa-4d0b-9c2a-05f181770ce1 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:30.718851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ae1849-b5fa-4d0b-9c2a-05f181770ce1 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:30.735972 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a485b27b-5417-4997-87e4-694da024a128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b0e653cec4489b880bda246ce56c5d', 'request_id': 'req-a485b27b-5417-4997-87e4-694da024a128'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:30.743556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a485b27b-5417-4997-87e4-694da024a128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b0e653cec4489b880bda246ce56c5d', 'request_id': 'req-a485b27b-5417-4997-87e4-694da024a128'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:30.751958 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a485b27b-5417-4997-87e4-694da024a128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b0e653cec4489b880bda246ce56c5d', 'request_id': 'req-a485b27b-5417-4997-87e4-694da024a128'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:30.788674 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0f31f-cbc7-4ade-a1ef-61792b780c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:30.790079 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0f31f-cbc7-4ade-a1ef-61792b780c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:30.790426 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0f31f-cbc7-4ade-a1ef-61792b780c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:30.790749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0f31f-cbc7-4ade-a1ef-61792b780c27 admin admin] PATH_INFO: `/v3/projects/494f50ba342946aa98af2c0aae38ad04/users/5436552f1a0e4a84bbbe4c5d2c3bc21e/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:30.812453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0f31f-cbc7-4ade-a1ef-61792b780c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=494f50ba342946aa98af2c0aae38ad04, user_id=5436552f1a0e4a84bbbe4c5d2c3bc21e, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:30.816147 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0f31f-cbc7-4ade-a1ef-61792b780c27 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:30.989487 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 965/1924] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:30 2022] PUT /identity/v3/projects/494f50ba342946aa98af2c0aae38ad04/users/5436552f1a0e4a84bbbe4c5d2c3bc21e/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:31.000534 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0f31f-cbc7-4ade-a1ef-61792b780c27 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:31.002410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2be0f31f-cbc7-4ade-a1ef-61792b780c27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:31.062739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a485b27b-5417-4997-87e4-694da024a128 admin admin] The token cache is being invalidate because project 09b0e653cec4489b880bda246ce56c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:31.063039 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a485b27b-5417-4997-87e4-694da024a128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:31.066314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a485b27b-5417-4997-87e4-694da024a128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:31.068251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 960/1925] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:30 2022] DELETE /identity/v3/projects/09b0e653cec4489b880bda246ce56c5d => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:31.070080 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01685c99-bec4-432f-bd4c-4c66e11a5538 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:31.070371 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01685c99-bec4-432f-bd4c-4c66e11a5538 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:31.070656 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01685c99-bec4-432f-bd4c-4c66e11a5538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:31.118138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-01685c99-bec4-432f-bd4c-4c66e11a5538 None None] MFA Rules not processed for user `5436552f1a0e4a84bbbe4c5d2c3bc21e`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:31.120418 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-01685c99-bec4-432f-bd4c-4c66e11a5538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:31.130992 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0f31f-cbc7-4ade-a1ef-61792b780c27 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:31.143459 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677b0cb-ab9f-4a6b-b712-014694c29a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:31.145212 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677b0cb-ab9f-4a6b-b712-014694c29a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:31.145630 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677b0cb-ab9f-4a6b-b712-014694c29a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:31.146024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677b0cb-ab9f-4a6b-b712-014694c29a1e admin admin] PATH_INFO: `/v3/users/5804ae7a29ec4e98a6d0380265462b70` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:31.149791 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677b0cb-ab9f-4a6b-b712-014694c29a1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5804ae7a29ec4e98a6d0380265462b70)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:31.152584 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677b0cb-ab9f-4a6b-b712-014694c29a1e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:31.246806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 961/1926] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:31.246806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756acf1-ae0e-46eb-a567-f3c4c2cd6f09 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:31.246806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756acf1-ae0e-46eb-a567-f3c4c2cd6f09 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:31.246806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2756acf1-ae0e-46eb-a567-f3c4c2cd6f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:31.268530 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2756acf1-ae0e-46eb-a567-f3c4c2cd6f09 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:31.271531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2756acf1-ae0e-46eb-a567-f3c4c2cd6f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:31.279879 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 962/1927] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:31.280730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756acf1-ae0e-46eb-a567-f3c4c2cd6f09 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:31.282146 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2756acf1-ae0e-46eb-a567-f3c4c2cd6f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:31.295206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2756acf1-ae0e-46eb-a567-f3c4c2cd6f09 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:31.300419 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b0de4-8a6a-42ef-897c-0039bb8e56f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:31.301190 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b0de4-8a6a-42ef-897c-0039bb8e56f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:31.301612 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b0de4-8a6a-42ef-897c-0039bb8e56f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:31.301936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b0de4-8a6a-42ef-897c-0039bb8e56f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:31.302731 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b0de4-8a6a-42ef-897c-0039bb8e56f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:31.303113 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:31.304804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b0de4-8a6a-42ef-897c-0039bb8e56f7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:31.438922 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 963/1928] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:31 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:31.440371 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaceab-21b0-43fa-883f-d9fd65c9edb0 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:31.440668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaceab-21b0-43fa-883f-d9fd65c9edb0 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:31.440953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbaceab-21b0-43fa-883f-d9fd65c9edb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:31.450332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-2677b0cb-ab9f-4a6b-b712-014694c29a1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5804ae7a29ec4e98a6d0380265462b70'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:31.451549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-2677b0cb-ab9f-4a6b-b712-014694c29a1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5804ae7a29ec4e98a6d0380265462b70'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:31.457021 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-2677b0cb-ab9f-4a6b-b712-014694c29a1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5804ae7a29ec4e98a6d0380265462b70'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:31.485225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-2677b0cb-ab9f-4a6b-b712-014694c29a1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5804ae7a29ec4e98a6d0380265462b70'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:31.493602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-2677b0cb-ab9f-4a6b-b712-014694c29a1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5804ae7a29ec4e98a6d0380265462b70'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:31.503441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-bbbaceab-21b0-43fa-883f-d9fd65c9edb0 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:31.504765 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bbbaceab-21b0-43fa-883f-d9fd65c9edb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:31.567604 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 964/1929] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:31.568706 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaceab-21b0-43fa-883f-d9fd65c9edb0 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:31.570101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bbbaceab-21b0-43fa-883f-d9fd65c9edb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:31.581978 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbaceab-21b0-43fa-883f-d9fd65c9edb0 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:31.586490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec344db-a0bb-48e2-84f7-5c86cfcf0665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:31.587347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec344db-a0bb-48e2-84f7-5c86cfcf0665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:31.587662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec344db-a0bb-48e2-84f7-5c86cfcf0665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:31.587941 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec344db-a0bb-48e2-84f7-5c86cfcf0665 admin admin] PATH_INFO: `/v3/projects/286238a6a014405b9277acc79bf06c48` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:31.589148 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec344db-a0bb-48e2-84f7-5c86cfcf0665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=286238a6a014405b9277acc79bf06c48)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:31.591123 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec344db-a0bb-48e2-84f7-5c86cfcf0665 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:31.621332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 966/1930] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:30 2022] DELETE /identity/v3/users/5804ae7a29ec4e98a6d0380265462b70 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:31.622185 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677b0cb-ab9f-4a6b-b712-014694c29a1e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:31.623524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2677b0cb-ab9f-4a6b-b712-014694c29a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:31.691763 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677b0cb-ab9f-4a6b-b712-014694c29a1e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:31.696630 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fa932-0425-4d45-9d0c-ccf1acae723f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:31.697349 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fa932-0425-4d45-9d0c-ccf1acae723f admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:31.697636 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fa932-0425-4d45-9d0c-ccf1acae723f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:31.697939 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94fa932-0425-4d45-9d0c-ccf1acae723f admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:31.698636 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94fa932-0425-4d45-9d0c-ccf1acae723f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:31.700570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94fa932-0425-4d45-9d0c-ccf1acae723f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:31.734234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-aec344db-a0bb-48e2-84f7-5c86cfcf0665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '286238a6a014405b9277acc79bf06c48', 'request_id': 'req-aec344db-a0bb-48e2-84f7-5c86cfcf0665'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:31.740632 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-aec344db-a0bb-48e2-84f7-5c86cfcf0665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '286238a6a014405b9277acc79bf06c48', 'request_id': 'req-aec344db-a0bb-48e2-84f7-5c86cfcf0665'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:31.748769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-aec344db-a0bb-48e2-84f7-5c86cfcf0665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '286238a6a014405b9277acc79bf06c48', 'request_id': 'req-aec344db-a0bb-48e2-84f7-5c86cfcf0665'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:31.784832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 967/1931] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:31 2022] POST /identity/v3/users => generated 299 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:31.785748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fa932-0425-4d45-9d0c-ccf1acae723f admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:31.796410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94fa932-0425-4d45-9d0c-ccf1acae723f admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:31.852817 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05802812-d2d9-468b-b0c8-ccbaa2bef14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:31.854091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05802812-d2d9-468b-b0c8-ccbaa2bef14a admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:31.854381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05802812-d2d9-468b-b0c8-ccbaa2bef14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:31.854659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05802812-d2d9-468b-b0c8-ccbaa2bef14a admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:31.855384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05802812-d2d9-468b-b0c8-ccbaa2bef14a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:37:31.855692 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05802812-d2d9-468b-b0c8-ccbaa2bef14a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:31.857736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05802812-d2d9-468b-b0c8-ccbaa2bef14a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:31.865592 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-aec344db-a0bb-48e2-84f7-5c86cfcf0665 admin admin] The token cache is being invalidate because project 286238a6a014405b9277acc79bf06c48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:31.866474 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-aec344db-a0bb-48e2-84f7-5c86cfcf0665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:31.872586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-aec344db-a0bb-48e2-84f7-5c86cfcf0665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:31.872673 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 968/1933] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:37:31.872673 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbfc5c-fb52-4082-8a67-16d67277f2b9 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:31.872673 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbfc5c-fb52-4082-8a67-16d67277f2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:31.873226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbfc5c-fb52-4082-8a67-16d67277f2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:31.873925 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 965/1933] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:31 2022] DELETE /identity/v3/projects/286238a6a014405b9277acc79bf06c48 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:31.874974 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec344db-a0bb-48e2-84f7-5c86cfcf0665 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:31.877341 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-aec344db-a0bb-48e2-84f7-5c86cfcf0665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:31.891784 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec344db-a0bb-48e2-84f7-5c86cfcf0665 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:31.892704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-1bfbfc5c-fb52-4082-8a67-16d67277f2b9 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:31.894146 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1bfbfc5c-fb52-4082-8a67-16d67277f2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:31.897278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7e0cb-7feb-412a-9f64-525c8d399cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:31.898117 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7e0cb-7feb-412a-9f64-525c8d399cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:31.898725 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7e0cb-7feb-412a-9f64-525c8d399cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:31.899164 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc7e0cb-7feb-412a-9f64-525c8d399cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:31.900567 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7e0cb-7feb-412a-9f64-525c8d399cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:31.902383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc7e0cb-7feb-412a-9f64-525c8d399cc9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:31.903797 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 969/1934] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:31.904515 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbfc5c-fb52-4082-8a67-16d67277f2b9 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:31.905896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1bfbfc5c-fb52-4082-8a67-16d67277f2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:31.915123 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 966/1935] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:31.919185 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbfc5c-fb52-4082-8a67-16d67277f2b9 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:31.919858 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7e0cb-7feb-412a-9f64-525c8d399cc9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:31.921643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1cc7e0cb-7feb-412a-9f64-525c8d399cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:31.926056 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb1c92-3941-4bb5-bcda-eddc77b302ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:31.926943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb1c92-3941-4bb5-bcda-eddc77b302ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:31.927224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb1c92-3941-4bb5-bcda-eddc77b302ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:31.927500 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fb1c92-3941-4bb5-bcda-eddc77b302ea admin admin] PATH_INFO: `/v3/users/d2a8164e43154a1b8480b1fda5a24133` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:31.928734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb1c92-3941-4bb5-bcda-eddc77b302ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2a8164e43154a1b8480b1fda5a24133)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:31.930779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fb1c92-3941-4bb5-bcda-eddc77b302ea admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:31.937009 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc7e0cb-7feb-412a-9f64-525c8d399cc9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:31.942030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ae08b-0ed0-4489-ac50-a2286c00b6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:31.942518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ae08b-0ed0-4489-ac50-a2286c00b6fc admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:31.942806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ae08b-0ed0-4489-ac50-a2286c00b6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:31.943083 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ae08b-0ed0-4489-ac50-a2286c00b6fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:31.943766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ae08b-0ed0-4489-ac50-a2286c00b6fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:31.946056 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ae08b-0ed0-4489-ac50-a2286c00b6fc admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:32.097162 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 967/1936] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:31 2022] POST /identity/v3/projects => generated 401 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:32.097162 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ae08b-0ed0-4489-ac50-a2286c00b6fc admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:32.100572 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4f1ae08b-0ed0-4489-ac50-a2286c00b6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:32.202741 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ae08b-0ed0-4489-ac50-a2286c00b6fc admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:32.206807 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f3fb1c92-3941-4bb5-bcda-eddc77b302ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2a8164e43154a1b8480b1fda5a24133'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:32.207494 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f3fb1c92-3941-4bb5-bcda-eddc77b302ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2a8164e43154a1b8480b1fda5a24133'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:32.208373 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f3fb1c92-3941-4bb5-bcda-eddc77b302ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2a8164e43154a1b8480b1fda5a24133'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:32.211897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23463273-b203-49b2-8dc3-0dcd544a431c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:32.214013 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23463273-b203-49b2-8dc3-0dcd544a431c service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:32.214875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23463273-b203-49b2-8dc3-0dcd544a431c service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:32.215595 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23463273-b203-49b2-8dc3-0dcd544a431c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:32.234117 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f3fb1c92-3941-4bb5-bcda-eddc77b302ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2a8164e43154a1b8480b1fda5a24133'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:32.236983 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:32.239458 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-23463273-b203-49b2-8dc3-0dcd544a431c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:32.244398 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f3fb1c92-3941-4bb5-bcda-eddc77b302ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2a8164e43154a1b8480b1fda5a24133'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:32.340122 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23463273-b203-49b2-8dc3-0dcd544a431c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:32.341658 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23463273-b203-49b2-8dc3-0dcd544a431c service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:32.355004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 968/1937] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:32.355902 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23463273-b203-49b2-8dc3-0dcd544a431c service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:32.357482 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-23463273-b203-49b2-8dc3-0dcd544a431c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:32.360662 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 970/1938] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:31 2022] DELETE /identity/v3/users/d2a8164e43154a1b8480b1fda5a24133 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:32.361978 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb1c92-3941-4bb5-bcda-eddc77b302ea admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:32.367656 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f3fb1c92-3941-4bb5-bcda-eddc77b302ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:32.389134 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23463273-b203-49b2-8dc3-0dcd544a431c service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:32.524095 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeae92f-b672-42ba-bed2-f58a8b3c2417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:32.525584 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeae92f-b672-42ba-bed2-f58a8b3c2417 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:32.525905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeae92f-b672-42ba-bed2-f58a8b3c2417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:32.527635 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeae92f-b672-42ba-bed2-f58a8b3c2417 admin admin] PATH_INFO: `/v3/projects/dd2cc5755b804a86989d5e24f82e9b78/users/21d7da4b6ff84f2eba11f57546713a6a/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:32.557244 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeae92f-b672-42ba-bed2-f58a8b3c2417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd2cc5755b804a86989d5e24f82e9b78, user_id=21d7da4b6ff84f2eba11f57546713a6a, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:32.560582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeae92f-b672-42ba-bed2-f58a8b3c2417 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:32.589190 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fb1c92-3941-4bb5-bcda-eddc77b302ea admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:32.596965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa68e9-b0ae-4555-bd42-38a7e1ab2374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:32.597923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa68e9-b0ae-4555-bd42-38a7e1ab2374 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:32.598376 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa68e9-b0ae-4555-bd42-38a7e1ab2374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:32.598726 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa68e9-b0ae-4555-bd42-38a7e1ab2374 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:32.600240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa68e9-b0ae-4555-bd42-38a7e1ab2374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:32.603999 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa68e9-b0ae-4555-bd42-38a7e1ab2374 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:32.687741 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 969/1939] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:32 2022] PUT /identity/v3/projects/dd2cc5755b804a86989d5e24f82e9b78/users/21d7da4b6ff84f2eba11f57546713a6a/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:32.701118 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeae92f-b672-42ba-bed2-f58a8b3c2417 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:32.751342 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 971/1940] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:32 2022] POST /identity/v3/users => generated 301 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:32.752545 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa68e9-b0ae-4555-bd42-38a7e1ab2374 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:32.765414 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:32.776089 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa68e9-b0ae-4555-bd42-38a7e1ab2374 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:32.814124 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeae92f-b672-42ba-bed2-f58a8b3c2417 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:32.820618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d711d-1468-48e9-834a-369f1b3a59a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:32.824441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d711d-1468-48e9-834a-369f1b3a59a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:32.824441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d711d-1468-48e9-834a-369f1b3a59a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:32.824441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d711d-1468-48e9-834a-369f1b3a59a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:32.824441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d711d-1468-48e9-834a-369f1b3a59a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:32.826256 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d711d-1468-48e9-834a-369f1b3a59a0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:32.840634 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 970/1941] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:37:32.844579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d711d-1468-48e9-834a-369f1b3a59a0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:32.860092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d711d-1468-48e9-834a-369f1b3a59a0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:32.865922 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e2fae-debe-4e94-8e30-4dcc1e2192be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:32.866843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e2fae-debe-4e94-8e30-4dcc1e2192be admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:32.867129 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e2fae-debe-4e94-8e30-4dcc1e2192be admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:32.867414 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e2fae-debe-4e94-8e30-4dcc1e2192be admin admin] PATH_INFO: `/v3/projects/dd2cc5755b804a86989d5e24f82e9b78/users/21d7da4b6ff84f2eba11f57546713a6a/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:32.868103 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c57b2-445e-4b8c-8583-f3de6e943abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:32.869513 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c57b2-445e-4b8c-8583-f3de6e943abd admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:32.869874 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c57b2-445e-4b8c-8583-f3de6e943abd admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:32.870255 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57c57b2-445e-4b8c-8583-f3de6e943abd admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:32.870574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e2fae-debe-4e94-8e30-4dcc1e2192be admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd2cc5755b804a86989d5e24f82e9b78, user_id=21d7da4b6ff84f2eba11f57546713a6a, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:32.871289 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c57b2-445e-4b8c-8583-f3de6e943abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:32.873069 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57c57b2-445e-4b8c-8583-f3de6e943abd admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:32.873610 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e2fae-debe-4e94-8e30-4dcc1e2192be admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:32.884538 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 972/1942] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:32.888511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 971/1943] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:32 2022] PUT /identity/v3/projects/dd2cc5755b804a86989d5e24f82e9b78/users/21d7da4b6ff84f2eba11f57546713a6a/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:32.888666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c57b2-445e-4b8c-8583-f3de6e943abd admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:32.900029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d68f85-ab12-4133-929f-42ce0e9f861d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:32.900496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d68f85-ab12-4133-929f-42ce0e9f861d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:32.900851 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d68f85-ab12-4133-929f-42ce0e9f861d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:32.913570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57c57b2-445e-4b8c-8583-f3de6e943abd admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:32.943533 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a9d68f85-ab12-4133-929f-42ce0e9f861d None None] MFA Rules not processed for user `21d7da4b6ff84f2eba11f57546713a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:32.944956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a9d68f85-ab12-4133-929f-42ce0e9f861d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:33.008021 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763a079-4533-4e97-b64d-9821e7f1eef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:33.008876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763a079-4533-4e97-b64d-9821e7f1eef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:33.009258 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763a079-4533-4e97-b64d-9821e7f1eef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:33.009445 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763a079-4533-4e97-b64d-9821e7f1eef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:33.010249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763a079-4533-4e97-b64d-9821e7f1eef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:33.012146 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763a079-4533-4e97-b64d-9821e7f1eef0 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:33.025089 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 973/1944] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:37:33.029242 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763a079-4533-4e97-b64d-9821e7f1eef0 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:33.040303 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763a079-4533-4e97-b64d-9821e7f1eef0 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:33.045680 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3f1e0-8794-42d0-9e09-24f81aebef4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:33.048928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 972/1945] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:37:33.049049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3f1e0-8794-42d0-9e09-24f81aebef4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:33.049049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3f1e0-8794-42d0-9e09-24f81aebef4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:33.049049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3f1e0-8794-42d0-9e09-24f81aebef4a admin admin] PATH_INFO: `/v3/projects/15d9a97d10874e57b64d238a9e93cffb/users/62c6d4ae2d154b7f8c98aa9486ffc58f/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:33.058833 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d68f85-ab12-4133-929f-42ce0e9f861d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:33.060652 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a9d68f85-ab12-4133-929f-42ce0e9f861d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:33.062785 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3f1e0-8794-42d0-9e09-24f81aebef4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d9a97d10874e57b64d238a9e93cffb, user_id=62c6d4ae2d154b7f8c98aa9486ffc58f, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:33.065676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a3f1e0-8794-42d0-9e09-24f81aebef4a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:33.156293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d68f85-ab12-4133-929f-42ce0e9f861d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:33.161241 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723afd1b-3b2a-40fb-bb5d-d5d6dbbaef1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:33.169904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723afd1b-3b2a-40fb-bb5d-d5d6dbbaef1f service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:33.169904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723afd1b-3b2a-40fb-bb5d-d5d6dbbaef1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:33.169904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723afd1b-3b2a-40fb-bb5d-d5d6dbbaef1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:33.174209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723afd1b-3b2a-40fb-bb5d-d5d6dbbaef1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:33.175692 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723afd1b-3b2a-40fb-bb5d-d5d6dbbaef1f service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:33.187713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 973/1946] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:37:33.188771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723afd1b-3b2a-40fb-bb5d-d5d6dbbaef1f service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:33.190149 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-723afd1b-3b2a-40fb-bb5d-d5d6dbbaef1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:33.206844 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723afd1b-3b2a-40fb-bb5d-d5d6dbbaef1f service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:33.215453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 974/1947] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:33 2022] PUT /identity/v3/projects/15d9a97d10874e57b64d238a9e93cffb/users/62c6d4ae2d154b7f8c98aa9486ffc58f/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:33.216452 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3f1e0-8794-42d0-9e09-24f81aebef4a admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:33.219029 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-72a3f1e0-8794-42d0-9e09-24f81aebef4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:33.269904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79741f8-aba4-4b0e-ad8d-7e9f556f876e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:33.272894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79741f8-aba4-4b0e-ad8d-7e9f556f876e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:33.272894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79741f8-aba4-4b0e-ad8d-7e9f556f876e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:33.272894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79741f8-aba4-4b0e-ad8d-7e9f556f876e admin admin] PATH_INFO: `/v3/projects/014788c32a8c4f99bff2b7de86fa1ae7` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:33.272894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79741f8-aba4-4b0e-ad8d-7e9f556f876e admin admin] RBAC: Authorizing `identity:delete_project(project_id=014788c32a8c4f99bff2b7de86fa1ae7)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:33.275921 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79741f8-aba4-4b0e-ad8d-7e9f556f876e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:33.332916 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a3f1e0-8794-42d0-9e09-24f81aebef4a admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:33.340272 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f16ce-3825-4d95-9cf5-4cfff8abec67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:33.340993 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f16ce-3825-4d95-9cf5-4cfff8abec67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:33.341344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f16ce-3825-4d95-9cf5-4cfff8abec67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:33.341746 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41f16ce-3825-4d95-9cf5-4cfff8abec67 admin admin] PATH_INFO: `/v3/projects/571e6fb2633a4aea8b47bab9b5431e21` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:33.343071 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f16ce-3825-4d95-9cf5-4cfff8abec67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=571e6fb2633a4aea8b47bab9b5431e21)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:33.346323 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41f16ce-3825-4d95-9cf5-4cfff8abec67 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:33.466901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c79741f8-aba4-4b0e-ad8d-7e9f556f876e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '014788c32a8c4f99bff2b7de86fa1ae7', 'request_id': 'req-c79741f8-aba4-4b0e-ad8d-7e9f556f876e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:33.472555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c79741f8-aba4-4b0e-ad8d-7e9f556f876e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '014788c32a8c4f99bff2b7de86fa1ae7', 'request_id': 'req-c79741f8-aba4-4b0e-ad8d-7e9f556f876e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:33.480090 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c79741f8-aba4-4b0e-ad8d-7e9f556f876e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '014788c32a8c4f99bff2b7de86fa1ae7', 'request_id': 'req-c79741f8-aba4-4b0e-ad8d-7e9f556f876e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:33.501073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a41f16ce-3825-4d95-9cf5-4cfff8abec67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '571e6fb2633a4aea8b47bab9b5431e21', 'request_id': 'req-a41f16ce-3825-4d95-9cf5-4cfff8abec67'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:33.508483 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a41f16ce-3825-4d95-9cf5-4cfff8abec67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '571e6fb2633a4aea8b47bab9b5431e21', 'request_id': 'req-a41f16ce-3825-4d95-9cf5-4cfff8abec67'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:33.519375 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a41f16ce-3825-4d95-9cf5-4cfff8abec67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '571e6fb2633a4aea8b47bab9b5431e21', 'request_id': 'req-a41f16ce-3825-4d95-9cf5-4cfff8abec67'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:33.616845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c79741f8-aba4-4b0e-ad8d-7e9f556f876e admin admin] The token cache is being invalidate because project 014788c32a8c4f99bff2b7de86fa1ae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:33.616845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c79741f8-aba4-4b0e-ad8d-7e9f556f876e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:33.617436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c79741f8-aba4-4b0e-ad8d-7e9f556f876e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:33.619620 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 974/1948] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:33 2022] DELETE /identity/v3/projects/014788c32a8c4f99bff2b7de86fa1ae7 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:33.620911 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e5f7d-4ea2-4828-b5a1-161481f09996 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:33.621208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e5f7d-4ea2-4828-b5a1-161481f09996 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:33.621559 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e5f7d-4ea2-4828-b5a1-161481f09996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:33.649651 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-662e5f7d-4ea2-4828-b5a1-161481f09996 None None] MFA Rules not processed for user `62c6d4ae2d154b7f8c98aa9486ffc58f`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:33.650921 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-662e5f7d-4ea2-4828-b5a1-161481f09996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:33.721116 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a41f16ce-3825-4d95-9cf5-4cfff8abec67 admin admin] The token cache is being invalidate because project 571e6fb2633a4aea8b47bab9b5431e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:33.721670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a41f16ce-3825-4d95-9cf5-4cfff8abec67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:33.722164 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a41f16ce-3825-4d95-9cf5-4cfff8abec67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:33.723853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 975/1949] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:33 2022] DELETE /identity/v3/projects/571e6fb2633a4aea8b47bab9b5431e21 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:33.724922 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f16ce-3825-4d95-9cf5-4cfff8abec67 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:33.726870 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a41f16ce-3825-4d95-9cf5-4cfff8abec67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:33.728487 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 975/1950] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:33 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:33.730178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314d65f-ae2b-42a5-a2b9-91e8a6a3fa89 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:33.730653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314d65f-ae2b-42a5-a2b9-91e8a6a3fa89 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:33.731129 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8314d65f-ae2b-42a5-a2b9-91e8a6a3fa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:33.752319 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8314d65f-ae2b-42a5-a2b9-91e8a6a3fa89 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:33.754027 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8314d65f-ae2b-42a5-a2b9-91e8a6a3fa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:33.812814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41f16ce-3825-4d95-9cf5-4cfff8abec67 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:33.817499 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180e080-2405-4bc6-9de5-73233f083bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:33.818421 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180e080-2405-4bc6-9de5-73233f083bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:33.823467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180e080-2405-4bc6-9de5-73233f083bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:33.823467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180e080-2405-4bc6-9de5-73233f083bb9 admin admin] PATH_INFO: `/v3/users/8134642b117c4e3d8b1a106db2709a20` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:33.823467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180e080-2405-4bc6-9de5-73233f083bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8134642b117c4e3d8b1a106db2709a20)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:33.823467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180e080-2405-4bc6-9de5-73233f083bb9 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:33.841915 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 976/1951] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:33.842598 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314d65f-ae2b-42a5-a2b9-91e8a6a3fa89 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:33.844870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8314d65f-ae2b-42a5-a2b9-91e8a6a3fa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:33.858961 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8314d65f-ae2b-42a5-a2b9-91e8a6a3fa89 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:33.869320 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f261d-2189-4f53-98f7-24e802293556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:33.870114 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f261d-2189-4f53-98f7-24e802293556 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:33.870532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f261d-2189-4f53-98f7-24e802293556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:33.870816 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f261d-2189-4f53-98f7-24e802293556 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:33.871569 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f261d-2189-4f53-98f7-24e802293556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:33.873519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f261d-2189-4f53-98f7-24e802293556 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:34.074023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 977/1952] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:33 2022] POST /identity/v3/projects => generated 399 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:34.075221 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677e764-525a-48be-ab13-b54df441b817 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:34.075566 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677e764-525a-48be-ab13-b54df441b817 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:34.075905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677e764-525a-48be-ab13-b54df441b817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:34.094817 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2677e764-525a-48be-ab13-b54df441b817 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:34.096096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2677e764-525a-48be-ab13-b54df441b817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:34.115502 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3180e080-2405-4bc6-9de5-73233f083bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8134642b117c4e3d8b1a106db2709a20'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:34.116209 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3180e080-2405-4bc6-9de5-73233f083bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8134642b117c4e3d8b1a106db2709a20'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:34.117006 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3180e080-2405-4bc6-9de5-73233f083bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8134642b117c4e3d8b1a106db2709a20'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:34.144998 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3180e080-2405-4bc6-9de5-73233f083bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8134642b117c4e3d8b1a106db2709a20'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:34.153380 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3180e080-2405-4bc6-9de5-73233f083bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8134642b117c4e3d8b1a106db2709a20'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:34.194152 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 978/1953] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:34.195079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677e764-525a-48be-ab13-b54df441b817 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:34.196432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2677e764-525a-48be-ab13-b54df441b817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:34.208425 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677e764-525a-48be-ab13-b54df441b817 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:34.213918 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae24bd1-e3d3-44bf-96cd-8d0bd6476dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:34.214590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae24bd1-e3d3-44bf-96cd-8d0bd6476dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:34.214876 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae24bd1-e3d3-44bf-96cd-8d0bd6476dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:34.215197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae24bd1-e3d3-44bf-96cd-8d0bd6476dd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:34.215884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae24bd1-e3d3-44bf-96cd-8d0bd6476dd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:34.217814 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae24bd1-e3d3-44bf-96cd-8d0bd6476dd0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:34.234179 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 976/1954] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:33 2022] DELETE /identity/v3/users/8134642b117c4e3d8b1a106db2709a20 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:34.235040 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180e080-2405-4bc6-9de5-73233f083bb9 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:34.326509 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 979/1955] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:34 2022] POST /identity/v3/users => generated 306 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:34.327048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180e080-2405-4bc6-9de5-73233f083bb9 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:34.328186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae24bd1-e3d3-44bf-96cd-8d0bd6476dd0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:34.341419 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae24bd1-e3d3-44bf-96cd-8d0bd6476dd0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:34.343454 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb328f-a08a-4efa-9758-2ede5406028c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:34.344777 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb328f-a08a-4efa-9758-2ede5406028c admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:34.345102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb328f-a08a-4efa-9758-2ede5406028c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:34.345397 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeb328f-a08a-4efa-9758-2ede5406028c admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:34.346187 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb328f-a08a-4efa-9758-2ede5406028c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:37:34.346501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb328f-a08a-4efa-9758-2ede5406028c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:34.346919 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d0758-638f-4ab3-a9e0-da1aec7286c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:34.347729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d0758-638f-4ab3-a9e0-da1aec7286c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:34.347989 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d0758-638f-4ab3-a9e0-da1aec7286c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:34.348142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeb328f-a08a-4efa-9758-2ede5406028c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:34.348248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4d0758-638f-4ab3-a9e0-da1aec7286c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:34.349909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d0758-638f-4ab3-a9e0-da1aec7286c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:34.351859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4d0758-638f-4ab3-a9e0-da1aec7286c1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:34.361467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 977/1956] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:37:34.362018 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 980/1957] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:34.366388 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d0758-638f-4ab3-a9e0-da1aec7286c1 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:34.366514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb328f-a08a-4efa-9758-2ede5406028c admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:34.377086 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeb328f-a08a-4efa-9758-2ede5406028c admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:34.377993 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4d0758-638f-4ab3-a9e0-da1aec7286c1 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:34.381955 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7d2ae-a3d8-458e-ae2b-e2bd787dbea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:34.382925 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7d2ae-a3d8-458e-ae2b-e2bd787dbea4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:34.383286 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7d2ae-a3d8-458e-ae2b-e2bd787dbea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:34.383663 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7d2ae-a3d8-458e-ae2b-e2bd787dbea4 admin admin] PATH_INFO: `/v3/projects/06f506b20f3d433192e3902bb4fdf29f/users/7ff815bcaa754b2e89913af249a9a07e/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:34.384580 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f207cf-2ff5-4e93-af11-a69962e142e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:34.385313 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f207cf-2ff5-4e93-af11-a69962e142e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:34.385669 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f207cf-2ff5-4e93-af11-a69962e142e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:34.386047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f207cf-2ff5-4e93-af11-a69962e142e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:34.386810 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f207cf-2ff5-4e93-af11-a69962e142e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:34.388839 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f207cf-2ff5-4e93-af11-a69962e142e7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:34.400318 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7d2ae-a3d8-458e-ae2b-e2bd787dbea4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f506b20f3d433192e3902bb4fdf29f, user_id=7ff815bcaa754b2e89913af249a9a07e, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:34.403847 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7d2ae-a3d8-458e-ae2b-e2bd787dbea4 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:34.525172 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 978/1958] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:34 2022] PUT /identity/v3/projects/06f506b20f3d433192e3902bb4fdf29f/users/7ff815bcaa754b2e89913af249a9a07e/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:34.526259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7d2ae-a3d8-458e-ae2b-e2bd787dbea4 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:34.530777 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 981/1959] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:34 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:34.534857 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f207cf-2ff5-4e93-af11-a69962e142e7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:34.620490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f207cf-2ff5-4e93-af11-a69962e142e7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:34.620490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320e1f7-b578-4248-aa05-6386b59eaa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:34.620490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320e1f7-b578-4248-aa05-6386b59eaa80 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:34.620490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320e1f7-b578-4248-aa05-6386b59eaa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:34.621243 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a320e1f7-b578-4248-aa05-6386b59eaa80 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:34.621243 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320e1f7-b578-4248-aa05-6386b59eaa80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:34.621243 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a320e1f7-b578-4248-aa05-6386b59eaa80 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:34.660835 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7d2ae-a3d8-458e-ae2b-e2bd787dbea4 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:34.666893 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe245bf7-12a2-424c-8672-48de57926ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:34.667900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe245bf7-12a2-424c-8672-48de57926ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:34.667900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe245bf7-12a2-424c-8672-48de57926ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:34.668190 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe245bf7-12a2-424c-8672-48de57926ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:34.668964 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe245bf7-12a2-424c-8672-48de57926ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:34.670654 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe245bf7-12a2-424c-8672-48de57926ad7 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:34.681740 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 979/1960] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:37:34.686050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe245bf7-12a2-424c-8672-48de57926ad7 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:34.696488 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe245bf7-12a2-424c-8672-48de57926ad7 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:34.701437 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e502ca6-ea65-4335-ba82-2254aa63a6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:34.702509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e502ca6-ea65-4335-ba82-2254aa63a6ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:34.702826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e502ca6-ea65-4335-ba82-2254aa63a6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:34.703105 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e502ca6-ea65-4335-ba82-2254aa63a6ab admin admin] PATH_INFO: `/v3/projects/06f506b20f3d433192e3902bb4fdf29f/users/7ff815bcaa754b2e89913af249a9a07e/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:34.705202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e502ca6-ea65-4335-ba82-2254aa63a6ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=06f506b20f3d433192e3902bb4fdf29f, user_id=7ff815bcaa754b2e89913af249a9a07e, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:34.708000 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e502ca6-ea65-4335-ba82-2254aa63a6ab admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:34.719331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 980/1961] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:34 2022] PUT /identity/v3/projects/06f506b20f3d433192e3902bb4fdf29f/users/7ff815bcaa754b2e89913af249a9a07e/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:37:34.735505 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 982/1962] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:34 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:37:34.735602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92441a9-1253-4978-8d23-04da3d947c02 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:34.735602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92441a9-1253-4978-8d23-04da3d947c02 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:34.735602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92441a9-1253-4978-8d23-04da3d947c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:34.738785 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320e1f7-b578-4248-aa05-6386b59eaa80 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:34.756255 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a320e1f7-b578-4248-aa05-6386b59eaa80 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:34.768268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a92441a9-1253-4978-8d23-04da3d947c02 None None] MFA Rules not processed for user `7ff815bcaa754b2e89913af249a9a07e`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:34.769752 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a92441a9-1253-4978-8d23-04da3d947c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:34.854642 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea0534-165a-4d07-8efe-1a256ddc46f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:34.855398 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea0534-165a-4d07-8efe-1a256ddc46f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:34.856086 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea0534-165a-4d07-8efe-1a256ddc46f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:34.856549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea0534-165a-4d07-8efe-1a256ddc46f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:34.858495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea0534-165a-4d07-8efe-1a256ddc46f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:34.860674 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea0534-165a-4d07-8efe-1a256ddc46f1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:34.874151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 983/1963] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:37:34.874957 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea0534-165a-4d07-8efe-1a256ddc46f1 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:34.877424 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2aea0534-165a-4d07-8efe-1a256ddc46f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:34.888748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 981/1964] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:34 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:37:34.889898 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92441a9-1253-4978-8d23-04da3d947c02 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:34.893186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a92441a9-1253-4978-8d23-04da3d947c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:34.895078 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea0534-165a-4d07-8efe-1a256ddc46f1 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:34.911526 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1509484d-a470-47a4-8cc5-bdb6ffdeee6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:34.912424 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509484d-a470-47a4-8cc5-bdb6ffdeee6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:34.912712 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509484d-a470-47a4-8cc5-bdb6ffdeee6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:34.912992 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1509484d-a470-47a4-8cc5-bdb6ffdeee6d admin admin] PATH_INFO: `/v3/projects/b0fe24df435142a9b420dcd9cb87a87d` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:34.914267 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509484d-a470-47a4-8cc5-bdb6ffdeee6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0fe24df435142a9b420dcd9cb87a87d)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:34.916820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1509484d-a470-47a4-8cc5-bdb6ffdeee6d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:34.951978 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92441a9-1253-4978-8d23-04da3d947c02 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:34.956005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f41d0c-b587-41fa-a484-ece8405b1bac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:34.956663 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f41d0c-b587-41fa-a484-ece8405b1bac service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:34.956949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f41d0c-b587-41fa-a484-ece8405b1bac service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:34.957268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f41d0c-b587-41fa-a484-ece8405b1bac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:34.959117 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-49f41d0c-b587-41fa-a484-ece8405b1bac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:35.021051 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f41d0c-b587-41fa-a484-ece8405b1bac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:35.022659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f41d0c-b587-41fa-a484-ece8405b1bac service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:35.033042 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 982/1965] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:35.033728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f41d0c-b587-41fa-a484-ece8405b1bac service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:35.046474 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f41d0c-b587-41fa-a484-ece8405b1bac service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:35.051911 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c9d4c-65b4-43da-92b0-cef1b3730cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:35.052729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c9d4c-65b4-43da-92b0-cef1b3730cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:35.053029 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c9d4c-65b4-43da-92b0-cef1b3730cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:35.053312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c9d4c-65b4-43da-92b0-cef1b3730cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:35.054078 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c9d4c-65b4-43da-92b0-cef1b3730cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:35.056329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c9d4c-65b4-43da-92b0-cef1b3730cd2 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:35.067084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 983/1966] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:35.072739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c9d4c-65b4-43da-92b0-cef1b3730cd2 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:35.082376 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c9d4c-65b4-43da-92b0-cef1b3730cd2 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:35.095859 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410cf36-7766-44d7-9b00-9289b84cb16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:35.097156 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410cf36-7766-44d7-9b00-9289b84cb16d admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:35.097596 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410cf36-7766-44d7-9b00-9289b84cb16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:35.097901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1410cf36-7766-44d7-9b00-9289b84cb16d admin admin] PATH_INFO: `/v3/projects/44bf417771b34d29a032853776743ce3/users/27ce42eee08843b0b5d56231c6c06558/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:35.115028 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410cf36-7766-44d7-9b00-9289b84cb16d admin admin] RBAC: Authorizing `identity:create_grant(project_id=44bf417771b34d29a032853776743ce3, user_id=27ce42eee08843b0b5d56231c6c06558, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:35.117820 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1410cf36-7766-44d7-9b00-9289b84cb16d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:35.242225 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1509484d-a470-47a4-8cc5-bdb6ffdeee6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0fe24df435142a9b420dcd9cb87a87d', 'request_id': 'req-1509484d-a470-47a4-8cc5-bdb6ffdeee6d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:35.242429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 984/1967] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:35 2022] PUT /identity/v3/projects/44bf417771b34d29a032853776743ce3/users/27ce42eee08843b0b5d56231c6c06558/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:35.245014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410cf36-7766-44d7-9b00-9289b84cb16d admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:35.250353 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1509484d-a470-47a4-8cc5-bdb6ffdeee6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0fe24df435142a9b420dcd9cb87a87d', 'request_id': 'req-1509484d-a470-47a4-8cc5-bdb6ffdeee6d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:35.250575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1410cf36-7766-44d7-9b00-9289b84cb16d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:35.259908 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1509484d-a470-47a4-8cc5-bdb6ffdeee6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0fe24df435142a9b420dcd9cb87a87d', 'request_id': 'req-1509484d-a470-47a4-8cc5-bdb6ffdeee6d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:35.329289 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1410cf36-7766-44d7-9b00-9289b84cb16d admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:35.334188 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e8cd6-bd12-489a-b45c-e9bb073e6bfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:35.334986 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e8cd6-bd12-489a-b45c-e9bb073e6bfe service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:35.335418 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e8cd6-bd12-489a-b45c-e9bb073e6bfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:35.335704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e8cd6-bd12-489a-b45c-e9bb073e6bfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:35.385871 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1509484d-a470-47a4-8cc5-bdb6ffdeee6d admin admin] The token cache is being invalidate because project b0fe24df435142a9b420dcd9cb87a87d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:35.386654 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1509484d-a470-47a4-8cc5-bdb6ffdeee6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:35.387455 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1509484d-a470-47a4-8cc5-bdb6ffdeee6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:35.389626 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 984/1968] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:34 2022] DELETE /identity/v3/projects/b0fe24df435142a9b420dcd9cb87a87d => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:35.394077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd626e26-c3f6-43a2-8ff7-7aa3e5da5342 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:35.394580 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd626e26-c3f6-43a2-8ff7-7aa3e5da5342 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:35.394948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd626e26-c3f6-43a2-8ff7-7aa3e5da5342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:35.407314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e8cd6-bd12-489a-b45c-e9bb073e6bfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:35.407668 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:35.409404 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e8cd6-bd12-489a-b45c-e9bb073e6bfe service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:35.421961 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 985/1969] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:35 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:35.423294 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38195941-2482-46ab-8ada-0b97c10c80a0 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:35.423594 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38195941-2482-46ab-8ada-0b97c10c80a0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:35.423859 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38195941-2482-46ab-8ada-0b97c10c80a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:35.447862 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-38195941-2482-46ab-8ada-0b97c10c80a0 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:35.449116 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-38195941-2482-46ab-8ada-0b97c10c80a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:35.451009 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-fd626e26-c3f6-43a2-8ff7-7aa3e5da5342 None None] MFA Rules not processed for user `27ce42eee08843b0b5d56231c6c06558`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:35.452236 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fd626e26-c3f6-43a2-8ff7-7aa3e5da5342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:35.522053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 986/1970] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:35.530369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e76efe-6d15-478f-ad05-068678389c4d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:35.536407 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e76efe-6d15-478f-ad05-068678389c4d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:35.536407 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e76efe-6d15-478f-ad05-068678389c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:35.542929 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 985/1971] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:35.548799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd626e26-c3f6-43a2-8ff7-7aa3e5da5342 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:35.550953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-47e76efe-6d15-478f-ad05-068678389c4d None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:35.551104 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fd626e26-c3f6-43a2-8ff7-7aa3e5da5342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:35.552127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-47e76efe-6d15-478f-ad05-068678389c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:35.563821 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 987/1972] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:37:35.570882 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e76efe-6d15-478f-ad05-068678389c4d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:35.577476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd626e26-c3f6-43a2-8ff7-7aa3e5da5342 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:35.584231 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e76efe-6d15-478f-ad05-068678389c4d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:35.594530 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f78c6-0138-4f6d-90b6-7fd357e44a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:35.595618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f78c6-0138-4f6d-90b6-7fd357e44a5c admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:35.599642 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f78c6-0138-4f6d-90b6-7fd357e44a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:35.599642 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f78c6-0138-4f6d-90b6-7fd357e44a5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:35.599642 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f78c6-0138-4f6d-90b6-7fd357e44a5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:35.599642 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f78c6-0138-4f6d-90b6-7fd357e44a5c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:35.611808 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488722b3-13e3-4c67-a5bd-3ad08a01ae48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:35.613626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488722b3-13e3-4c67-a5bd-3ad08a01ae48 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:35.614657 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488722b3-13e3-4c67-a5bd-3ad08a01ae48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:35.615213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488722b3-13e3-4c67-a5bd-3ad08a01ae48 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:35.618174 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488722b3-13e3-4c67-a5bd-3ad08a01ae48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:37:35.619361 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488722b3-13e3-4c67-a5bd-3ad08a01ae48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:35.622791 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488722b3-13e3-4c67-a5bd-3ad08a01ae48 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:35.647187 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 988/1973] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:37:35.655427 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488722b3-13e3-4c67-a5bd-3ad08a01ae48 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:35.677405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488722b3-13e3-4c67-a5bd-3ad08a01ae48 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:35.688207 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8679e-0b41-49a5-8d7b-e6621d65635b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:35.688937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8679e-0b41-49a5-8d7b-e6621d65635b admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:35.689254 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8679e-0b41-49a5-8d7b-e6621d65635b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:35.689609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8679e-0b41-49a5-8d7b-e6621d65635b admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:35.690441 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a8679e-0b41-49a5-8d7b-e6621d65635b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:35.692452 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a8679e-0b41-49a5-8d7b-e6621d65635b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:35.760870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 986/1974] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:35 2022] POST /identity/v3/projects => generated 375 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:37:35.762477 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f78c6-0138-4f6d-90b6-7fd357e44a5c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:35.830675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f78c6-0138-4f6d-90b6-7fd357e44a5c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:35.835519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbcc40-8537-4571-a0f9-14330fde8a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:35.836134 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbcc40-8537-4571-a0f9-14330fde8a03 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:35.836411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbcc40-8537-4571-a0f9-14330fde8a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:35.836688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbcc40-8537-4571-a0f9-14330fde8a03 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:35.837408 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbcc40-8537-4571-a0f9-14330fde8a03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:35.839399 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbcc40-8537-4571-a0f9-14330fde8a03 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:35.870501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 989/1975] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:35 2022] POST /identity/v3/projects => generated 361 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:37:35.874784 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8679e-0b41-49a5-8d7b-e6621d65635b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:35.941400 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8679e-0b41-49a5-8d7b-e6621d65635b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:35.946101 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f519b8-1172-48d0-af76-ac05b32f750b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:35.947312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f519b8-1172-48d0-af76-ac05b32f750b admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:35.947597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f519b8-1172-48d0-af76-ac05b32f750b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:35.947874 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f519b8-1172-48d0-af76-ac05b32f750b admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:35.948604 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f519b8-1172-48d0-af76-ac05b32f750b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:35.950560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f519b8-1172-48d0-af76-ac05b32f750b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:36.016242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 987/1976] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:35 2022] POST /identity/v3/users => generated 294 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:37:36.017087 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbcc40-8537-4571-a0f9-14330fde8a03 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:36.018673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-66bbcc40-8537-4571-a0f9-14330fde8a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:36.075828 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbcc40-8537-4571-a0f9-14330fde8a03 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:36.150941 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93a688-4ebc-4928-8ffd-d2acd1aa9940 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:36.151722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93a688-4ebc-4928-8ffd-d2acd1aa9940 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:36.152110 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93a688-4ebc-4928-8ffd-d2acd1aa9940 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:36.152490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93a688-4ebc-4928-8ffd-d2acd1aa9940 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:36.154516 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6b93a688-4ebc-4928-8ffd-d2acd1aa9940 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:36.175921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 990/1977] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:35 2022] POST /identity/v3/users => generated 281 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:37:36.175921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f519b8-1172-48d0-af76-ac05b32f750b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:36.182971 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f519b8-1172-48d0-af76-ac05b32f750b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:36.187876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513846b0-33e3-4700-8ce8-4be9d7d939b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:36.188555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513846b0-33e3-4700-8ce8-4be9d7d939b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:36.188880 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513846b0-33e3-4700-8ce8-4be9d7d939b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:36.189124 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513846b0-33e3-4700-8ce8-4be9d7d939b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:36.189901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513846b0-33e3-4700-8ce8-4be9d7d939b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:36.191505 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513846b0-33e3-4700-8ce8-4be9d7d939b4 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:36.202000 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 991/1978] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:36.202822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513846b0-33e3-4700-8ce8-4be9d7d939b4 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:36.209010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:36.213399 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513846b0-33e3-4700-8ce8-4be9d7d939b4 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:36.218245 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90230b2f-9052-408d-93da-cd4c4a82f75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:36.218909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90230b2f-9052-408d-93da-cd4c4a82f75b admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:36.219200 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90230b2f-9052-408d-93da-cd4c4a82f75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:36.219480 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90230b2f-9052-408d-93da-cd4c4a82f75b admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:36.220204 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90230b2f-9052-408d-93da-cd4c4a82f75b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:36.221008 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93a688-4ebc-4928-8ffd-d2acd1aa9940 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:36.221925 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90230b2f-9052-408d-93da-cd4c4a82f75b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:36.222601 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93a688-4ebc-4928-8ffd-d2acd1aa9940 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:36.232779 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 988/1979] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:36.233256 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 992/1980] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:36.233936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93a688-4ebc-4928-8ffd-d2acd1aa9940 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:36.234531 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90230b2f-9052-408d-93da-cd4c4a82f75b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:36.235494 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6b93a688-4ebc-4928-8ffd-d2acd1aa9940 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:36.244194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90230b2f-9052-408d-93da-cd4c4a82f75b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:36.250403 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93a688-4ebc-4928-8ffd-d2acd1aa9940 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:36.250852 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4891806-04a6-4b3e-9f2d-a0fcf7fee2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:36.251804 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4891806-04a6-4b3e-9f2d-a0fcf7fee2ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:36.252111 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4891806-04a6-4b3e-9f2d-a0fcf7fee2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:36.252394 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4891806-04a6-4b3e-9f2d-a0fcf7fee2ef admin admin] PATH_INFO: `/v3/projects/b551d6c560154139953b7615460ce8a7/users/7a2fe6894f9b49e9bf8caa20321abec0/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:36.255919 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735be7d9-4fec-470a-91d4-390e10423290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:36.256819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735be7d9-4fec-470a-91d4-390e10423290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:36.257106 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735be7d9-4fec-470a-91d4-390e10423290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:36.257399 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735be7d9-4fec-470a-91d4-390e10423290 admin admin] PATH_INFO: `/v3/users/ff7e1d49d0b7417eb9995e9f91310af5` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:36.258674 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735be7d9-4fec-470a-91d4-390e10423290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff7e1d49d0b7417eb9995e9f91310af5)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:36.260632 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735be7d9-4fec-470a-91d4-390e10423290 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:36.268366 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4891806-04a6-4b3e-9f2d-a0fcf7fee2ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b551d6c560154139953b7615460ce8a7, user_id=7a2fe6894f9b49e9bf8caa20321abec0, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:36.272040 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4891806-04a6-4b3e-9f2d-a0fcf7fee2ef admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:36.421181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 993/1981] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:36 2022] PUT /identity/v3/projects/b551d6c560154139953b7615460ce8a7/users/7a2fe6894f9b49e9bf8caa20321abec0/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:36.425060 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4891806-04a6-4b3e-9f2d-a0fcf7fee2ef admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:36.488962 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4891806-04a6-4b3e-9f2d-a0fcf7fee2ef admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:36.494197 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc5aa9-4280-45c7-9782-c39706aca668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:36.494873 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc5aa9-4280-45c7-9782-c39706aca668 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:36.495212 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc5aa9-4280-45c7-9782-c39706aca668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:36.495830 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc5aa9-4280-45c7-9782-c39706aca668 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:36.496362 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc5aa9-4280-45c7-9782-c39706aca668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:36.498054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc5aa9-4280-45c7-9782-c39706aca668 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:36.508965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 994/1982] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:36.510365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc5aa9-4280-45c7-9782-c39706aca668 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:36.520546 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc5aa9-4280-45c7-9782-c39706aca668 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:36.532273 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65b198-be8e-41ac-9435-3ad1367be7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:36.533481 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65b198-be8e-41ac-9435-3ad1367be7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:36.534805 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65b198-be8e-41ac-9435-3ad1367be7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:36.535228 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65b198-be8e-41ac-9435-3ad1367be7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:36.536931 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65b198-be8e-41ac-9435-3ad1367be7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:36.542376 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a65b198-be8e-41ac-9435-3ad1367be7b7 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:36.552451 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-735be7d9-4fec-470a-91d4-390e10423290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff7e1d49d0b7417eb9995e9f91310af5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:36.553123 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-735be7d9-4fec-470a-91d4-390e10423290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff7e1d49d0b7417eb9995e9f91310af5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:36.553766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-735be7d9-4fec-470a-91d4-390e10423290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff7e1d49d0b7417eb9995e9f91310af5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:36.556339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 995/1983] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:36.557500 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65b198-be8e-41ac-9435-3ad1367be7b7 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:36.560426 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9a65b198-be8e-41ac-9435-3ad1367be7b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:36.572447 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-735be7d9-4fec-470a-91d4-390e10423290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff7e1d49d0b7417eb9995e9f91310af5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:36.576203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65b198-be8e-41ac-9435-3ad1367be7b7 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:36.581437 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218dd505-5df6-44c8-818e-f5de68b2f803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:36.582387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dd505-5df6-44c8-818e-f5de68b2f803 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:36.582696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dd505-5df6-44c8-818e-f5de68b2f803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:36.582966 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dd505-5df6-44c8-818e-f5de68b2f803 admin admin] PATH_INFO: `/v3/projects/934e6b14f4cc4fba9964e84782ed3610/users/10b62398614f406ebdef5b42bf9eeb7b/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:36.598492 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218dd505-5df6-44c8-818e-f5de68b2f803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=934e6b14f4cc4fba9964e84782ed3610, user_id=10b62398614f406ebdef5b42bf9eeb7b, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:36.603357 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218dd505-5df6-44c8-818e-f5de68b2f803 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:36.692467 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-735be7d9-4fec-470a-91d4-390e10423290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff7e1d49d0b7417eb9995e9f91310af5'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:36.706136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 989/1984] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:36 2022] DELETE /identity/v3/users/ff7e1d49d0b7417eb9995e9f91310af5 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:36.707079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735be7d9-4fec-470a-91d4-390e10423290 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:36.708495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-735be7d9-4fec-470a-91d4-390e10423290 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:36.734700 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 996/1985] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:36 2022] PUT /identity/v3/projects/934e6b14f4cc4fba9964e84782ed3610/users/10b62398614f406ebdef5b42bf9eeb7b/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:36.734700 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740245d-419e-4f37-84b0-4c57f57a1c8e None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:36.734700 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740245d-419e-4f37-84b0-4c57f57a1c8e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:36.734700 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d740245d-419e-4f37-84b0-4c57f57a1c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:36.752645 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:36.758467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-d740245d-419e-4f37-84b0-4c57f57a1c8e None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:36.760577 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d740245d-419e-4f37-84b0-4c57f57a1c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:36.776970 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735be7d9-4fec-470a-91d4-390e10423290 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:36.827651 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 997/1986] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:36.828998 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794889af-9222-45bb-8710-c661677db375 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:36.829279 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794889af-9222-45bb-8710-c661677db375 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:36.829562 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794889af-9222-45bb-8710-c661677db375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:36.844254 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126dc62-8b36-458f-a6e6-b3b81292acf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:36.844254 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126dc62-8b36-458f-a6e6-b3b81292acf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:36.844254 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126dc62-8b36-458f-a6e6-b3b81292acf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:36.845449 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126dc62-8b36-458f-a6e6-b3b81292acf8 admin admin] PATH_INFO: `/v3/projects/b551d6c560154139953b7615460ce8a7/users/7a2fe6894f9b49e9bf8caa20321abec0/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:36.850304 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126dc62-8b36-458f-a6e6-b3b81292acf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b551d6c560154139953b7615460ce8a7, user_id=7a2fe6894f9b49e9bf8caa20321abec0, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:36.853595 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e126dc62-8b36-458f-a6e6-b3b81292acf8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:36.868638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 990/1987] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:36 2022] PUT /identity/v3/projects/b551d6c560154139953b7615460ce8a7/users/7a2fe6894f9b49e9bf8caa20321abec0/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:36.874154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126dc62-8b36-458f-a6e6-b3b81292acf8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:36.874262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-794889af-9222-45bb-8710-c661677db375 None None] MFA Rules not processed for user `10b62398614f406ebdef5b42bf9eeb7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:36.874679 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e126dc62-8b36-458f-a6e6-b3b81292acf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:36.874758 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-794889af-9222-45bb-8710-c661677db375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:36.943228 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126dc62-8b36-458f-a6e6-b3b81292acf8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:36.952796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8e898-f708-438f-a60d-f3e4845b34ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:36.953671 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8e898-f708-438f-a60d-f3e4845b34ef service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:36.954104 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8e898-f708-438f-a60d-f3e4845b34ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:36.954477 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8e898-f708-438f-a60d-f3e4845b34ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:36.960997 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 998/1988] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:36.963011 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde9b92-5a9f-4182-b39d-d2658e51b8d3 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:36.963704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde9b92-5a9f-4182-b39d-d2658e51b8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:36.964009 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde9b92-5a9f-4182-b39d-d2658e51b8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:36.994495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-3bde9b92-5a9f-4182-b39d-d2658e51b8d3 None None] MFA Rules not processed for user `7a2fe6894f9b49e9bf8caa20321abec0`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:36.995723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3bde9b92-5a9f-4182-b39d-d2658e51b8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:37.030309 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8e898-f708-438f-a60d-f3e4845b34ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:37.031964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8e898-f708-438f-a60d-f3e4845b34ef service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:37.042853 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 991/1989] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:37.083477 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 999/1990] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:36 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:37.201928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8e898-f708-438f-a60d-f3e4845b34ef service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:37.203431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d1a8e898-f708-438f-a60d-f3e4845b34ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:37.270494 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8e898-f708-438f-a60d-f3e4845b34ef service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:37.277645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e232e3-5714-41d7-b3ff-094fb389daba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:37.278785 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e232e3-5714-41d7-b3ff-094fb389daba service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:37.279223 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e232e3-5714-41d7-b3ff-094fb389daba service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:37.279514 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e232e3-5714-41d7-b3ff-094fb389daba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:37.282344 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-41e232e3-5714-41d7-b3ff-094fb389daba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:37.369720 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e232e3-5714-41d7-b3ff-094fb389daba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:37.371609 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e232e3-5714-41d7-b3ff-094fb389daba service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:37.393415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 992/1991] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:37:37.640867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde9b92-5a9f-4182-b39d-d2658e51b8d3 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:37.642390 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3bde9b92-5a9f-4182-b39d-d2658e51b8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:37.660812 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bde9b92-5a9f-4182-b39d-d2658e51b8d3 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:37.664573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161b5ee-cc8e-4474-8082-13af9f8c05b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:37.666163 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161b5ee-cc8e-4474-8082-13af9f8c05b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:37.666452 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161b5ee-cc8e-4474-8082-13af9f8c05b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:37.670551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5161b5ee-cc8e-4474-8082-13af9f8c05b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:37.675855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161b5ee-cc8e-4474-8082-13af9f8c05b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:37.677298 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5161b5ee-cc8e-4474-8082-13af9f8c05b7 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:37.686932 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1000/1992] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:37 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:37.711466 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e232e3-5714-41d7-b3ff-094fb389daba service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:37.723942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161b5ee-cc8e-4474-8082-13af9f8c05b7 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:37.723942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5161b5ee-cc8e-4474-8082-13af9f8c05b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:37.724135 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e232e3-5714-41d7-b3ff-094fb389daba service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:37.730986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75deef36-c67a-40d2-9a03-fef025dbc854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:37.732285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deef36-c67a-40d2-9a03-fef025dbc854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:37.732625 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deef36-c67a-40d2-9a03-fef025dbc854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:37.733272 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deef36-c67a-40d2-9a03-fef025dbc854 admin admin] PATH_INFO: `/v3/users/10b62398614f406ebdef5b42bf9eeb7b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:37.734683 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75deef36-c67a-40d2-9a03-fef025dbc854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10b62398614f406ebdef5b42bf9eeb7b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:37.736187 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5161b5ee-cc8e-4474-8082-13af9f8c05b7 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:37.737105 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75deef36-c67a-40d2-9a03-fef025dbc854 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:37.740918 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a880f-644c-4e02-a259-d1fac16c787b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:37.742897 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a880f-644c-4e02-a259-d1fac16c787b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:37.743619 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a880f-644c-4e02-a259-d1fac16c787b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:37.744311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a880f-644c-4e02-a259-d1fac16c787b admin admin] PATH_INFO: `/v3/projects/acd3cba2ea0449678ccce172afacfc83` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:37.746331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a880f-644c-4e02-a259-d1fac16c787b admin admin] RBAC: Authorizing `identity:delete_project(project_id=acd3cba2ea0449678ccce172afacfc83)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:37.748812 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a880f-644c-4e02-a259-d1fac16c787b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:38.011911 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-75deef36-c67a-40d2-9a03-fef025dbc854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10b62398614f406ebdef5b42bf9eeb7b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:38.013563 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-75deef36-c67a-40d2-9a03-fef025dbc854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10b62398614f406ebdef5b42bf9eeb7b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:38.014345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-75deef36-c67a-40d2-9a03-fef025dbc854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10b62398614f406ebdef5b42bf9eeb7b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:38.016667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3a3a880f-644c-4e02-a259-d1fac16c787b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acd3cba2ea0449678ccce172afacfc83', 'request_id': 'req-3a3a880f-644c-4e02-a259-d1fac16c787b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:38.029992 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-75deef36-c67a-40d2-9a03-fef025dbc854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10b62398614f406ebdef5b42bf9eeb7b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:38.060903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3a3a880f-644c-4e02-a259-d1fac16c787b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acd3cba2ea0449678ccce172afacfc83', 'request_id': 'req-3a3a880f-644c-4e02-a259-d1fac16c787b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:38.071317 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3a3a880f-644c-4e02-a259-d1fac16c787b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acd3cba2ea0449678ccce172afacfc83', 'request_id': 'req-3a3a880f-644c-4e02-a259-d1fac16c787b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:38.134263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-75deef36-c67a-40d2-9a03-fef025dbc854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10b62398614f406ebdef5b42bf9eeb7b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:38.172990 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 993/1993] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:37 2022] DELETE /identity/v3/users/10b62398614f406ebdef5b42bf9eeb7b => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:38.189382 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0edba3-5726-474e-882d-676838091e86 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:38.189838 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0edba3-5726-474e-882d-676838091e86 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:38.190204 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0edba3-5726-474e-882d-676838091e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:38.213310 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-fa0edba3-5726-474e-882d-676838091e86 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:38.215005 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fa0edba3-5726-474e-882d-676838091e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:38.240822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3a3a880f-644c-4e02-a259-d1fac16c787b admin admin] The token cache is being invalidate because project acd3cba2ea0449678ccce172afacfc83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:38.241454 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3a3a880f-644c-4e02-a259-d1fac16c787b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:38.242534 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3a3a880f-644c-4e02-a259-d1fac16c787b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:38.244880 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1001/1994] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:37 2022] DELETE /identity/v3/projects/acd3cba2ea0449678ccce172afacfc83 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:38.250376 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a880f-644c-4e02-a259-d1fac16c787b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:38.251852 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3a3a880f-644c-4e02-a259-d1fac16c787b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:38.334237 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 994/1995] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:38.346303 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0edba3-5726-474e-882d-676838091e86 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:38.347844 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fa0edba3-5726-474e-882d-676838091e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:38.355881 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a880f-644c-4e02-a259-d1fac16c787b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:38.361177 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76e5da-18eb-496c-aac9-382509ee89d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:38.362644 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e5da-18eb-496c-aac9-382509ee89d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:38.362940 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e5da-18eb-496c-aac9-382509ee89d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:38.363222 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76e5da-18eb-496c-aac9-382509ee89d6 admin admin] PATH_INFO: `/v3/users/17b99c6ceb8342daaca682992125c123` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:38.364603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76e5da-18eb-496c-aac9-382509ee89d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b99c6ceb8342daaca682992125c123)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:38.366780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76e5da-18eb-496c-aac9-382509ee89d6 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:38.392232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:38.431705 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0edba3-5726-474e-882d-676838091e86 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:38.435321 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09606c9a-26ac-4d32-8be7-6b81f523e376 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:38.435976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09606c9a-26ac-4d32-8be7-6b81f523e376 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:38.436262 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09606c9a-26ac-4d32-8be7-6b81f523e376 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:38.436537 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09606c9a-26ac-4d32-8be7-6b81f523e376 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:38.447575 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09606c9a-26ac-4d32-8be7-6b81f523e376 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:38.449208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09606c9a-26ac-4d32-8be7-6b81f523e376 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:38.459280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 995/1996] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:38.651149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3c76e5da-18eb-496c-aac9-382509ee89d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b99c6ceb8342daaca682992125c123'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:38.652428 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3c76e5da-18eb-496c-aac9-382509ee89d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b99c6ceb8342daaca682992125c123'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:38.653167 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3c76e5da-18eb-496c-aac9-382509ee89d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b99c6ceb8342daaca682992125c123'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:38.665936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3c76e5da-18eb-496c-aac9-382509ee89d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b99c6ceb8342daaca682992125c123'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:38.674877 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3c76e5da-18eb-496c-aac9-382509ee89d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b99c6ceb8342daaca682992125c123'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:38.720176 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:38.804556 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1002/1997] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:38 2022] DELETE /identity/v3/users/17b99c6ceb8342daaca682992125c123 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:39.032451 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09606c9a-26ac-4d32-8be7-6b81f523e376 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:39.034745 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-09606c9a-26ac-4d32-8be7-6b81f523e376 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:39.072233 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09606c9a-26ac-4d32-8be7-6b81f523e376 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:39.164072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9847287-5667-4736-82a3-99f458680fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:39.165678 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9847287-5667-4736-82a3-99f458680fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:39.172616 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9847287-5667-4736-82a3-99f458680fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:39.172616 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9847287-5667-4736-82a3-99f458680fdd admin admin] PATH_INFO: `/v3/projects/934e6b14f4cc4fba9964e84782ed3610` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:39.172616 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9847287-5667-4736-82a3-99f458680fdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=934e6b14f4cc4fba9964e84782ed3610)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:39.172616 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9847287-5667-4736-82a3-99f458680fdd admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:39.429807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b9847287-5667-4736-82a3-99f458680fdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '934e6b14f4cc4fba9964e84782ed3610', 'request_id': 'req-b9847287-5667-4736-82a3-99f458680fdd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:39.436670 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b9847287-5667-4736-82a3-99f458680fdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '934e6b14f4cc4fba9964e84782ed3610', 'request_id': 'req-b9847287-5667-4736-82a3-99f458680fdd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:39.442945 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b9847287-5667-4736-82a3-99f458680fdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '934e6b14f4cc4fba9964e84782ed3610', 'request_id': 'req-b9847287-5667-4736-82a3-99f458680fdd'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:39.563591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b9847287-5667-4736-82a3-99f458680fdd admin admin] The token cache is being invalidate because project 934e6b14f4cc4fba9964e84782ed3610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:39.563886 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b9847287-5667-4736-82a3-99f458680fdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:39.564549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b9847287-5667-4736-82a3-99f458680fdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:39.566474 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 996/1998] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:39 2022] DELETE /identity/v3/projects/934e6b14f4cc4fba9964e84782ed3610 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:39.571904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6a265-5d42-4f3d-8f60-4075ec8b78cb None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:39.572460 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6a265-5d42-4f3d-8f60-4075ec8b78cb None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:39.572460 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6a265-5d42-4f3d-8f60-4075ec8b78cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:39.590631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-48d6a265-5d42-4f3d-8f60-4075ec8b78cb None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:39.591861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-48d6a265-5d42-4f3d-8f60-4075ec8b78cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:39.654977 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1003/1999] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:39.663169 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090327d7-f03a-44a7-9494-e0048df18aac None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:39.663586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090327d7-f03a-44a7-9494-e0048df18aac None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:39.663948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090327d7-f03a-44a7-9494-e0048df18aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:39.686556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-090327d7-f03a-44a7-9494-e0048df18aac None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:39.689137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-090327d7-f03a-44a7-9494-e0048df18aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:39.712595 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 997/2000] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:37:39.717404 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6a265-5d42-4f3d-8f60-4075ec8b78cb None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:39.728572 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6a265-5d42-4f3d-8f60-4075ec8b78cb None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:39.733619 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe540e-4f4f-46b1-8491-8e7a5b96ba4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:39.734584 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe540e-4f4f-46b1-8491-8e7a5b96ba4b admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:39.735069 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe540e-4f4f-46b1-8491-8e7a5b96ba4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:39.735491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe540e-4f4f-46b1-8491-8e7a5b96ba4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:39.736224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe540e-4f4f-46b1-8491-8e7a5b96ba4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:37:39.736565 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe540e-4f4f-46b1-8491-8e7a5b96ba4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:39.738203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe540e-4f4f-46b1-8491-8e7a5b96ba4b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:39.756539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1004/2001] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:37:39.758897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090327d7-f03a-44a7-9494-e0048df18aac None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:39.770806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090327d7-f03a-44a7-9494-e0048df18aac None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:39.776648 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e536d0-1c25-4444-9486-70e9b48608c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:39.777396 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e536d0-1c25-4444-9486-70e9b48608c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:39.777688 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e536d0-1c25-4444-9486-70e9b48608c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:39.778074 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e536d0-1c25-4444-9486-70e9b48608c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:39.778859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e536d0-1c25-4444-9486-70e9b48608c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:39.780780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e536d0-1c25-4444-9486-70e9b48608c7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:39.978394 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 998/2002] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:39 2022] POST /identity/v3/projects => generated 375 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:39.980019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe540e-4f4f-46b1-8491-8e7a5b96ba4b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:39.997088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe540e-4f4f-46b1-8491-8e7a5b96ba4b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:40.074370 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b0914-a4f7-4db1-a1cb-f0efbff9fc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:40.075064 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b0914-a4f7-4db1-a1cb-f0efbff9fc49 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:40.075354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b0914-a4f7-4db1-a1cb-f0efbff9fc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:40.075649 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b0914-a4f7-4db1-a1cb-f0efbff9fc49 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:40.076369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b0914-a4f7-4db1-a1cb-f0efbff9fc49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:40.078589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b0914-a4f7-4db1-a1cb-f0efbff9fc49 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:40.174013 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e536d0-1c25-4444-9486-70e9b48608c7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:40.174013 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e6e536d0-1c25-4444-9486-70e9b48608c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:40.197691 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e536d0-1c25-4444-9486-70e9b48608c7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:40.207880 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd24537-ffa4-4ca9-9466-69c2c72d9f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:40.208815 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd24537-ffa4-4ca9-9466-69c2c72d9f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:40.209097 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd24537-ffa4-4ca9-9466-69c2c72d9f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:40.209383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd24537-ffa4-4ca9-9466-69c2c72d9f79 admin admin] PATH_INFO: `/v3/projects/86c89000d6504fc7939c2d1df19cfdf9` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:40.210672 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd24537-ffa4-4ca9-9466-69c2c72d9f79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86c89000d6504fc7939c2d1df19cfdf9)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:40.213344 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd24537-ffa4-4ca9-9466-69c2c72d9f79 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:40.236213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1005/2003] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:39 2022] POST /identity/v3/users => generated 288 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:40.237216 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b0914-a4f7-4db1-a1cb-f0efbff9fc49 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:40.252276 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b0914-a4f7-4db1-a1cb-f0efbff9fc49 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:40.266691 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707bf5f-cb21-4b1a-a192-6ee16d68a32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:40.267862 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707bf5f-cb21-4b1a-a192-6ee16d68a32a admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:40.267862 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707bf5f-cb21-4b1a-a192-6ee16d68a32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:40.268209 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707bf5f-cb21-4b1a-a192-6ee16d68a32a admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:40.269084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707bf5f-cb21-4b1a-a192-6ee16d68a32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:40.270769 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707bf5f-cb21-4b1a-a192-6ee16d68a32a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:40.285298 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1006/2004] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:37:40.287342 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707bf5f-cb21-4b1a-a192-6ee16d68a32a admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:40.301623 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707bf5f-cb21-4b1a-a192-6ee16d68a32a admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:40.310778 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c02a7-cbe4-4b9d-9301-ae2ef5dc08c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:40.311622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c02a7-cbe4-4b9d-9301-ae2ef5dc08c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:40.311856 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c02a7-cbe4-4b9d-9301-ae2ef5dc08c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:40.312113 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c02a7-cbe4-4b9d-9301-ae2ef5dc08c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:40.312856 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c02a7-cbe4-4b9d-9301-ae2ef5dc08c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:40.314540 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c02a7-cbe4-4b9d-9301-ae2ef5dc08c3 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:40.337188 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1007/2005] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:37:40.338126 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c02a7-cbe4-4b9d-9301-ae2ef5dc08c3 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:40.347846 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6bd24537-ffa4-4ca9-9466-69c2c72d9f79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86c89000d6504fc7939c2d1df19cfdf9', 'request_id': 'req-6bd24537-ffa4-4ca9-9466-69c2c72d9f79'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:40.354037 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c02a7-cbe4-4b9d-9301-ae2ef5dc08c3 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:40.355142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6bd24537-ffa4-4ca9-9466-69c2c72d9f79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86c89000d6504fc7939c2d1df19cfdf9', 'request_id': 'req-6bd24537-ffa4-4ca9-9466-69c2c72d9f79'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:40.362594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6bd24537-ffa4-4ca9-9466-69c2c72d9f79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86c89000d6504fc7939c2d1df19cfdf9', 'request_id': 'req-6bd24537-ffa4-4ca9-9466-69c2c72d9f79'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:40.424159 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fa83ea-961d-4dfc-aafc-472d62cf5a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:40.425228 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa83ea-961d-4dfc-aafc-472d62cf5a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:40.425620 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa83ea-961d-4dfc-aafc-472d62cf5a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:40.426155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fa83ea-961d-4dfc-aafc-472d62cf5a7b admin admin] PATH_INFO: `/v3/projects/d967901f812b445696c811906b902d93/users/8da274f8aac44eb08426475da389f65d/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:40.445262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa83ea-961d-4dfc-aafc-472d62cf5a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d967901f812b445696c811906b902d93, user_id=8da274f8aac44eb08426475da389f65d, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:40.448759 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fa83ea-961d-4dfc-aafc-472d62cf5a7b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:40.474920 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6bd24537-ffa4-4ca9-9466-69c2c72d9f79 admin admin] The token cache is being invalidate because project 86c89000d6504fc7939c2d1df19cfdf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:40.475216 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6bd24537-ffa4-4ca9-9466-69c2c72d9f79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:40.476059 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6bd24537-ffa4-4ca9-9466-69c2c72d9f79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:40.479936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 999/2006] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:40 2022] DELETE /identity/v3/projects/86c89000d6504fc7939c2d1df19cfdf9 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:37:40.483364 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b2644-c4a4-4418-a5d6-9b2e80b5d261 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:40.483657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b2644-c4a4-4418-a5d6-9b2e80b5d261 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:40.483934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b2644-c4a4-4418-a5d6-9b2e80b5d261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:40.504443 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-897b2644-c4a4-4418-a5d6-9b2e80b5d261 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:40.506593 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-897b2644-c4a4-4418-a5d6-9b2e80b5d261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:40.517687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1000/2007] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:37:40.522473 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13002bff-032e-41f3-b366-a3ea88db99bc None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:40.522867 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13002bff-032e-41f3-b366-a3ea88db99bc None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:40.523536 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13002bff-032e-41f3-b366-a3ea88db99bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:40.544007 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-13002bff-032e-41f3-b366-a3ea88db99bc None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:40.545122 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-13002bff-032e-41f3-b366-a3ea88db99bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:40.554302 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1001/2008] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:40.559216 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13002bff-032e-41f3-b366-a3ea88db99bc None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:40.574515 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1008/2009] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:40 2022] PUT /identity/v3/projects/d967901f812b445696c811906b902d93/users/8da274f8aac44eb08426475da389f65d/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:40.579121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13002bff-032e-41f3-b366-a3ea88db99bc None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:40.586662 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4efbb-87bd-4c65-bd45-7988f0ae453f None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:40.588340 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4efbb-87bd-4c65-bd45-7988f0ae453f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:40.589315 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4efbb-87bd-4c65-bd45-7988f0ae453f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:40.621761 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-5cd4efbb-87bd-4c65-bd45-7988f0ae453f None None] MFA Rules not processed for user `8da274f8aac44eb08426475da389f65d`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:40.623791 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5cd4efbb-87bd-4c65-bd45-7988f0ae453f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:40.644555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c268a49-8a4a-4439-b0af-fcda24f9a0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:40.645360 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c268a49-8a4a-4439-b0af-fcda24f9a0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:40.645658 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c268a49-8a4a-4439-b0af-fcda24f9a0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:40.645967 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c268a49-8a4a-4439-b0af-fcda24f9a0d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:40.646698 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c268a49-8a4a-4439-b0af-fcda24f9a0d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:37:40.647008 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c268a49-8a4a-4439-b0af-fcda24f9a0d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:40.649257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c268a49-8a4a-4439-b0af-fcda24f9a0d4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:40.664299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1002/2010] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:37:40.669833 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c268a49-8a4a-4439-b0af-fcda24f9a0d4 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:40.682650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c268a49-8a4a-4439-b0af-fcda24f9a0d4 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:40.687922 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45219c9f-8232-4892-b089-f778d7b7beed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:40.688593 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45219c9f-8232-4892-b089-f778d7b7beed admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:40.689442 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45219c9f-8232-4892-b089-f778d7b7beed admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:40.689442 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45219c9f-8232-4892-b089-f778d7b7beed admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:40.690014 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45219c9f-8232-4892-b089-f778d7b7beed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:40.692305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45219c9f-8232-4892-b089-f778d7b7beed admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:40.698861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1009/2011] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:40.702928 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4efbb-87bd-4c65-bd45-7988f0ae453f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:40.704434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5cd4efbb-87bd-4c65-bd45-7988f0ae453f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:40.718938 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4efbb-87bd-4c65-bd45-7988f0ae453f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:40.723855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e68525-c0c7-4fc9-a34c-9892ec47dd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:40.724520 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e68525-c0c7-4fc9-a34c-9892ec47dd31 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:40.724809 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e68525-c0c7-4fc9-a34c-9892ec47dd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:40.725087 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e68525-c0c7-4fc9-a34c-9892ec47dd31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:40.725809 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e68525-c0c7-4fc9-a34c-9892ec47dd31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:40.729748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e68525-c0c7-4fc9-a34c-9892ec47dd31 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:40.841552 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1003/2012] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:40 2022] POST /identity/v3/projects => generated 369 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:40.846075 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45219c9f-8232-4892-b089-f778d7b7beed admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:40.860012 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:40.871207 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1010/2013] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:40 2022] POST /identity/v3/projects => generated 375 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:40.871207 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9035013-d4a8-4ae5-802f-150c43be7e5c None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:40.871207 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9035013-d4a8-4ae5-802f-150c43be7e5c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:40.871207 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9035013-d4a8-4ae5-802f-150c43be7e5c None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:40.875513 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1011/2014] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jul 18 02:37:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:37:40.876316 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9035013-d4a8-4ae5-802f-150c43be7e5c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:40.940676 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45219c9f-8232-4892-b089-f778d7b7beed admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:40.962525 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9035013-d4a8-4ae5-802f-150c43be7e5c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:40.967786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bbbf3f-edd2-47ec-bffb-b43affbd9239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:40.968476 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbbf3f-edd2-47ec-bffb-b43affbd9239 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:40.968761 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbbf3f-edd2-47ec-bffb-b43affbd9239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:40.969123 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bbbf3f-edd2-47ec-bffb-b43affbd9239 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:40.969828 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbbf3f-edd2-47ec-bffb-b43affbd9239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:40.972628 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bbbf3f-edd2-47ec-bffb-b43affbd9239 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:41.007313 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04105e8f-58fe-40c2-916c-203d51297496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:41.008166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04105e8f-58fe-40c2-916c-203d51297496 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:41.008486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04105e8f-58fe-40c2-916c-203d51297496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:41.008770 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04105e8f-58fe-40c2-916c-203d51297496 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:41.021456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04105e8f-58fe-40c2-916c-203d51297496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:41.021456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04105e8f-58fe-40c2-916c-203d51297496 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:41.162179 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1012/2015] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:40 2022] POST /identity/v3/users => generated 288 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:41.163525 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cd6d1-f37b-4600-9412-9a89099a8cf5 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:41.163979 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cd6d1-f37b-4600-9412-9a89099a8cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:41.164175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077cd6d1-f37b-4600-9412-9a89099a8cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:41.192755 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-077cd6d1-f37b-4600-9412-9a89099a8cf5 None None] MFA Rules not processed for user `6f51aae36f0b42868567840fa957ffe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:41.194255 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-077cd6d1-f37b-4600-9412-9a89099a8cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:41.198728 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1004/2016] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:40 2022] POST /identity/v3/users => generated 285 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:41.207358 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04105e8f-58fe-40c2-916c-203d51297496 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:41.227770 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04105e8f-58fe-40c2-916c-203d51297496 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:41.234970 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fe90e-290e-477c-81ff-1ad709b6c327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:41.237004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fe90e-290e-477c-81ff-1ad709b6c327 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:41.237583 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fe90e-290e-477c-81ff-1ad709b6c327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:41.238351 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fe90e-290e-477c-81ff-1ad709b6c327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:41.239164 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fe90e-290e-477c-81ff-1ad709b6c327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:41.241621 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fe90e-290e-477c-81ff-1ad709b6c327 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:41.258877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1005/2017] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:41.260196 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fe90e-290e-477c-81ff-1ad709b6c327 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:41.277818 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fe90e-290e-477c-81ff-1ad709b6c327 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:41.282955 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596834d-4d14-4825-9908-0e2614a3f3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:41.283697 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596834d-4d14-4825-9908-0e2614a3f3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:41.283989 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596834d-4d14-4825-9908-0e2614a3f3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:41.284327 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596834d-4d14-4825-9908-0e2614a3f3c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:41.285093 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596834d-4d14-4825-9908-0e2614a3f3c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:41.286817 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7596834d-4d14-4825-9908-0e2614a3f3c8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:41.299988 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1013/2018] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jul 18 02:37:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:41.300445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1006/2019] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:41.304089 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cd6d1-f37b-4600-9412-9a89099a8cf5 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:41.304277 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596834d-4d14-4825-9908-0e2614a3f3c8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:41.316631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077cd6d1-f37b-4600-9412-9a89099a8cf5 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:41.316964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596834d-4d14-4825-9908-0e2614a3f3c8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:41.322176 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1f9be-8d01-428f-9179-c92161a60f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:41.323090 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1f9be-8d01-428f-9179-c92161a60f16 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:41.323370 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c2600-20b1-46c2-b733-a190f0992c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:41.323531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1f9be-8d01-428f-9179-c92161a60f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:41.323678 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1f9be-8d01-428f-9179-c92161a60f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:41.324572 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c2600-20b1-46c2-b733-a190f0992c81 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:41.324697 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1f9be-8d01-428f-9179-c92161a60f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:41.324788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c2600-20b1-46c2-b733-a190f0992c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:41.325049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c2600-20b1-46c2-b733-a190f0992c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:41.326135 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c2600-20b1-46c2-b733-a190f0992c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:41.326349 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1f9be-8d01-428f-9179-c92161a60f16 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:41.327780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c2600-20b1-46c2-b733-a190f0992c81 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:41.337450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1007/2020] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:41.338433 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1f9be-8d01-428f-9179-c92161a60f16 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:41.340542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-85b1f9be-8d01-428f-9179-c92161a60f16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:41.346242 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1014/2021] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:41.347121 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c2600-20b1-46c2-b733-a190f0992c81 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:41.358980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1f9be-8d01-428f-9179-c92161a60f16 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:41.359186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c2600-20b1-46c2-b733-a190f0992c81 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:41.364111 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3197fc-2b50-4748-b1e1-8e7f6892b4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:41.365021 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba64645-53fc-4314-a480-8060e3ae3f96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:41.365146 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3197fc-2b50-4748-b1e1-8e7f6892b4c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:41.365310 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3197fc-2b50-4748-b1e1-8e7f6892b4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:41.365596 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3197fc-2b50-4748-b1e1-8e7f6892b4c5 admin admin] PATH_INFO: `/v3/projects/ffee48171c684efda63cad0c4d58fd7e/users/f7bd885124494876bc32b3bcfb888932/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:41.365793 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba64645-53fc-4314-a480-8060e3ae3f96 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:41.366228 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba64645-53fc-4314-a480-8060e3ae3f96 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:41.366447 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba64645-53fc-4314-a480-8060e3ae3f96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:41.376497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba64645-53fc-4314-a480-8060e3ae3f96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:41.378137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba64645-53fc-4314-a480-8060e3ae3f96 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:41.382382 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3197fc-2b50-4748-b1e1-8e7f6892b4c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffee48171c684efda63cad0c4d58fd7e, user_id=f7bd885124494876bc32b3bcfb888932, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:41.385194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3197fc-2b50-4748-b1e1-8e7f6892b4c5 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:41.393352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1008/2022] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:41.394940 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba64645-53fc-4314-a480-8060e3ae3f96 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:41.408863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:41.410489 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba64645-53fc-4314-a480-8060e3ae3f96 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:41.421031 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f390a20-40b1-48f9-9f6c-8cb08bb82e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:41.422952 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f390a20-40b1-48f9-9f6c-8cb08bb82e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:41.423249 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f390a20-40b1-48f9-9f6c-8cb08bb82e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:41.423693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f390a20-40b1-48f9-9f6c-8cb08bb82e6b admin admin] PATH_INFO: `/v3/projects/43fea9e74900432babcb4e7ea07d6c13/users/a3e1aa6c219c447e9a17f3d3ba4a4fe1/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:41.442671 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f390a20-40b1-48f9-9f6c-8cb08bb82e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=43fea9e74900432babcb4e7ea07d6c13, user_id=a3e1aa6c219c447e9a17f3d3ba4a4fe1, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:41.446110 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f390a20-40b1-48f9-9f6c-8cb08bb82e6b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:41.469974 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1015/2023] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:41 2022] PUT /identity/v3/projects/ffee48171c684efda63cad0c4d58fd7e/users/f7bd885124494876bc32b3bcfb888932/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:41.480929 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326e68c-b585-491d-8458-24478fc85e6b None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:41.481196 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326e68c-b585-491d-8458-24478fc85e6b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:41.482144 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3326e68c-b585-491d-8458-24478fc85e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:41.511471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-3326e68c-b585-491d-8458-24478fc85e6b None None] MFA Rules not processed for user `f7bd885124494876bc32b3bcfb888932`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:41.512693 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3326e68c-b585-491d-8458-24478fc85e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:41.579581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1016/2024] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:37:41.584269 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326e68c-b585-491d-8458-24478fc85e6b None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:41.589449 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1009/2025] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:41 2022] PUT /identity/v3/projects/43fea9e74900432babcb4e7ea07d6c13/users/a3e1aa6c219c447e9a17f3d3ba4a4fe1/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:41.600819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf15e2-d23a-4fc9-b396-536d0d42343a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:41.601385 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf15e2-d23a-4fc9-b396-536d0d42343a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:41.601671 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaf15e2-d23a-4fc9-b396-536d0d42343a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:41.640503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-eaaf15e2-d23a-4fc9-b396-536d0d42343a None None] MFA Rules not processed for user `a3e1aa6c219c447e9a17f3d3ba4a4fe1`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:41.642875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-eaaf15e2-d23a-4fc9-b396-536d0d42343a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:41.692475 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3326e68c-b585-491d-8458-24478fc85e6b None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:41.753582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1010/2026] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:37:41.758212 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf15e2-d23a-4fc9-b396-536d0d42343a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:41.777857 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8e817-ee75-4802-a5e9-be5023666149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:41.779153 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8e817-ee75-4802-a5e9-be5023666149 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:41.779440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8e817-ee75-4802-a5e9-be5023666149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:41.779717 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8e817-ee75-4802-a5e9-be5023666149 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:41.780445 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8e817-ee75-4802-a5e9-be5023666149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:41.782652 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8e817-ee75-4802-a5e9-be5023666149 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:41.834967 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaf15e2-d23a-4fc9-b396-536d0d42343a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:41.840500 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b743e7-8352-4749-9929-3dbeaae879de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:41.841323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b743e7-8352-4749-9929-3dbeaae879de admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:41.841623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b743e7-8352-4749-9929-3dbeaae879de admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:41.841977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b743e7-8352-4749-9929-3dbeaae879de admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:41.842717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b743e7-8352-4749-9929-3dbeaae879de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:41.847872 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b743e7-8352-4749-9929-3dbeaae879de admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:41.864262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:41.939526 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1017/2027] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:41 2022] POST /identity/v3/projects => generated 367 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:41.944390 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8e817-ee75-4802-a5e9-be5023666149 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:42.011814 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1011/2028] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:41 2022] POST /identity/v3/projects => generated 377 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:37:42.015973 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b743e7-8352-4749-9929-3dbeaae879de admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:42.032109 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8e817-ee75-4802-a5e9-be5023666149 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:42.134922 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5768220-a73e-41ba-bfdc-ad782d244d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:42.135777 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5768220-a73e-41ba-bfdc-ad782d244d52 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:42.136068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5768220-a73e-41ba-bfdc-ad782d244d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:42.151735 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5768220-a73e-41ba-bfdc-ad782d244d52 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:42.152624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5768220-a73e-41ba-bfdc-ad782d244d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:42.165439 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b743e7-8352-4749-9929-3dbeaae879de admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:42.165923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5768220-a73e-41ba-bfdc-ad782d244d52 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:42.171795 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847dd6f-e154-4828-8bf9-014e62729352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:42.172614 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847dd6f-e154-4828-8bf9-014e62729352 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:42.173006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847dd6f-e154-4828-8bf9-014e62729352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:42.173360 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847dd6f-e154-4828-8bf9-014e62729352 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:42.174231 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847dd6f-e154-4828-8bf9-014e62729352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:42.176643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847dd6f-e154-4828-8bf9-014e62729352 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:42.284470 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1012/2029] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:42 2022] POST /identity/v3/users => generated 295 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:37:42.290125 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847dd6f-e154-4828-8bf9-014e62729352 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:42.297081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1018/2030] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:41 2022] POST /identity/v3/users => generated 290 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:37:42.297081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5768220-a73e-41ba-bfdc-ad782d244d52 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:42.298259 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1847dd6f-e154-4828-8bf9-014e62729352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:42.300691 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d5768220-a73e-41ba-bfdc-ad782d244d52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:42.327380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847dd6f-e154-4828-8bf9-014e62729352 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:42.345163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25c71d-0203-4dcc-bfff-a3ca73414e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:42.346097 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25c71d-0203-4dcc-bfff-a3ca73414e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:42.346388 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25c71d-0203-4dcc-bfff-a3ca73414e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:42.346663 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c25c71d-0203-4dcc-bfff-a3ca73414e8c admin admin] PATH_INFO: `/v3/users/62c6d4ae2d154b7f8c98aa9486ffc58f` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:42.349068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25c71d-0203-4dcc-bfff-a3ca73414e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=62c6d4ae2d154b7f8c98aa9486ffc58f)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:42.351376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c25c71d-0203-4dcc-bfff-a3ca73414e8c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:42.392354 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:42.448811 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5768220-a73e-41ba-bfdc-ad782d244d52 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:42.453464 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f9209-fef3-46ab-9b15-411c529dd0db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:42.454205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f9209-fef3-46ab-9b15-411c529dd0db service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:42.454499 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f9209-fef3-46ab-9b15-411c529dd0db service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:42.454923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54f9209-fef3-46ab-9b15-411c529dd0db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:42.458507 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e54f9209-fef3-46ab-9b15-411c529dd0db service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:42.538063 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f9209-fef3-46ab-9b15-411c529dd0db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:42.539488 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54f9209-fef3-46ab-9b15-411c529dd0db service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:42.550199 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1019/2031] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:42.550413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f9209-fef3-46ab-9b15-411c529dd0db service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:42.561367 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54f9209-fef3-46ab-9b15-411c529dd0db service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:42.568067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a6485-4217-465f-a691-6528a797a862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:42.568764 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a6485-4217-465f-a691-6528a797a862 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:42.569056 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a6485-4217-465f-a691-6528a797a862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:42.569428 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a6485-4217-465f-a691-6528a797a862 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:42.570207 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a6485-4217-465f-a691-6528a797a862 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:42.571897 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a6485-4217-465f-a691-6528a797a862 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:42.583678 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1020/2032] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:42.584590 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a6485-4217-465f-a691-6528a797a862 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:42.595469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a6485-4217-465f-a691-6528a797a862 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:42.601586 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb3ce6-0bb0-4152-b590-1e405273f1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:42.602887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb3ce6-0bb0-4152-b590-1e405273f1ef admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:42.603153 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb3ce6-0bb0-4152-b590-1e405273f1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:42.603440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb3ce6-0bb0-4152-b590-1e405273f1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:42.604171 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb3ce6-0bb0-4152-b590-1e405273f1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:42.605941 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb3ce6-0bb0-4152-b590-1e405273f1ef admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:42.621139 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1021/2033] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:42.621139 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb3ce6-0bb0-4152-b590-1e405273f1ef admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:42.622505 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-dbeb3ce6-0bb0-4152-b590-1e405273f1ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:42.636184 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb3ce6-0bb0-4152-b590-1e405273f1ef admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:42.640773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3aa85-7349-478c-adc4-b0dcfa482db9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:42.641534 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3aa85-7349-478c-adc4-b0dcfa482db9 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:42.641947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3aa85-7349-478c-adc4-b0dcfa482db9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:42.642296 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3aa85-7349-478c-adc4-b0dcfa482db9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:42.644271 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-22d3aa85-7349-478c-adc4-b0dcfa482db9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:42.705780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3aa85-7349-478c-adc4-b0dcfa482db9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:42.707292 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3aa85-7349-478c-adc4-b0dcfa482db9 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:42.716888 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1022/2034] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:42.717937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3aa85-7349-478c-adc4-b0dcfa482db9 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:42.729032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5c25c71d-0203-4dcc-bfff-a3ca73414e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62c6d4ae2d154b7f8c98aa9486ffc58f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:42.729479 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3aa85-7349-478c-adc4-b0dcfa482db9 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:42.730477 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5c25c71d-0203-4dcc-bfff-a3ca73414e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62c6d4ae2d154b7f8c98aa9486ffc58f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:42.732322 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5c25c71d-0203-4dcc-bfff-a3ca73414e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62c6d4ae2d154b7f8c98aa9486ffc58f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:42.736209 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0b4f4-5ec7-4353-9a03-b85a457d8827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:42.737242 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0b4f4-5ec7-4353-9a03-b85a457d8827 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:42.737607 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0b4f4-5ec7-4353-9a03-b85a457d8827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:42.737988 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0b4f4-5ec7-4353-9a03-b85a457d8827 admin admin] PATH_INFO: `/v3/projects/419da1d2da5a4f3cbe89cbb256b176db/users/b22f611211dc485eb13d856ddb93e105/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:42.749330 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5c25c71d-0203-4dcc-bfff-a3ca73414e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62c6d4ae2d154b7f8c98aa9486ffc58f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:42.757058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0b4f4-5ec7-4353-9a03-b85a457d8827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=419da1d2da5a4f3cbe89cbb256b176db, user_id=b22f611211dc485eb13d856ddb93e105, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:42.760278 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0b4f4-5ec7-4353-9a03-b85a457d8827 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:42.864081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5c25c71d-0203-4dcc-bfff-a3ca73414e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62c6d4ae2d154b7f8c98aa9486ffc58f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:42.875639 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1023/2035] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:42 2022] PUT /identity/v3/projects/419da1d2da5a4f3cbe89cbb256b176db/users/b22f611211dc485eb13d856ddb93e105/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:42.876422 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0b4f4-5ec7-4353-9a03-b85a457d8827 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:42.882418 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-41e0b4f4-5ec7-4353-9a03-b85a457d8827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:42.889040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1013/2036] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:42 2022] DELETE /identity/v3/users/62c6d4ae2d154b7f8c98aa9486ffc58f => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:42.890971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25c71d-0203-4dcc-bfff-a3ca73414e8c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:42.893036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5c25c71d-0203-4dcc-bfff-a3ca73414e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:42.972786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0b4f4-5ec7-4353-9a03-b85a457d8827 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:42.993925 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c25c71d-0203-4dcc-bfff-a3ca73414e8c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:43.000977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd953caf-c118-40ac-acbe-2ffeaf3d6999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:43.002372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd953caf-c118-40ac-acbe-2ffeaf3d6999 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:43.008990 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd953caf-c118-40ac-acbe-2ffeaf3d6999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:43.008990 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd953caf-c118-40ac-acbe-2ffeaf3d6999 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:43.008990 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd953caf-c118-40ac-acbe-2ffeaf3d6999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:43.008990 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd953caf-c118-40ac-acbe-2ffeaf3d6999 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:43.024474 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1014/2037] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:43.026036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c2c9a-70aa-42e2-8430-3203cfab1c43 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:43.026153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c2c9a-70aa-42e2-8430-3203cfab1c43 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:43.026423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c2c9a-70aa-42e2-8430-3203cfab1c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:43.048828 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c02c2c9a-70aa-42e2-8430-3203cfab1c43 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:43.052214 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c02c2c9a-70aa-42e2-8430-3203cfab1c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:43.052690 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8decf64e-ead3-47a6-b114-7dc30925a463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:43.054157 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decf64e-ead3-47a6-b114-7dc30925a463 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:43.054567 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decf64e-ead3-47a6-b114-7dc30925a463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:43.055549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8decf64e-ead3-47a6-b114-7dc30925a463 admin admin] PATH_INFO: `/v3/projects/4189acc131624dca89250ded2b9a7061/users/bb81a044a856404aa49004bd28369942/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:43.062907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1015/2038] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:43.063818 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c2c9a-70aa-42e2-8430-3203cfab1c43 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:43.084170 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c2c9a-70aa-42e2-8430-3203cfab1c43 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:43.084760 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decf64e-ead3-47a6-b114-7dc30925a463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4189acc131624dca89250ded2b9a7061, user_id=bb81a044a856404aa49004bd28369942, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:43.089059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8decf64e-ead3-47a6-b114-7dc30925a463 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:43.096594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ee4d4-801c-4487-b515-100e2bd321f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:43.099413 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ee4d4-801c-4487-b515-100e2bd321f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:43.099413 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ee4d4-801c-4487-b515-100e2bd321f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:43.099413 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ee4d4-801c-4487-b515-100e2bd321f0 admin admin] PATH_INFO: `/v3/projects/419da1d2da5a4f3cbe89cbb256b176db/users/b22f611211dc485eb13d856ddb93e105/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:43.101229 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ee4d4-801c-4487-b515-100e2bd321f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=419da1d2da5a4f3cbe89cbb256b176db, user_id=b22f611211dc485eb13d856ddb93e105, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:43.104431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1ee4d4-801c-4487-b515-100e2bd321f0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:43.126700 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1016/2039] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:43 2022] PUT /identity/v3/projects/419da1d2da5a4f3cbe89cbb256b176db/users/b22f611211dc485eb13d856ddb93e105/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:43.126700 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ee4d4-801c-4487-b515-100e2bd321f0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:43.126700 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3c1ee4d4-801c-4487-b515-100e2bd321f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:43.210816 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ee4d4-801c-4487-b515-100e2bd321f0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:43.218827 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1024/2040] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:42 2022] PUT /identity/v3/projects/4189acc131624dca89250ded2b9a7061/users/bb81a044a856404aa49004bd28369942/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:43.221425 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfc76c-02a3-410f-aece-7af9493190dd None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:43.222006 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfc76c-02a3-410f-aece-7af9493190dd None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:43.222642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cfc76c-02a3-410f-aece-7af9493190dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:43.282826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-e1cfc76c-02a3-410f-aece-7af9493190dd None None] MFA Rules not processed for user `b22f611211dc485eb13d856ddb93e105`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:43.284800 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e1cfc76c-02a3-410f-aece-7af9493190dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:43.305745 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c94e58-c149-474e-8792-3017df4f7a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:43.307059 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c94e58-c149-474e-8792-3017df4f7a73 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:43.307569 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c94e58-c149-474e-8792-3017df4f7a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:43.308042 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c94e58-c149-474e-8792-3017df4f7a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:43.416397 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1025/2041] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:43.417075 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfc76c-02a3-410f-aece-7af9493190dd None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:43.438044 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c94e58-c149-474e-8792-3017df4f7a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:43.440034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c94e58-c149-474e-8792-3017df4f7a73 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:43.453230 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1017/2042] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:43.491279 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cfc76c-02a3-410f-aece-7af9493190dd None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:43.502298 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01572f2f-c429-478c-b158-023256768328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:43.503216 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01572f2f-c429-478c-b158-023256768328 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:43.504030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01572f2f-c429-478c-b158-023256768328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:43.504401 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01572f2f-c429-478c-b158-023256768328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:43.505116 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01572f2f-c429-478c-b158-023256768328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:43.506869 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01572f2f-c429-478c-b158-023256768328 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:43.528565 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1026/2043] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:43.532948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c94e58-c149-474e-8792-3017df4f7a73 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:43.548917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c94e58-c149-474e-8792-3017df4f7a73 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:43.555136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5afd8-55e9-48b7-b909-9a67c8b353b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:43.556356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5afd8-55e9-48b7-b909-9a67c8b353b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:43.556789 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5afd8-55e9-48b7-b909-9a67c8b353b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:43.557340 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5afd8-55e9-48b7-b909-9a67c8b353b2 admin admin] PATH_INFO: `/v3/projects/4189acc131624dca89250ded2b9a7061/users/bb81a044a856404aa49004bd28369942/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:43.559612 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5afd8-55e9-48b7-b909-9a67c8b353b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4189acc131624dca89250ded2b9a7061, user_id=bb81a044a856404aa49004bd28369942, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:43.562844 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5afd8-55e9-48b7-b909-9a67c8b353b2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:43.575825 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1018/2044] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:43 2022] PUT /identity/v3/projects/4189acc131624dca89250ded2b9a7061/users/bb81a044a856404aa49004bd28369942/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:43.587610 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbab51-49ac-4d7d-bfc2-215d2a737645 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:43.593526 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbab51-49ac-4d7d-bfc2-215d2a737645 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:43.593526 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbab51-49ac-4d7d-bfc2-215d2a737645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:43.617738 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-3acbab51-49ac-4d7d-bfc2-215d2a737645 None None] MFA Rules not processed for user `bb81a044a856404aa49004bd28369942`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:43.619251 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3acbab51-49ac-4d7d-bfc2-215d2a737645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:43.715441 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1027/2045] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:43 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:43.805911 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5afd8-55e9-48b7-b909-9a67c8b353b2 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:43.807731 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-26b5afd8-55e9-48b7-b909-9a67c8b353b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:43.921949 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5afd8-55e9-48b7-b909-9a67c8b353b2 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:43.926022 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf70297-e98b-488c-9e10-3fec22d4a9b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:43.926691 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf70297-e98b-488c-9e10-3fec22d4a9b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:43.926992 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf70297-e98b-488c-9e10-3fec22d4a9b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:43.927252 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf70297-e98b-488c-9e10-3fec22d4a9b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:43.929278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-aaf70297-e98b-488c-9e10-3fec22d4a9b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:43.998974 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf70297-e98b-488c-9e10-3fec22d4a9b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:44.000737 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf70297-e98b-488c-9e10-3fec22d4a9b3 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:44.012158 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1019/2046] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:37:44.178188 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:44.186353 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbab51-49ac-4d7d-bfc2-215d2a737645 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:44.187990 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3acbab51-49ac-4d7d-bfc2-215d2a737645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:44.261757 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbab51-49ac-4d7d-bfc2-215d2a737645 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:44.266479 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0c3d9-dd69-43ff-91aa-0d14b6588eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:44.267354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0c3d9-dd69-43ff-91aa-0d14b6588eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:44.267640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0c3d9-dd69-43ff-91aa-0d14b6588eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:44.267918 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0c3d9-dd69-43ff-91aa-0d14b6588eb9 admin admin] PATH_INFO: `/v3/projects/15d9a97d10874e57b64d238a9e93cffb` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:44.270767 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0c3d9-dd69-43ff-91aa-0d14b6588eb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15d9a97d10874e57b64d238a9e93cffb)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:44.271146 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0c3d9-dd69-43ff-91aa-0d14b6588eb9 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:44.426874 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-08a0c3d9-dd69-43ff-91aa-0d14b6588eb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15d9a97d10874e57b64d238a9e93cffb', 'request_id': 'req-08a0c3d9-dd69-43ff-91aa-0d14b6588eb9'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:44.432827 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-08a0c3d9-dd69-43ff-91aa-0d14b6588eb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15d9a97d10874e57b64d238a9e93cffb', 'request_id': 'req-08a0c3d9-dd69-43ff-91aa-0d14b6588eb9'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:44.439571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-08a0c3d9-dd69-43ff-91aa-0d14b6588eb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15d9a97d10874e57b64d238a9e93cffb', 'request_id': 'req-08a0c3d9-dd69-43ff-91aa-0d14b6588eb9'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:44.574523 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-08a0c3d9-dd69-43ff-91aa-0d14b6588eb9 admin admin] The token cache is being invalidate because project 15d9a97d10874e57b64d238a9e93cffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:44.574813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-08a0c3d9-dd69-43ff-91aa-0d14b6588eb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:44.575441 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-08a0c3d9-dd69-43ff-91aa-0d14b6588eb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:44.576998 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1028/2047] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:44 2022] DELETE /identity/v3/projects/15d9a97d10874e57b64d238a9e93cffb => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:44.581096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf70297-e98b-488c-9e10-3fec22d4a9b3 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:44.592456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf70297-e98b-488c-9e10-3fec22d4a9b3 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:44.612623 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:44.651493 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef727e3b-1cfa-45b9-b093-0ce881b523e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:44.652429 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef727e3b-1cfa-45b9-b093-0ce881b523e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:44.652719 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef727e3b-1cfa-45b9-b093-0ce881b523e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:44.653003 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef727e3b-1cfa-45b9-b093-0ce881b523e2 admin admin] PATH_INFO: `/v3/users/7ff815bcaa754b2e89913af249a9a07e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:44.654290 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef727e3b-1cfa-45b9-b093-0ce881b523e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ff815bcaa754b2e89913af249a9a07e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:44.656208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef727e3b-1cfa-45b9-b093-0ce881b523e2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:44.885048 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ef727e3b-1cfa-45b9-b093-0ce881b523e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ff815bcaa754b2e89913af249a9a07e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:44.885730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ef727e3b-1cfa-45b9-b093-0ce881b523e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ff815bcaa754b2e89913af249a9a07e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:44.887444 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ef727e3b-1cfa-45b9-b093-0ce881b523e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ff815bcaa754b2e89913af249a9a07e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:44.901317 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ef727e3b-1cfa-45b9-b093-0ce881b523e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ff815bcaa754b2e89913af249a9a07e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:44.936913 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0c3d9-dd69-43ff-91aa-0d14b6588eb9 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:44.938636 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-08a0c3d9-dd69-43ff-91aa-0d14b6588eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:45.004364 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0c3d9-dd69-43ff-91aa-0d14b6588eb9 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:45.004364 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e80ff3-d6ef-492f-ada3-2fbccfa08f5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:45.004364 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e80ff3-d6ef-492f-ada3-2fbccfa08f5c service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:45.004364 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e80ff3-d6ef-492f-ada3-2fbccfa08f5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:45.004798 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e80ff3-d6ef-492f-ada3-2fbccfa08f5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:45.005730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-46e80ff3-d6ef-492f-ada3-2fbccfa08f5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:45.043925 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ef727e3b-1cfa-45b9-b093-0ce881b523e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ff815bcaa754b2e89913af249a9a07e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:45.059868 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1020/2048] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:44 2022] DELETE /identity/v3/users/7ff815bcaa754b2e89913af249a9a07e => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:45.080817 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e80ff3-d6ef-492f-ada3-2fbccfa08f5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:45.082521 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e80ff3-d6ef-492f-ada3-2fbccfa08f5c service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:45.096540 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1029/2049] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:44 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:37:45.358803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef727e3b-1cfa-45b9-b093-0ce881b523e2 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:45.360505 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ef727e3b-1cfa-45b9-b093-0ce881b523e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:45.435226 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef727e3b-1cfa-45b9-b093-0ce881b523e2 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:45.439286 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf015e-4964-4a17-8791-e2706c009662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:45.440255 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf015e-4964-4a17-8791-e2706c009662 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:45.440632 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf015e-4964-4a17-8791-e2706c009662 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:45.440957 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf015e-4964-4a17-8791-e2706c009662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:45.443570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6fdf015e-4964-4a17-8791-e2706c009662 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:45.518168 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf015e-4964-4a17-8791-e2706c009662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:45.519774 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf015e-4964-4a17-8791-e2706c009662 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:45.531058 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1021/2050] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:45 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:37:45.597192 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e80ff3-d6ef-492f-ada3-2fbccfa08f5c service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:45.602444 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-46e80ff3-d6ef-492f-ada3-2fbccfa08f5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:45.623787 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e80ff3-d6ef-492f-ada3-2fbccfa08f5c service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:45.694604 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b25d1-f29d-4e72-bab0-3c23ecf03292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:45.695991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b25d1-f29d-4e72-bab0-3c23ecf03292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:45.696278 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b25d1-f29d-4e72-bab0-3c23ecf03292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:45.696553 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b25d1-f29d-4e72-bab0-3c23ecf03292 admin admin] PATH_INFO: `/v3/projects/06f506b20f3d433192e3902bb4fdf29f` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:45.697764 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b25d1-f29d-4e72-bab0-3c23ecf03292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06f506b20f3d433192e3902bb4fdf29f)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:45.699763 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b25d1-f29d-4e72-bab0-3c23ecf03292 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:45.853580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8c3b25d1-f29d-4e72-bab0-3c23ecf03292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06f506b20f3d433192e3902bb4fdf29f', 'request_id': 'req-8c3b25d1-f29d-4e72-bab0-3c23ecf03292'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:45.860085 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8c3b25d1-f29d-4e72-bab0-3c23ecf03292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06f506b20f3d433192e3902bb4fdf29f', 'request_id': 'req-8c3b25d1-f29d-4e72-bab0-3c23ecf03292'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:45.866815 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8c3b25d1-f29d-4e72-bab0-3c23ecf03292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06f506b20f3d433192e3902bb4fdf29f', 'request_id': 'req-8c3b25d1-f29d-4e72-bab0-3c23ecf03292'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:45.927845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:46.034344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8c3b25d1-f29d-4e72-bab0-3c23ecf03292 admin admin] The token cache is being invalidate because project 06f506b20f3d433192e3902bb4fdf29f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:46.034630 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8c3b25d1-f29d-4e72-bab0-3c23ecf03292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:46.035251 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8c3b25d1-f29d-4e72-bab0-3c23ecf03292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:46.036835 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1030/2051] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:45 2022] DELETE /identity/v3/projects/06f506b20f3d433192e3902bb4fdf29f => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:46.042546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e97252-83a6-4480-be49-3feefbf0ae30 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:46.043177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e97252-83a6-4480-be49-3feefbf0ae30 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:46.043484 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e97252-83a6-4480-be49-3feefbf0ae30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:46.063230 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-64e97252-83a6-4480-be49-3feefbf0ae30 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:46.064444 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-64e97252-83a6-4480-be49-3feefbf0ae30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:46.123412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1022/2052] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:46.131479 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a475fb-10bc-4800-85e5-76e793719626 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:46.131774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a475fb-10bc-4800-85e5-76e793719626 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:46.132055 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a475fb-10bc-4800-85e5-76e793719626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:46.153129 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-26a475fb-10bc-4800-85e5-76e793719626 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:46.154172 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-26a475fb-10bc-4800-85e5-76e793719626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:46.163723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1031/2053] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:46.168658 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e97252-83a6-4480-be49-3feefbf0ae30 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:46.178218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e97252-83a6-4480-be49-3feefbf0ae30 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:46.183083 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135d89c-70e1-484e-a865-e0c953d59f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:46.183739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135d89c-70e1-484e-a865-e0c953d59f83 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:46.184085 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135d89c-70e1-484e-a865-e0c953d59f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:46.184372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135d89c-70e1-484e-a865-e0c953d59f83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:46.185100 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135d89c-70e1-484e-a865-e0c953d59f83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:37:46.185413 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135d89c-70e1-484e-a865-e0c953d59f83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:46.187074 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135d89c-70e1-484e-a865-e0c953d59f83 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:46.204380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1023/2054] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:37:46.205227 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a475fb-10bc-4800-85e5-76e793719626 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:46.215795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a475fb-10bc-4800-85e5-76e793719626 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:46.221030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabb082-3669-4ae3-aa97-4656912c3a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:46.221887 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabb082-3669-4ae3-aa97-4656912c3a29 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:46.222185 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabb082-3669-4ae3-aa97-4656912c3a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:46.222490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dabb082-3669-4ae3-aa97-4656912c3a29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:46.223190 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dabb082-3669-4ae3-aa97-4656912c3a29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:46.225282 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dabb082-3669-4ae3-aa97-4656912c3a29 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:46.401843 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1032/2055] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:46 2022] POST /identity/v3/projects => generated 371 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:37:46.406180 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135d89c-70e1-484e-a865-e0c953d59f83 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:46.416493 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135d89c-70e1-484e-a865-e0c953d59f83 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:46.478015 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35b7aa-5504-40e7-99ab-e6975bb8c7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:46.478766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35b7aa-5504-40e7-99ab-e6975bb8c7fb admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:46.479052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35b7aa-5504-40e7-99ab-e6975bb8c7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:46.479328 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35b7aa-5504-40e7-99ab-e6975bb8c7fb admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:46.480246 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35b7aa-5504-40e7-99ab-e6975bb8c7fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:46.483055 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35b7aa-5504-40e7-99ab-e6975bb8c7fb admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:47.183979 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1024/2056] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:46 2022] POST /identity/v3/users => generated 286 bytes in 778 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:47.188265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabb082-3669-4ae3-aa97-4656912c3a29 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:47.198915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dabb082-3669-4ae3-aa97-4656912c3a29 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:47.203627 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fcca3-f2bf-4bb8-8aef-76417e06c3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:47.204293 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fcca3-f2bf-4bb8-8aef-76417e06c3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:47.204582 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fcca3-f2bf-4bb8-8aef-76417e06c3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:47.204863 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fcca3-f2bf-4bb8-8aef-76417e06c3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:47.205588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fcca3-f2bf-4bb8-8aef-76417e06c3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:47.207232 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fcca3-f2bf-4bb8-8aef-76417e06c3a0 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:47.217782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1033/2057] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:37:47.221978 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35b7aa-5504-40e7-99ab-e6975bb8c7fb admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:47.232278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35b7aa-5504-40e7-99ab-e6975bb8c7fb admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:47.251322 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12e772-1873-4d2d-813d-b2550cd9e493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:47.251322 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12e772-1873-4d2d-813d-b2550cd9e493 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:47.251322 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12e772-1873-4d2d-813d-b2550cd9e493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:47.251322 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12e772-1873-4d2d-813d-b2550cd9e493 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:47.251853 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12e772-1873-4d2d-813d-b2550cd9e493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:47.251853 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12e772-1873-4d2d-813d-b2550cd9e493 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:47.257052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1025/2058] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:47.261435 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fcca3-f2bf-4bb8-8aef-76417e06c3a0 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:47.271646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fcca3-f2bf-4bb8-8aef-76417e06c3a0 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:47.276678 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae611a-5dbd-4278-825f-c250fc2581a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:47.277564 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae611a-5dbd-4278-825f-c250fc2581a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:47.277909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae611a-5dbd-4278-825f-c250fc2581a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:47.278191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae611a-5dbd-4278-825f-c250fc2581a3 admin admin] PATH_INFO: `/v3/projects/a35e29048825447d952fe69525dbfbb9/users/a922fc0313624105a9fb4528e3aa6a89/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:47.293719 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae611a-5dbd-4278-825f-c250fc2581a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a35e29048825447d952fe69525dbfbb9, user_id=a922fc0313624105a9fb4528e3aa6a89, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:47.296475 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae611a-5dbd-4278-825f-c250fc2581a3 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:47.958553 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1034/2059] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:47 2022] PUT /identity/v3/projects/a35e29048825447d952fe69525dbfbb9/users/a922fc0313624105a9fb4528e3aa6a89/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:47.960294 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f8b90-1bc4-4739-b87e-58371147b033 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:47.960603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f8b90-1bc4-4739-b87e-58371147b033 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:47.962017 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f8b90-1bc4-4739-b87e-58371147b033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:47.984363 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2e4f8b90-1bc4-4739-b87e-58371147b033 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:47.985668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2e4f8b90-1bc4-4739-b87e-58371147b033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:48.055566 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1026/2060] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:48.066027 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae611a-5dbd-4278-825f-c250fc2581a3 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:48.068172 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-00ae611a-5dbd-4278-825f-c250fc2581a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:48.150840 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae611a-5dbd-4278-825f-c250fc2581a3 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:48.155529 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a09589-a781-42da-b7ae-9406739353a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:48.156156 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a09589-a781-42da-b7ae-9406739353a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:48.156448 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a09589-a781-42da-b7ae-9406739353a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:48.156730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a09589-a781-42da-b7ae-9406739353a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:48.167561 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a09589-a781-42da-b7ae-9406739353a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:48.169555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a09589-a781-42da-b7ae-9406739353a0 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:48.180018 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1035/2061] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:48.878772 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f8b90-1bc4-4739-b87e-58371147b033 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:48.880249 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2e4f8b90-1bc4-4739-b87e-58371147b033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:48.948761 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f8b90-1bc4-4739-b87e-58371147b033 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:48.952755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9d33b-3368-4515-8ef6-78c77fbb0744 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:48.953417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9d33b-3368-4515-8ef6-78c77fbb0744 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:48.953720 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9d33b-3368-4515-8ef6-78c77fbb0744 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:48.954002 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be9d33b-3368-4515-8ef6-78c77fbb0744 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:48.956374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1be9d33b-3368-4515-8ef6-78c77fbb0744 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:49.024851 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9d33b-3368-4515-8ef6-78c77fbb0744 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:49.026276 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be9d33b-3368-4515-8ef6-78c77fbb0744 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:49.035312 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1027/2062] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:49.252734 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:50.044375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:50.057493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037d59d-e180-41ec-90c2-c0beac3da7ff None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:50.057822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037d59d-e180-41ec-90c2-c0beac3da7ff None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:50.058114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037d59d-e180-41ec-90c2-c0beac3da7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:50.084966 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0037d59d-e180-41ec-90c2-c0beac3da7ff None None] MFA Rules not processed for user `a922fc0313624105a9fb4528e3aa6a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:50.086221 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0037d59d-e180-41ec-90c2-c0beac3da7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:50.163411 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1036/2063] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:50.168526 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9d33b-3368-4515-8ef6-78c77fbb0744 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:50.179673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be9d33b-3368-4515-8ef6-78c77fbb0744 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:50.184278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce49f5-4d0a-4beb-90d3-78a610ab2f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:50.184940 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce49f5-4d0a-4beb-90d3-78a610ab2f7d admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:50.185234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce49f5-4d0a-4beb-90d3-78a610ab2f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:50.185516 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ce49f5-4d0a-4beb-90d3-78a610ab2f7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:50.186313 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce49f5-4d0a-4beb-90d3-78a610ab2f7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:50.188259 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ce49f5-4d0a-4beb-90d3-78a610ab2f7d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:50.413178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1028/2064] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:50 2022] POST /identity/v3/projects => generated 371 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:50.417773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037d59d-e180-41ec-90c2-c0beac3da7ff None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:50.428820 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037d59d-e180-41ec-90c2-c0beac3da7ff None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:50.488115 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e55c0-9fcc-4aec-a496-cb7ae323b173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:50.488701 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e55c0-9fcc-4aec-a496-cb7ae323b173 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:50.488993 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e55c0-9fcc-4aec-a496-cb7ae323b173 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:50.489274 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e55c0-9fcc-4aec-a496-cb7ae323b173 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:50.490445 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e55c0-9fcc-4aec-a496-cb7ae323b173 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:50.491964 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e55c0-9fcc-4aec-a496-cb7ae323b173 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:50.641127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1037/2065] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:50 2022] POST /identity/v3/users => generated 292 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:50.644898 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce49f5-4d0a-4beb-90d3-78a610ab2f7d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:50.656812 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ce49f5-4d0a-4beb-90d3-78a610ab2f7d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:50.662249 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4077f62-0a61-48a7-b1b9-9667c2be6de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:50.662963 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4077f62-0a61-48a7-b1b9-9667c2be6de7 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:50.663255 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4077f62-0a61-48a7-b1b9-9667c2be6de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:50.663538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4077f62-0a61-48a7-b1b9-9667c2be6de7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:50.664284 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4077f62-0a61-48a7-b1b9-9667c2be6de7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:50.665987 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4077f62-0a61-48a7-b1b9-9667c2be6de7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:50.676776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1029/2066] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:50.681456 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e55c0-9fcc-4aec-a496-cb7ae323b173 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:50.692867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e55c0-9fcc-4aec-a496-cb7ae323b173 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:50.698154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4418b0b-4380-44da-8f86-6a272225df96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:50.699010 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4418b0b-4380-44da-8f86-6a272225df96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:50.699293 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4418b0b-4380-44da-8f86-6a272225df96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:50.699565 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4418b0b-4380-44da-8f86-6a272225df96 admin admin] PATH_INFO: `/v3/projects/fd60edba4de94440b594c47b47febb3c/users/fb32ee34e21a4c1c9f0493a76b2c4d89/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:50.715136 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4418b0b-4380-44da-8f86-6a272225df96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd60edba4de94440b594c47b47febb3c, user_id=fb32ee34e21a4c1c9f0493a76b2c4d89, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:50.717880 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4418b0b-4380-44da-8f86-6a272225df96 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:50.854997 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1038/2067] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:50 2022] PUT /identity/v3/projects/fd60edba4de94440b594c47b47febb3c/users/fb32ee34e21a4c1c9f0493a76b2c4d89/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:50.859032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4077f62-0a61-48a7-b1b9-9667c2be6de7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:50.869602 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4077f62-0a61-48a7-b1b9-9667c2be6de7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:50.927615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae24ee7-b966-4f2e-b5ed-faa348a5c82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:50.928292 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae24ee7-b966-4f2e-b5ed-faa348a5c82f admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:50.928580 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae24ee7-b966-4f2e-b5ed-faa348a5c82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:50.928864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae24ee7-b966-4f2e-b5ed-faa348a5c82f admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:50.930252 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae24ee7-b966-4f2e-b5ed-faa348a5c82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:50.931860 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae24ee7-b966-4f2e-b5ed-faa348a5c82f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:50.941880 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1030/2068] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:50.946179 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4418b0b-4380-44da-8f86-6a272225df96 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:50.956384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4418b0b-4380-44da-8f86-6a272225df96 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:50.960896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f332a-b39f-49af-82b4-01ace2451f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:50.961795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f332a-b39f-49af-82b4-01ace2451f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:50.962083 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f332a-b39f-49af-82b4-01ace2451f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:50.962361 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f332a-b39f-49af-82b4-01ace2451f60 admin admin] PATH_INFO: `/v3/projects/fd60edba4de94440b594c47b47febb3c/users/fb32ee34e21a4c1c9f0493a76b2c4d89/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:50.964319 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f332a-b39f-49af-82b4-01ace2451f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd60edba4de94440b594c47b47febb3c, user_id=fb32ee34e21a4c1c9f0493a76b2c4d89, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:50.966985 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f332a-b39f-49af-82b4-01ace2451f60 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:50.977361 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1039/2069] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:50 2022] PUT /identity/v3/projects/fd60edba4de94440b594c47b47febb3c/users/fb32ee34e21a4c1c9f0493a76b2c4d89/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:51.423664 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae24ee7-b966-4f2e-b5ed-faa348a5c82f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:51.425845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6ae24ee7-b966-4f2e-b5ed-faa348a5c82f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:51.447253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae24ee7-b966-4f2e-b5ed-faa348a5c82f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:51.519795 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4834575-2f13-489f-ad79-257dab0f24d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:51.520693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4834575-2f13-489f-ad79-257dab0f24d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:51.521162 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4834575-2f13-489f-ad79-257dab0f24d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:51.521261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4834575-2f13-489f-ad79-257dab0f24d7 admin admin] PATH_INFO: `/v3/users/49f0803b480a4d23933a7f0e6f86aa2f` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:51.522842 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4834575-2f13-489f-ad79-257dab0f24d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49f0803b480a4d23933a7f0e6f86aa2f)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:51.524978 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4834575-2f13-489f-ad79-257dab0f24d7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:51.602123 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f332a-b39f-49af-82b4-01ace2451f60 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:51.663214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f332a-b39f-49af-82b4-01ace2451f60 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:51.663214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93818a2c-c812-4bf8-93b6-accfb95378bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:51.663214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93818a2c-c812-4bf8-93b6-accfb95378bb service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:51.663214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93818a2c-c812-4bf8-93b6-accfb95378bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:51.664243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93818a2c-c812-4bf8-93b6-accfb95378bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:51.665986 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-93818a2c-c812-4bf8-93b6-accfb95378bb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:51.763100 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93818a2c-c812-4bf8-93b6-accfb95378bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:51.764768 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93818a2c-c812-4bf8-93b6-accfb95378bb service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:51.776372 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1040/2070] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:37:51.834749 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f4834575-2f13-489f-ad79-257dab0f24d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49f0803b480a4d23933a7f0e6f86aa2f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:51.835503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f4834575-2f13-489f-ad79-257dab0f24d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49f0803b480a4d23933a7f0e6f86aa2f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:51.836249 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f4834575-2f13-489f-ad79-257dab0f24d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49f0803b480a4d23933a7f0e6f86aa2f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:51.848650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f4834575-2f13-489f-ad79-257dab0f24d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49f0803b480a4d23933a7f0e6f86aa2f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:52.014954 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f4834575-2f13-489f-ad79-257dab0f24d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49f0803b480a4d23933a7f0e6f86aa2f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:52.028618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1031/2071] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:51 2022] DELETE /identity/v3/users/49f0803b480a4d23933a7f0e6f86aa2f => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:52.033158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732c540-e8e1-4937-80f1-6f5757b3f4b2 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:52.033504 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732c540-e8e1-4937-80f1-6f5757b3f4b2 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:52.033898 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732c540-e8e1-4937-80f1-6f5757b3f4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:52.052261 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c732c540-e8e1-4937-80f1-6f5757b3f4b2 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:52.053492 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c732c540-e8e1-4937-80f1-6f5757b3f4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:52.113221 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1041/2072] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:37:52.124164 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4834575-2f13-489f-ad79-257dab0f24d7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:52.126480 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f4834575-2f13-489f-ad79-257dab0f24d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:52.211553 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4834575-2f13-489f-ad79-257dab0f24d7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:52.215504 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ff4c7f-81f7-4bb1-90a2-c131661501e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:52.216216 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff4c7f-81f7-4bb1-90a2-c131661501e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:52.216506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff4c7f-81f7-4bb1-90a2-c131661501e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:52.216790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ff4c7f-81f7-4bb1-90a2-c131661501e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:52.226973 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff4c7f-81f7-4bb1-90a2-c131661501e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:52.228510 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ff4c7f-81f7-4bb1-90a2-c131661501e7 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:52.238894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1032/2073] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:52.635836 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:52.935022 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732c540-e8e1-4937-80f1-6f5757b3f4b2 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:52.938253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c732c540-e8e1-4937-80f1-6f5757b3f4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:52.981739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732c540-e8e1-4937-80f1-6f5757b3f4b2 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:52.998258 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227037f-b7d2-4152-b373-b3dc51adb920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:52.999051 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227037f-b7d2-4152-b373-b3dc51adb920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:52.999434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227037f-b7d2-4152-b373-b3dc51adb920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:52.999842 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6227037f-b7d2-4152-b373-b3dc51adb920 admin admin] PATH_INFO: `/v3/projects/dfc75d8ae2f942148a961282d367a1df` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:53.001819 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227037f-b7d2-4152-b373-b3dc51adb920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfc75d8ae2f942148a961282d367a1df)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:53.004509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6227037f-b7d2-4152-b373-b3dc51adb920 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:53.116320 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5ae67-ef35-42e8-9d96-5997fea3794d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:53.117050 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5ae67-ef35-42e8-9d96-5997fea3794d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:53.117480 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5ae67-ef35-42e8-9d96-5997fea3794d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:53.160705 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6ba5ae67-ef35-42e8-9d96-5997fea3794d None None] MFA Rules not processed for user `fb32ee34e21a4c1c9f0493a76b2c4d89`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:53.162206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6ba5ae67-ef35-42e8-9d96-5997fea3794d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:53.254588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6227037f-b7d2-4152-b373-b3dc51adb920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfc75d8ae2f942148a961282d367a1df', 'request_id': 'req-6227037f-b7d2-4152-b373-b3dc51adb920'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:53.258980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1033/2074] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:53 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:37:53.268115 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6227037f-b7d2-4152-b373-b3dc51adb920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfc75d8ae2f942148a961282d367a1df', 'request_id': 'req-6227037f-b7d2-4152-b373-b3dc51adb920'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:53.269913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf822de0-cc0e-4d36-b027-04cfe46d0e56 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:53.270262 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf822de0-cc0e-4d36-b027-04cfe46d0e56 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:53.270372 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6227037f-b7d2-4152-b373-b3dc51adb920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfc75d8ae2f942148a961282d367a1df', 'request_id': 'req-6227037f-b7d2-4152-b373-b3dc51adb920'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:53.270557 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf822de0-cc0e-4d36-b027-04cfe46d0e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:53.290866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-bf822de0-cc0e-4d36-b027-04cfe46d0e56 None None] MFA Rules not processed for user `a922fc0313624105a9fb4528e3aa6a89`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:53.292088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bf822de0-cc0e-4d36-b027-04cfe46d0e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:53.354936 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1034/2075] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:37:53.366034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf822de0-cc0e-4d36-b027-04cfe46d0e56 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:53.367593 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bf822de0-cc0e-4d36-b027-04cfe46d0e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:53.447519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf822de0-cc0e-4d36-b027-04cfe46d0e56 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:53.454114 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bb810-2b3c-4985-8c20-56e521f7373f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:53.454879 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bb810-2b3c-4985-8c20-56e521f7373f service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:53.455240 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bb810-2b3c-4985-8c20-56e521f7373f service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:53.455596 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bb810-2b3c-4985-8c20-56e521f7373f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:53.458280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bd1bb810-2b3c-4985-8c20-56e521f7373f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:53.464928 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6227037f-b7d2-4152-b373-b3dc51adb920 admin admin] The token cache is being invalidate because project dfc75d8ae2f942148a961282d367a1df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:53.468743 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6227037f-b7d2-4152-b373-b3dc51adb920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:53.469808 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6227037f-b7d2-4152-b373-b3dc51adb920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:53.473523 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bb810-2b3c-4985-8c20-56e521f7373f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:53.475268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bb810-2b3c-4985-8c20-56e521f7373f service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:53.478830 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1042/2076] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:52 2022] DELETE /identity/v3/projects/dfc75d8ae2f942148a961282d367a1df => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:53.479959 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227037f-b7d2-4152-b373-b3dc51adb920 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:53.481608 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6227037f-b7d2-4152-b373-b3dc51adb920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:53.501617 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1035/2077] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:37:53.561202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6227037f-b7d2-4152-b373-b3dc51adb920 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:53.577555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb96a0-6f71-48a7-abd0-5045d88e29b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:53.580389 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb96a0-6f71-48a7-abd0-5045d88e29b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:53.580825 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb96a0-6f71-48a7-abd0-5045d88e29b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:53.581214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfb96a0-6f71-48a7-abd0-5045d88e29b3 admin admin] PATH_INFO: `/v3/users/5436552f1a0e4a84bbbe4c5d2c3bc21e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:53.584864 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb96a0-6f71-48a7-abd0-5045d88e29b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5436552f1a0e4a84bbbe4c5d2c3bc21e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:53.588705 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfb96a0-6f71-48a7-abd0-5045d88e29b3 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:53.607412 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:54.028083 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-abfb96a0-6f71-48a7-abd0-5045d88e29b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5436552f1a0e4a84bbbe4c5d2c3bc21e'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:54.028769 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-abfb96a0-6f71-48a7-abd0-5045d88e29b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5436552f1a0e4a84bbbe4c5d2c3bc21e'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:54.029398 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-abfb96a0-6f71-48a7-abd0-5045d88e29b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5436552f1a0e4a84bbbe4c5d2c3bc21e'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:54.041956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-abfb96a0-6f71-48a7-abd0-5045d88e29b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5436552f1a0e4a84bbbe4c5d2c3bc21e'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:54.048789 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-abfb96a0-6f71-48a7-abd0-5045d88e29b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5436552f1a0e4a84bbbe4c5d2c3bc21e'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:54.168234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1043/2078] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:53 2022] DELETE /identity/v3/users/5436552f1a0e4a84bbbe4c5d2c3bc21e => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:54.717958 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bb810-2b3c-4985-8c20-56e521f7373f service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:54.720043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bd1bb810-2b3c-4985-8c20-56e521f7373f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:54.738497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bb810-2b3c-4985-8c20-56e521f7373f service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:54.798480 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1040c8-65a7-4951-992b-7ae763c64f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:54.799380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1040c8-65a7-4951-992b-7ae763c64f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:54.799663 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1040c8-65a7-4951-992b-7ae763c64f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:54.799935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1040c8-65a7-4951-992b-7ae763c64f84 admin admin] PATH_INFO: `/v3/users/f7bd885124494876bc32b3bcfb888932` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:54.801156 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1040c8-65a7-4951-992b-7ae763c64f84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7bd885124494876bc32b3bcfb888932)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:54.803155 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1040c8-65a7-4951-992b-7ae763c64f84 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:54.827132 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb96a0-6f71-48a7-abd0-5045d88e29b3 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:54.829074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-abfb96a0-6f71-48a7-abd0-5045d88e29b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:54.848703 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfb96a0-6f71-48a7-abd0-5045d88e29b3 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:54.856349 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d2d08-0198-4d04-be62-0bb207eb6c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:54.858453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d2d08-0198-4d04-be62-0bb207eb6c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:54.859049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d2d08-0198-4d04-be62-0bb207eb6c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:54.859422 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d2d08-0198-4d04-be62-0bb207eb6c80 admin admin] PATH_INFO: `/v3/projects/494f50ba342946aa98af2c0aae38ad04` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:54.861016 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d2d08-0198-4d04-be62-0bb207eb6c80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=494f50ba342946aa98af2c0aae38ad04)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:54.863407 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d2d08-0198-4d04-be62-0bb207eb6c80 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:55.164534 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-711d2d08-0198-4d04-be62-0bb207eb6c80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '494f50ba342946aa98af2c0aae38ad04', 'request_id': 'req-711d2d08-0198-4d04-be62-0bb207eb6c80'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:55.166240 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3c1040c8-65a7-4951-992b-7ae763c64f84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7bd885124494876bc32b3bcfb888932'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:55.167454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3c1040c8-65a7-4951-992b-7ae763c64f84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7bd885124494876bc32b3bcfb888932'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:55.168343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3c1040c8-65a7-4951-992b-7ae763c64f84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7bd885124494876bc32b3bcfb888932'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:55.172565 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-711d2d08-0198-4d04-be62-0bb207eb6c80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '494f50ba342946aa98af2c0aae38ad04', 'request_id': 'req-711d2d08-0198-4d04-be62-0bb207eb6c80'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:55.181069 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-711d2d08-0198-4d04-be62-0bb207eb6c80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '494f50ba342946aa98af2c0aae38ad04', 'request_id': 'req-711d2d08-0198-4d04-be62-0bb207eb6c80'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:55.197048 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3c1040c8-65a7-4951-992b-7ae763c64f84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7bd885124494876bc32b3bcfb888932'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:55.328032 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-711d2d08-0198-4d04-be62-0bb207eb6c80 admin admin] The token cache is being invalidate because project 494f50ba342946aa98af2c0aae38ad04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:55.328329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-711d2d08-0198-4d04-be62-0bb207eb6c80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:55.328966 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-711d2d08-0198-4d04-be62-0bb207eb6c80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:55.330627 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1044/2079] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:54 2022] DELETE /identity/v3/projects/494f50ba342946aa98af2c0aae38ad04 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:55.334519 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d2d08-0198-4d04-be62-0bb207eb6c80 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:55.336001 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-711d2d08-0198-4d04-be62-0bb207eb6c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:55.422459 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d2d08-0198-4d04-be62-0bb207eb6c80 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:55.429721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69deee8-a125-4b44-9d15-b0a7924fec29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:55.430894 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69deee8-a125-4b44-9d15-b0a7924fec29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:55.433849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69deee8-a125-4b44-9d15-b0a7924fec29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:55.433849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69deee8-a125-4b44-9d15-b0a7924fec29 admin admin] PATH_INFO: `/v3/users/21d7da4b6ff84f2eba11f57546713a6a` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:55.442845 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69deee8-a125-4b44-9d15-b0a7924fec29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21d7da4b6ff84f2eba11f57546713a6a)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:55.445242 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69deee8-a125-4b44-9d15-b0a7924fec29 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:55.461033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3c1040c8-65a7-4951-992b-7ae763c64f84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7bd885124494876bc32b3bcfb888932'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:55.485216 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1036/2080] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:54 2022] DELETE /identity/v3/users/f7bd885124494876bc32b3bcfb888932 => generated 0 bytes in 767 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:55.489465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee60124-841b-4ffd-b9e6-9ce9604614ab None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:55.490178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee60124-841b-4ffd-b9e6-9ce9604614ab None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:55.496911 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee60124-841b-4ffd-b9e6-9ce9604614ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:55.527762 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-cee60124-841b-4ffd-b9e6-9ce9604614ab None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:55.530218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cee60124-841b-4ffd-b9e6-9ce9604614ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:55.635111 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1037/2081] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:55.645057 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee60124-841b-4ffd-b9e6-9ce9604614ab None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:55.648300 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cee60124-841b-4ffd-b9e6-9ce9604614ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:55.734018 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee60124-841b-4ffd-b9e6-9ce9604614ab None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:55.738795 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6166f0-2c93-48ce-b1e1-74c47e321197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:55.739481 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6166f0-2c93-48ce-b1e1-74c47e321197 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:55.739814 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6166f0-2c93-48ce-b1e1-74c47e321197 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:55.740091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6166f0-2c93-48ce-b1e1-74c47e321197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:55.750685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6166f0-2c93-48ce-b1e1-74c47e321197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:55.752228 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6166f0-2c93-48ce-b1e1-74c47e321197 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:55.762647 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1038/2082] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:37:55.857849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b69deee8-a125-4b44-9d15-b0a7924fec29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21d7da4b6ff84f2eba11f57546713a6a'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:55.862658 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b69deee8-a125-4b44-9d15-b0a7924fec29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21d7da4b6ff84f2eba11f57546713a6a'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:55.863402 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b69deee8-a125-4b44-9d15-b0a7924fec29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21d7da4b6ff84f2eba11f57546713a6a'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:55.879923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b69deee8-a125-4b44-9d15-b0a7924fec29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21d7da4b6ff84f2eba11f57546713a6a'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:55.891804 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b69deee8-a125-4b44-9d15-b0a7924fec29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21d7da4b6ff84f2eba11f57546713a6a'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:56.034653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1045/2083] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:55 2022] DELETE /identity/v3/users/21d7da4b6ff84f2eba11f57546713a6a => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:37:56.084905 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:56.507152 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:56.531643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6166f0-2c93-48ce-b1e1-74c47e321197 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:56.533343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7c6166f0-2c93-48ce-b1e1-74c47e321197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:56.571902 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6166f0-2c93-48ce-b1e1-74c47e321197 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:56.642229 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38be19-5832-43a6-9024-8d8197cdbe6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:56.643036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38be19-5832-43a6-9024-8d8197cdbe6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:56.643319 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38be19-5832-43a6-9024-8d8197cdbe6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:56.643594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38be19-5832-43a6-9024-8d8197cdbe6a admin admin] PATH_INFO: `/v3/projects/ffee48171c684efda63cad0c4d58fd7e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:56.644794 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38be19-5832-43a6-9024-8d8197cdbe6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffee48171c684efda63cad0c4d58fd7e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:56.646809 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38be19-5832-43a6-9024-8d8197cdbe6a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:56.670518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69deee8-a125-4b44-9d15-b0a7924fec29 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:56.672138 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b69deee8-a125-4b44-9d15-b0a7924fec29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:56.689932 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69deee8-a125-4b44-9d15-b0a7924fec29 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:56.697687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b45bbd-cf0d-46e0-b98a-aadccbbda71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:56.699885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b45bbd-cf0d-46e0-b98a-aadccbbda71d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:56.700420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b45bbd-cf0d-46e0-b98a-aadccbbda71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:56.705287 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b45bbd-cf0d-46e0-b98a-aadccbbda71d admin admin] PATH_INFO: `/v3/projects/dd2cc5755b804a86989d5e24f82e9b78` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:56.711106 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b45bbd-cf0d-46e0-b98a-aadccbbda71d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd2cc5755b804a86989d5e24f82e9b78)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:56.713732 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b45bbd-cf0d-46e0-b98a-aadccbbda71d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:56.828207 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ee38be19-5832-43a6-9024-8d8197cdbe6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffee48171c684efda63cad0c4d58fd7e', 'request_id': 'req-ee38be19-5832-43a6-9024-8d8197cdbe6a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:56.836691 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ee38be19-5832-43a6-9024-8d8197cdbe6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffee48171c684efda63cad0c4d58fd7e', 'request_id': 'req-ee38be19-5832-43a6-9024-8d8197cdbe6a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:56.843654 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ee38be19-5832-43a6-9024-8d8197cdbe6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffee48171c684efda63cad0c4d58fd7e', 'request_id': 'req-ee38be19-5832-43a6-9024-8d8197cdbe6a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:56.943078 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e1b45bbd-cf0d-46e0-b98a-aadccbbda71d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd2cc5755b804a86989d5e24f82e9b78', 'request_id': 'req-e1b45bbd-cf0d-46e0-b98a-aadccbbda71d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:56.951139 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e1b45bbd-cf0d-46e0-b98a-aadccbbda71d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd2cc5755b804a86989d5e24f82e9b78', 'request_id': 'req-e1b45bbd-cf0d-46e0-b98a-aadccbbda71d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:56.960189 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e1b45bbd-cf0d-46e0-b98a-aadccbbda71d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd2cc5755b804a86989d5e24f82e9b78', 'request_id': 'req-e1b45bbd-cf0d-46e0-b98a-aadccbbda71d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:56.991297 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ee38be19-5832-43a6-9024-8d8197cdbe6a admin admin] The token cache is being invalidate because project ffee48171c684efda63cad0c4d58fd7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:56.991297 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ee38be19-5832-43a6-9024-8d8197cdbe6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:56.992182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ee38be19-5832-43a6-9024-8d8197cdbe6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:56.994142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1039/2084] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:56 2022] DELETE /identity/v3/projects/ffee48171c684efda63cad0c4d58fd7e => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:57.000282 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38be19-5832-43a6-9024-8d8197cdbe6a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:57.002012 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ee38be19-5832-43a6-9024-8d8197cdbe6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:57.092999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38be19-5832-43a6-9024-8d8197cdbe6a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:57.097091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e1b45bbd-cf0d-46e0-b98a-aadccbbda71d admin admin] The token cache is being invalidate because project dd2cc5755b804a86989d5e24f82e9b78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:57.097512 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e1b45bbd-cf0d-46e0-b98a-aadccbbda71d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:57.098897 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e1b45bbd-cf0d-46e0-b98a-aadccbbda71d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:57.108574 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1046/2085] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:56 2022] DELETE /identity/v3/projects/dd2cc5755b804a86989d5e24f82e9b78 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:37:57.111246 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0daf9-2faf-4fd7-9ebe-d3f78703fee0 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:57.112157 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0daf9-2faf-4fd7-9ebe-d3f78703fee0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:57.112804 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0daf9-2faf-4fd7-9ebe-d3f78703fee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:57.162688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b5c0daf9-2faf-4fd7-9ebe-d3f78703fee0 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:57.164304 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b5c0daf9-2faf-4fd7-9ebe-d3f78703fee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:57.210797 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95cf4a-dba3-4868-8f27-a1b4ffcfb818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:57.214620 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95cf4a-dba3-4868-8f27-a1b4ffcfb818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:57.215230 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95cf4a-dba3-4868-8f27-a1b4ffcfb818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:57.215662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95cf4a-dba3-4868-8f27-a1b4ffcfb818 admin admin] PATH_INFO: `/v3/users/bb81a044a856404aa49004bd28369942` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:57.217328 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95cf4a-dba3-4868-8f27-a1b4ffcfb818 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb81a044a856404aa49004bd28369942)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:57.219499 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95cf4a-dba3-4868-8f27-a1b4ffcfb818 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:57.302031 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1047/2086] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:57.309740 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d28429-acca-4f6d-90b3-b36bf997cc60 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:57.309968 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d28429-acca-4f6d-90b3-b36bf997cc60 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:57.310265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d28429-acca-4f6d-90b3-b36bf997cc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:57.331283 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-92d28429-acca-4f6d-90b3-b36bf997cc60 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:57.332551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-92d28429-acca-4f6d-90b3-b36bf997cc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:57.342910 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1048/2087] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:37:57.354347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d28429-acca-4f6d-90b3-b36bf997cc60 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:57.363943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d28429-acca-4f6d-90b3-b36bf997cc60 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:57.372674 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eaf5d2-2635-47b3-99f5-92677549a1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:57.380022 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaf5d2-2635-47b3-99f5-92677549a1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:57.380022 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaf5d2-2635-47b3-99f5-92677549a1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:57.380022 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eaf5d2-2635-47b3-99f5-92677549a1c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:57.380022 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eaf5d2-2635-47b3-99f5-92677549a1c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:37:57.380022 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eaf5d2-2635-47b3-99f5-92677549a1c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:57.380022 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eaf5d2-2635-47b3-99f5-92677549a1c0 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:57.396861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1049/2088] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:37:57.398184 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eaf5d2-2635-47b3-99f5-92677549a1c0 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:57.408681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eaf5d2-2635-47b3-99f5-92677549a1c0 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:57.414894 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636e6e8-bb50-41cb-b146-c9a04a9f3a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:57.415585 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636e6e8-bb50-41cb-b146-c9a04a9f3a48 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:57.415873 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636e6e8-bb50-41cb-b146-c9a04a9f3a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:57.416150 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636e6e8-bb50-41cb-b146-c9a04a9f3a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:57.416855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636e6e8-bb50-41cb-b146-c9a04a9f3a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:57.419105 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636e6e8-bb50-41cb-b146-c9a04a9f3a48 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:57.559206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6f95cf4a-dba3-4868-8f27-a1b4ffcfb818 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb81a044a856404aa49004bd28369942'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:57.560198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6f95cf4a-dba3-4868-8f27-a1b4ffcfb818 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb81a044a856404aa49004bd28369942'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:57.561499 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6f95cf4a-dba3-4868-8f27-a1b4ffcfb818 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb81a044a856404aa49004bd28369942'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:57.582152 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1050/2089] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:57 2022] POST /identity/v3/projects => generated 389 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:57.583355 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6f95cf4a-dba3-4868-8f27-a1b4ffcfb818 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb81a044a856404aa49004bd28369942'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:57.587107 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636e6e8-bb50-41cb-b146-c9a04a9f3a48 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:57.598169 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3636e6e8-bb50-41cb-b146-c9a04a9f3a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:57.668547 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6f95cf4a-dba3-4868-8f27-a1b4ffcfb818 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb81a044a856404aa49004bd28369942'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:57.686833 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1040/2090] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:56 2022] DELETE /identity/v3/users/bb81a044a856404aa49004bd28369942 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:57.707560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636e6e8-bb50-41cb-b146-c9a04a9f3a48 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:57.782505 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7d295-b44b-41b8-b7e4-af434f158472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:57.783482 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7d295-b44b-41b8-b7e4-af434f158472 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:57.783847 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7d295-b44b-41b8-b7e4-af434f158472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:57.784205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7d295-b44b-41b8-b7e4-af434f158472 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:57.785471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7d295-b44b-41b8-b7e4-af434f158472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:57.791302 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7d295-b44b-41b8-b7e4-af434f158472 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:57.921529 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:57.929913 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1051/2091] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:57 2022] POST /identity/v3/users => generated 295 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:57.933807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95cf4a-dba3-4868-8f27-a1b4ffcfb818 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:57.950550 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95cf4a-dba3-4868-8f27-a1b4ffcfb818 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:57.956719 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f05012-de1d-4e8e-b1d7-9899b58ee3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:57.957473 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f05012-de1d-4e8e-b1d7-9899b58ee3f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:57.958057 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f05012-de1d-4e8e-b1d7-9899b58ee3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:57.958572 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f05012-de1d-4e8e-b1d7-9899b58ee3f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:57.963556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f05012-de1d-4e8e-b1d7-9899b58ee3f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:57.963556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f05012-de1d-4e8e-b1d7-9899b58ee3f9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:57.977502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1041/2092] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:57.981994 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7d295-b44b-41b8-b7e4-af434f158472 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:57.998417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7d295-b44b-41b8-b7e4-af434f158472 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:58.004913 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfe137-0def-4c3f-9876-bc4d32447898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:58.006156 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfe137-0def-4c3f-9876-bc4d32447898 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:58.006447 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfe137-0def-4c3f-9876-bc4d32447898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:58.007207 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfe137-0def-4c3f-9876-bc4d32447898 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:58.008364 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfe137-0def-4c3f-9876-bc4d32447898 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:58.010199 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfe137-0def-4c3f-9876-bc4d32447898 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:58.027281 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1052/2093] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:58.031860 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f05012-de1d-4e8e-b1d7-9899b58ee3f9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:58.043631 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f05012-de1d-4e8e-b1d7-9899b58ee3f9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:58.051419 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42fa17-d07e-4647-a65f-0be9c50a3487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:58.052732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42fa17-d07e-4647-a65f-0be9c50a3487 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:58.053026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42fa17-d07e-4647-a65f-0be9c50a3487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:58.054927 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42fa17-d07e-4647-a65f-0be9c50a3487 admin admin] PATH_INFO: `/v3/projects/3732376b5397456da592b67b1e1796c2/users/a883dfaa6754465e8d7fed83ea5d546a/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:58.078090 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42fa17-d07e-4647-a65f-0be9c50a3487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3732376b5397456da592b67b1e1796c2, user_id=a883dfaa6754465e8d7fed83ea5d546a, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:58.081201 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42fa17-d07e-4647-a65f-0be9c50a3487 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:58.167956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfe137-0def-4c3f-9876-bc4d32447898 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:58.169938 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-55dfe137-0def-4c3f-9876-bc4d32447898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:58.188200 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1042/2094] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:58 2022] PUT /identity/v3/projects/3732376b5397456da592b67b1e1796c2/users/a883dfaa6754465e8d7fed83ea5d546a/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:58.193322 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfe137-0def-4c3f-9876-bc4d32447898 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:58.193841 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf5311-7eef-424f-b64b-2194eed4f027 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:58.193841 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf5311-7eef-424f-b64b-2194eed4f027 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:58.193841 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bf5311-7eef-424f-b64b-2194eed4f027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:58.221510 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f5bf5311-7eef-424f-b64b-2194eed4f027 None None] MFA Rules not processed for user `a883dfaa6754465e8d7fed83ea5d546a`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:58.227722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f5bf5311-7eef-424f-b64b-2194eed4f027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:58.262912 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdce6f9-a0fa-47ed-8c15-b66325fff603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:58.264009 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdce6f9-a0fa-47ed-8c15-b66325fff603 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:58.264314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdce6f9-a0fa-47ed-8c15-b66325fff603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:58.264573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdce6f9-a0fa-47ed-8c15-b66325fff603 admin admin] PATH_INFO: `/v3/users/6673e93e63fc4e0bb47a7ca7c3fd4a18` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:58.265857 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdce6f9-a0fa-47ed-8c15-b66325fff603 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6673e93e63fc4e0bb47a7ca7c3fd4a18)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:58.268564 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdce6f9-a0fa-47ed-8c15-b66325fff603 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:58.312278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1043/2095] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:58.313448 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf5311-7eef-424f-b64b-2194eed4f027 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:58.314925 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f5bf5311-7eef-424f-b64b-2194eed4f027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:58.335841 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bf5311-7eef-424f-b64b-2194eed4f027 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:58.348148 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07fd27-4cf3-4437-953d-85cc54edbf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:58.349174 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07fd27-4cf3-4437-953d-85cc54edbf28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:58.349568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07fd27-4cf3-4437-953d-85cc54edbf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:58.349945 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07fd27-4cf3-4437-953d-85cc54edbf28 admin admin] PATH_INFO: `/v3/projects/4189acc131624dca89250ded2b9a7061` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:58.352059 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07fd27-4cf3-4437-953d-85cc54edbf28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4189acc131624dca89250ded2b9a7061)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:58.357640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f07fd27-4cf3-4437-953d-85cc54edbf28 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:58.638410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1fdce6f9-a0fa-47ed-8c15-b66325fff603 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6673e93e63fc4e0bb47a7ca7c3fd4a18'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:58.639079 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1fdce6f9-a0fa-47ed-8c15-b66325fff603 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6673e93e63fc4e0bb47a7ca7c3fd4a18'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:58.639717 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1fdce6f9-a0fa-47ed-8c15-b66325fff603 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6673e93e63fc4e0bb47a7ca7c3fd4a18'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:58.642659 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1f07fd27-4cf3-4437-953d-85cc54edbf28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4189acc131624dca89250ded2b9a7061', 'request_id': 'req-1f07fd27-4cf3-4437-953d-85cc54edbf28'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:58.652677 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1f07fd27-4cf3-4437-953d-85cc54edbf28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4189acc131624dca89250ded2b9a7061', 'request_id': 'req-1f07fd27-4cf3-4437-953d-85cc54edbf28'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:58.658339 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1f07fd27-4cf3-4437-953d-85cc54edbf28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4189acc131624dca89250ded2b9a7061', 'request_id': 'req-1f07fd27-4cf3-4437-953d-85cc54edbf28'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:58.659264 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1fdce6f9-a0fa-47ed-8c15-b66325fff603 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6673e93e63fc4e0bb47a7ca7c3fd4a18'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:58.666750 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1fdce6f9-a0fa-47ed-8c15-b66325fff603 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6673e93e63fc4e0bb47a7ca7c3fd4a18'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:58.814452 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1f07fd27-4cf3-4437-953d-85cc54edbf28 admin admin] The token cache is being invalidate because project 4189acc131624dca89250ded2b9a7061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:58.814801 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1f07fd27-4cf3-4437-953d-85cc54edbf28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:58.815577 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1f07fd27-4cf3-4437-953d-85cc54edbf28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:58.817736 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1044/2096] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:58 2022] DELETE /identity/v3/projects/4189acc131624dca89250ded2b9a7061 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:58.823472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07fd27-4cf3-4437-953d-85cc54edbf28 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:58.823472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1f07fd27-4cf3-4437-953d-85cc54edbf28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:58.895517 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07fd27-4cf3-4437-953d-85cc54edbf28 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:58.902477 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6f48e8-0c9c-4542-8fc4-336cd22cb1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:58.903491 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f48e8-0c9c-4542-8fc4-336cd22cb1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:58.904460 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f48e8-0c9c-4542-8fc4-336cd22cb1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:58.904460 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6f48e8-0c9c-4542-8fc4-336cd22cb1c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:58.904867 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f48e8-0c9c-4542-8fc4-336cd22cb1c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:58.906897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6f48e8-0c9c-4542-8fc4-336cd22cb1c3 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:58.954239 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1053/2097] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:58 2022] DELETE /identity/v3/users/6673e93e63fc4e0bb47a7ca7c3fd4a18 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:37:58.954239 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdce6f9-a0fa-47ed-8c15-b66325fff603 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:58.954239 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1fdce6f9-a0fa-47ed-8c15-b66325fff603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:59.021341 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1045/2098] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:58 2022] POST /identity/v3/projects => generated 389 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:59.022754 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4977558-5894-4358-895a-d83ebbc5eaab None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:59.023105 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4977558-5894-4358-895a-d83ebbc5eaab None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:59.023409 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4977558-5894-4358-895a-d83ebbc5eaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:59.037019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdce6f9-a0fa-47ed-8c15-b66325fff603 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:59.044610 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c4977558-5894-4358-895a-d83ebbc5eaab None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:59.046561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c4977558-5894-4358-895a-d83ebbc5eaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:59.112296 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ebbfc-c976-4758-bbcb-9e46df2e3514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:59.113491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ebbfc-c976-4758-bbcb-9e46df2e3514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:59.113962 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ebbfc-c976-4758-bbcb-9e46df2e3514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:59.114387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ebbfc-c976-4758-bbcb-9e46df2e3514 admin admin] PATH_INFO: `/v3/users/8da274f8aac44eb08426475da389f65d` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:59.116964 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ebbfc-c976-4758-bbcb-9e46df2e3514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8da274f8aac44eb08426475da389f65d)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:59.119165 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ebbfc-c976-4758-bbcb-9e46df2e3514 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:59.140898 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1046/2099] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:59.140898 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4977558-5894-4358-895a-d83ebbc5eaab None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:59.155031 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4977558-5894-4358-895a-d83ebbc5eaab None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:59.159951 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94722c-11b9-42fa-97fe-7cb966f52c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:59.160707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94722c-11b9-42fa-97fe-7cb966f52c3b admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:59.161133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94722c-11b9-42fa-97fe-7cb966f52c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:59.161479 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94722c-11b9-42fa-97fe-7cb966f52c3b admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:59.162269 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94722c-11b9-42fa-97fe-7cb966f52c3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:59.164981 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94722c-11b9-42fa-97fe-7cb966f52c3b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:59.320764 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1047/2100] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:37:59 2022] POST /identity/v3/users => generated 301 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:59.322102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004c24d-06ea-4236-ac39-5ae508d27fe7 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:59.322397 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004c24d-06ea-4236-ac39-5ae508d27fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:59.322715 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6004c24d-06ea-4236-ac39-5ae508d27fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:59.340466 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6004c24d-06ea-4236-ac39-5ae508d27fe7 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:59.341796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6004c24d-06ea-4236-ac39-5ae508d27fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:59.351245 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1048/2101] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:59.352133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004c24d-06ea-4236-ac39-5ae508d27fe7 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:59.353446 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6004c24d-06ea-4236-ac39-5ae508d27fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:59.365506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6004c24d-06ea-4236-ac39-5ae508d27fe7 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:59.371143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12875f-adb2-49c5-aa07-af133bb7b87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:59.372040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12875f-adb2-49c5-aa07-af133bb7b87a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:59.372356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12875f-adb2-49c5-aa07-af133bb7b87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:59.372634 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12875f-adb2-49c5-aa07-af133bb7b87a admin admin] PATH_INFO: `/v3/projects/867531f082ec4beeab9ef834c9b504b3` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:59.373878 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12875f-adb2-49c5-aa07-af133bb7b87a admin admin] RBAC: Authorizing `identity:delete_project(project_id=867531f082ec4beeab9ef834c9b504b3)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:59.375800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12875f-adb2-49c5-aa07-af133bb7b87a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:59.419006 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e48ebbfc-c976-4758-bbcb-9e46df2e3514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8da274f8aac44eb08426475da389f65d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:59.419686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e48ebbfc-c976-4758-bbcb-9e46df2e3514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8da274f8aac44eb08426475da389f65d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:59.421984 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e48ebbfc-c976-4758-bbcb-9e46df2e3514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8da274f8aac44eb08426475da389f65d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:59.438630 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e48ebbfc-c976-4758-bbcb-9e46df2e3514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8da274f8aac44eb08426475da389f65d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:59.446998 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e48ebbfc-c976-4758-bbcb-9e46df2e3514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8da274f8aac44eb08426475da389f65d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:59.494442 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-de12875f-adb2-49c5-aa07-af133bb7b87a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '867531f082ec4beeab9ef834c9b504b3', 'request_id': 'req-de12875f-adb2-49c5-aa07-af133bb7b87a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:59.499543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-de12875f-adb2-49c5-aa07-af133bb7b87a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '867531f082ec4beeab9ef834c9b504b3', 'request_id': 'req-de12875f-adb2-49c5-aa07-af133bb7b87a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:59.506052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-de12875f-adb2-49c5-aa07-af133bb7b87a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '867531f082ec4beeab9ef834c9b504b3', 'request_id': 'req-de12875f-adb2-49c5-aa07-af133bb7b87a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:59.604802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1054/2102] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:37:58 2022] DELETE /identity/v3/users/8da274f8aac44eb08426475da389f65d => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:59.605816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ebbfc-c976-4758-bbcb-9e46df2e3514 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:59.607234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e48ebbfc-c976-4758-bbcb-9e46df2e3514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:59.673013 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ebbfc-c976-4758-bbcb-9e46df2e3514 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:59.677882 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f77d4-698d-47cb-9a3a-177c8394e689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:59.678589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f77d4-698d-47cb-9a3a-177c8394e689 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:59.678875 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f77d4-698d-47cb-9a3a-177c8394e689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:59.679147 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f77d4-698d-47cb-9a3a-177c8394e689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:59.679926 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f77d4-698d-47cb-9a3a-177c8394e689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:59.681777 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f77d4-698d-47cb-9a3a-177c8394e689 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:59.695780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1055/2103] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:37:59.695780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f77d4-698d-47cb-9a3a-177c8394e689 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:59.697208 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b97f77d4-698d-47cb-9a3a-177c8394e689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:59.700206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-de12875f-adb2-49c5-aa07-af133bb7b87a admin admin] The token cache is being invalidate because project 867531f082ec4beeab9ef834c9b504b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:37:59.700770 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-de12875f-adb2-49c5-aa07-af133bb7b87a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:59.701591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-de12875f-adb2-49c5-aa07-af133bb7b87a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:37:59.703279 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1049/2104] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:37:59 2022] DELETE /identity/v3/projects/867531f082ec4beeab9ef834c9b504b3 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:59.707012 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e5c55-5335-46f1-a3ee-71cd243a6e67 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:59.707012 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e5c55-5335-46f1-a3ee-71cd243a6e67 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:59.707012 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e5c55-5335-46f1-a3ee-71cd243a6e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:59.713430 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f77d4-698d-47cb-9a3a-177c8394e689 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:59.715987 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:37:59.719099 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feae545-f8f3-479d-97f9-8c80542357f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:59.719586 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feae545-f8f3-479d-97f9-8c80542357f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:59.719883 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feae545-f8f3-479d-97f9-8c80542357f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:59.720165 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feae545-f8f3-479d-97f9-8c80542357f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:59.720900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feae545-f8f3-479d-97f9-8c80542357f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:37:59.721215 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feae545-f8f3-479d-97f9-8c80542357f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:59.723383 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feae545-f8f3-479d-97f9-8c80542357f4 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:59.727923 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-450e5c55-5335-46f1-a3ee-71cd243a6e67 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:59.728747 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-450e5c55-5335-46f1-a3ee-71cd243a6e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:59.740438 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1050/2105] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:59.740438 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e5c55-5335-46f1-a3ee-71cd243a6e67 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:59.740438 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-450e5c55-5335-46f1-a3ee-71cd243a6e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:59.740769 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1056/2106] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:37:59.741383 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd88306-4073-459d-9a11-7787e91461e0 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:59.741679 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd88306-4073-459d-9a11-7787e91461e0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:59.741986 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd88306-4073-459d-9a11-7787e91461e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:59.753604 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e5c55-5335-46f1-a3ee-71cd243a6e67 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:59.758558 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80895bf9-8a1d-461f-8bd6-de5d9fb86e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:59.759565 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80895bf9-8a1d-461f-8bd6-de5d9fb86e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:59.759856 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80895bf9-8a1d-461f-8bd6-de5d9fb86e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:59.760135 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80895bf9-8a1d-461f-8bd6-de5d9fb86e9d admin admin] PATH_INFO: `/v3/projects/04d73d57e8114cc38afff54b9a4511cd/users/28b3a3bd3a5f4173a6a5985b03914629/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:59.765738 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-5bd88306-4073-459d-9a11-7787e91461e0 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:59.767161 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5bd88306-4073-459d-9a11-7787e91461e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:59.776386 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1057/2107] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:37:59.781872 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80895bf9-8a1d-461f-8bd6-de5d9fb86e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d73d57e8114cc38afff54b9a4511cd, user_id=28b3a3bd3a5f4173a6a5985b03914629, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:59.781974 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd88306-4073-459d-9a11-7787e91461e0 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:59.781974 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5bd88306-4073-459d-9a11-7787e91461e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:59.782109 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80895bf9-8a1d-461f-8bd6-de5d9fb86e9d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:59.791973 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd88306-4073-459d-9a11-7787e91461e0 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:59.796566 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab34acb-3e0d-4f3e-a3d2-5f19abf7a9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:37:59.797223 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab34acb-3e0d-4f3e-a3d2-5f19abf7a9d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:59.797511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab34acb-3e0d-4f3e-a3d2-5f19abf7a9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:59.799696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab34acb-3e0d-4f3e-a3d2-5f19abf7a9d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:59.799696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab34acb-3e0d-4f3e-a3d2-5f19abf7a9d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:37:59.800386 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab34acb-3e0d-4f3e-a3d2-5f19abf7a9d1 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:37:59.891341 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1051/2108] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:37:59 2022] PUT /identity/v3/projects/04d73d57e8114cc38afff54b9a4511cd/users/28b3a3bd3a5f4173a6a5985b03914629/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:37:59.892398 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80895bf9-8a1d-461f-8bd6-de5d9fb86e9d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:37:59.894295 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-80895bf9-8a1d-461f-8bd6-de5d9fb86e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:59.894670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1058/2109] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:37:59 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:37:59.896184 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864bdb-8aed-4d20-b43e-9be06da33f5d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:37:59.896786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864bdb-8aed-4d20-b43e-9be06da33f5d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:37:59.898091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864bdb-8aed-4d20-b43e-9be06da33f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:37:59.917153 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-78864bdb-8aed-4d20-b43e-9be06da33f5d None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:37:59.918396 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-78864bdb-8aed-4d20-b43e-9be06da33f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:37:59.969931 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80895bf9-8a1d-461f-8bd6-de5d9fb86e9d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:37:59.999448 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1059/2110] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:00.000264 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78864bdb-8aed-4d20-b43e-9be06da33f5d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:00.013585 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78864bdb-8aed-4d20-b43e-9be06da33f5d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:00.026594 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeb800-409b-45e7-a7a9-fe71da4d3da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:00.027320 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeb800-409b-45e7-a7a9-fe71da4d3da5 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:00.027778 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeb800-409b-45e7-a7a9-fe71da4d3da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:00.028103 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeb800-409b-45e7-a7a9-fe71da4d3da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:00.029060 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eeb800-409b-45e7-a7a9-fe71da4d3da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:00.031313 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eeb800-409b-45e7-a7a9-fe71da4d3da5 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:00.044381 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7466f-c54a-42ae-9779-3be858eebce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:00.045056 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7466f-c54a-42ae-9779-3be858eebce0 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:00.045352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7466f-c54a-42ae-9779-3be858eebce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:00.045644 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7466f-c54a-42ae-9779-3be858eebce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:00.049243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1060/2111] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:00.049243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeb800-409b-45e7-a7a9-fe71da4d3da5 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:00.063274 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7466f-c54a-42ae-9779-3be858eebce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:00.064688 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeb800-409b-45e7-a7a9-fe71da4d3da5 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:00.067228 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7466f-c54a-42ae-9779-3be858eebce0 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:00.072569 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50ca06d-5e53-4c8d-8193-6a5e90e6f39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:00.074920 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ca06d-5e53-4c8d-8193-6a5e90e6f39e admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:00.075457 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ca06d-5e53-4c8d-8193-6a5e90e6f39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:00.076404 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50ca06d-5e53-4c8d-8193-6a5e90e6f39e admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:00.077400 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ca06d-5e53-4c8d-8193-6a5e90e6f39e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:00.077869 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1052/2112] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:00.078723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7466f-c54a-42ae-9779-3be858eebce0 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:00.080534 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50ca06d-5e53-4c8d-8193-6a5e90e6f39e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:00.090393 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7466f-c54a-42ae-9779-3be858eebce0 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:00.096026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab0d4e-a51c-4388-a0a1-928e454755a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:00.096481 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab0d4e-a51c-4388-a0a1-928e454755a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:00.096779 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab0d4e-a51c-4388-a0a1-928e454755a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:00.097061 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ab0d4e-a51c-4388-a0a1-928e454755a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:00.097827 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab0d4e-a51c-4388-a0a1-928e454755a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:38:00.098143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab0d4e-a51c-4388-a0a1-928e454755a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:00.099808 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ab0d4e-a51c-4388-a0a1-928e454755a9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:00.112404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1053/2113] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:38:00.113227 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab0d4e-a51c-4388-a0a1-928e454755a9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:00.123422 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ab0d4e-a51c-4388-a0a1-928e454755a9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:00.128114 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d6fba-21d5-441b-9682-e37295a9ecce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:00.129060 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d6fba-21d5-441b-9682-e37295a9ecce admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:00.129357 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d6fba-21d5-441b-9682-e37295a9ecce admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:00.129643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3d6fba-21d5-441b-9682-e37295a9ecce admin admin] PATH_INFO: `/v3/projects/04d73d57e8114cc38afff54b9a4511cd/users/28b3a3bd3a5f4173a6a5985b03914629/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:00.132253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d6fba-21d5-441b-9682-e37295a9ecce admin admin] RBAC: Authorizing `identity:create_grant(project_id=04d73d57e8114cc38afff54b9a4511cd, user_id=28b3a3bd3a5f4173a6a5985b03914629, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:00.134921 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3d6fba-21d5-441b-9682-e37295a9ecce admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:00.159507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1054/2114] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:00 2022] PUT /identity/v3/projects/04d73d57e8114cc38afff54b9a4511cd/users/28b3a3bd3a5f4173a6a5985b03914629/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:00.160758 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d6fba-21d5-441b-9682-e37295a9ecce admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:00.186048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:00.191625 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1061/2115] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:38:00 2022] POST /identity/v3/users => generated 291 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:00.191625 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6f78e-fd7a-4f1e-9f85-e6a6501d3913 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:00.191625 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6f78e-fd7a-4f1e-9f85-e6a6501d3913 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:00.191625 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6f78e-fd7a-4f1e-9f85-e6a6501d3913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:00.260255 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-43b6f78e-fd7a-4f1e-9f85-e6a6501d3913 None None] MFA Rules not processed for user `28b3a3bd3a5f4173a6a5985b03914629`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:00.261833 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-43b6f78e-fd7a-4f1e-9f85-e6a6501d3913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:00.300564 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3d6fba-21d5-441b-9682-e37295a9ecce admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:00.306232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca2ae3-86cc-456a-81ee-c44fb6f79706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:00.306994 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca2ae3-86cc-456a-81ee-c44fb6f79706 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:00.307365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca2ae3-86cc-456a-81ee-c44fb6f79706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:00.307718 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca2ae3-86cc-456a-81ee-c44fb6f79706 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:00.308496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca2ae3-86cc-456a-81ee-c44fb6f79706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:00.310526 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca2ae3-86cc-456a-81ee-c44fb6f79706 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:00.340219 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1062/2116] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:00 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:00.343391 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6f78e-fd7a-4f1e-9f85-e6a6501d3913 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:00.364934 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6f78e-fd7a-4f1e-9f85-e6a6501d3913 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:00.364934 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d30496-8c2d-413b-a322-dbad555ae40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:00.364934 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d30496-8c2d-413b-a322-dbad555ae40e admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:00.364934 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d30496-8c2d-413b-a322-dbad555ae40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:00.365416 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d30496-8c2d-413b-a322-dbad555ae40e admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:00.365803 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d30496-8c2d-413b-a322-dbad555ae40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:00.367838 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d30496-8c2d-413b-a322-dbad555ae40e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:00.383502 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1063/2117] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:00.387173 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d30496-8c2d-413b-a322-dbad555ae40e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:00.389017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-76d30496-8c2d-413b-a322-dbad555ae40e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:00.452242 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d30496-8c2d-413b-a322-dbad555ae40e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:00.455965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134b1d2-2c0c-4707-90b0-1c7a144eb4f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:00.456660 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134b1d2-2c0c-4707-90b0-1c7a144eb4f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:00.456942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134b1d2-2c0c-4707-90b0-1c7a144eb4f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:00.457221 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134b1d2-2c0c-4707-90b0-1c7a144eb4f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:00.467120 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134b1d2-2c0c-4707-90b0-1c7a144eb4f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:00.468593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134b1d2-2c0c-4707-90b0-1c7a144eb4f9 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:00.478714 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1064/2118] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:00 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:00.479516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134b1d2-2c0c-4707-90b0-1c7a144eb4f9 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:00.489826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134b1d2-2c0c-4707-90b0-1c7a144eb4f9 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:00.497952 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ca315-ba8a-43d7-8f9a-4eab216cd088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:00.498635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ca315-ba8a-43d7-8f9a-4eab216cd088 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:00.498921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ca315-ba8a-43d7-8f9a-4eab216cd088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:00.499202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ca315-ba8a-43d7-8f9a-4eab216cd088 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:00.499939 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ca315-ba8a-43d7-8f9a-4eab216cd088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:00.501791 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ca315-ba8a-43d7-8f9a-4eab216cd088 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:00.508792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1055/2119] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:38:00 2022] POST /identity/v3/projects => generated 385 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:00.514645 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1065/2120] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:00.516845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca2ae3-86cc-456a-81ee-c44fb6f79706 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:00.519742 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ca315-ba8a-43d7-8f9a-4eab216cd088 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:00.530448 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ca315-ba8a-43d7-8f9a-4eab216cd088 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:00.659354 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad798e-a190-4386-9fb4-82c4987940a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:00.661652 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad798e-a190-4386-9fb4-82c4987940a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:00.662116 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad798e-a190-4386-9fb4-82c4987940a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:00.662404 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad798e-a190-4386-9fb4-82c4987940a2 admin admin] PATH_INFO: `/v3/projects/21419eb4c7694a8eb312d3f9ad20a038/users/7a1601a3f92a42af9bd775a0e8bf4687/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:00.665874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca2ae3-86cc-456a-81ee-c44fb6f79706 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:00.672600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708b65c-65fe-4a18-955d-82fcd43cb26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:00.674365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708b65c-65fe-4a18-955d-82fcd43cb26f admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:00.674903 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708b65c-65fe-4a18-955d-82fcd43cb26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:00.675301 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708b65c-65fe-4a18-955d-82fcd43cb26f admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:00.676661 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708b65c-65fe-4a18-955d-82fcd43cb26f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:00.681217 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e708b65c-65fe-4a18-955d-82fcd43cb26f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:00.688675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad798e-a190-4386-9fb4-82c4987940a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21419eb4c7694a8eb312d3f9ad20a038, user_id=7a1601a3f92a42af9bd775a0e8bf4687, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:00.696194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad798e-a190-4386-9fb4-82c4987940a2 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:00.796130 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1056/2121] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:38:00 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:00.797370 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708b65c-65fe-4a18-955d-82fcd43cb26f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:00.808533 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708b65c-65fe-4a18-955d-82fcd43cb26f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:00.813338 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e69610-4fa7-4dff-ab77-7ba09e2b92a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:00.814243 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e69610-4fa7-4dff-ab77-7ba09e2b92a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:00.814581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e69610-4fa7-4dff-ab77-7ba09e2b92a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:00.814866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e69610-4fa7-4dff-ab77-7ba09e2b92a9 admin admin] PATH_INFO: `/v3/users/a883dfaa6754465e8d7fed83ea5d546a` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:00.819108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e69610-4fa7-4dff-ab77-7ba09e2b92a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a883dfaa6754465e8d7fed83ea5d546a)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:00.819108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e69610-4fa7-4dff-ab77-7ba09e2b92a9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:00.837529 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1066/2122] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:00 2022] PUT /identity/v3/projects/21419eb4c7694a8eb312d3f9ad20a038/users/7a1601a3f92a42af9bd775a0e8bf4687/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:00.837529 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad798e-a190-4386-9fb4-82c4987940a2 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:00.902275 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad798e-a190-4386-9fb4-82c4987940a2 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:00.907598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee1947e-350c-4b8f-9644-e4f9c31ad2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:00.908377 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1947e-350c-4b8f-9644-e4f9c31ad2ce admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:00.908731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1947e-350c-4b8f-9644-e4f9c31ad2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:00.909073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee1947e-350c-4b8f-9644-e4f9c31ad2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:00.909923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1947e-350c-4b8f-9644-e4f9c31ad2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:00.911660 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee1947e-350c-4b8f-9644-e4f9c31ad2ce admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:00.927627 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1067/2123] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:00.927627 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19caa3-ce24-40d0-b3c2-0679f2464037 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:00.927627 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19caa3-ce24-40d0-b3c2-0679f2464037 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:00.927627 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19caa3-ce24-40d0-b3c2-0679f2464037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:00.962892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-5f19caa3-ce24-40d0-b3c2-0679f2464037 None None] MFA Rules not processed for user `7a1601a3f92a42af9bd775a0e8bf4687`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:00.964241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5f19caa3-ce24-40d0-b3c2-0679f2464037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:01.034976 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1068/2124] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:01.035753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19caa3-ce24-40d0-b3c2-0679f2464037 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:01.048461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19caa3-ce24-40d0-b3c2-0679f2464037 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:01.053217 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb583ac-3f47-4786-921b-548744f52c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:01.054102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb583ac-3f47-4786-921b-548744f52c29 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:01.054324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb583ac-3f47-4786-921b-548744f52c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:01.054597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb583ac-3f47-4786-921b-548744f52c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:01.055322 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb583ac-3f47-4786-921b-548744f52c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:01.056931 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb583ac-3f47-4786-921b-548744f52c29 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:01.065075 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-30e69610-4fa7-4dff-ab77-7ba09e2b92a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a883dfaa6754465e8d7fed83ea5d546a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:01.065818 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-30e69610-4fa7-4dff-ab77-7ba09e2b92a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a883dfaa6754465e8d7fed83ea5d546a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:01.066443 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-30e69610-4fa7-4dff-ab77-7ba09e2b92a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a883dfaa6754465e8d7fed83ea5d546a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:01.067157 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1069/2125] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:01.067930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb583ac-3f47-4786-921b-548744f52c29 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:01.069836 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4bb583ac-3f47-4786-921b-548744f52c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:01.083211 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb583ac-3f47-4786-921b-548744f52c29 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:01.088552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915fae7-1e88-4b83-80c3-fa3b9a234b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:01.089311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915fae7-1e88-4b83-80c3-fa3b9a234b9e admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:01.089597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915fae7-1e88-4b83-80c3-fa3b9a234b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:01.089900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4915fae7-1e88-4b83-80c3-fa3b9a234b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:01.090593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915fae7-1e88-4b83-80c3-fa3b9a234b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:01.092496 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4915fae7-1e88-4b83-80c3-fa3b9a234b9e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:01.098740 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-30e69610-4fa7-4dff-ab77-7ba09e2b92a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a883dfaa6754465e8d7fed83ea5d546a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:01.288118 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-30e69610-4fa7-4dff-ab77-7ba09e2b92a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a883dfaa6754465e8d7fed83ea5d546a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:01.300777 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1070/2126] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:38:01 2022] POST /identity/v3/projects => generated 379 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:01.302536 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1057/2127] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:38:00 2022] DELETE /identity/v3/users/a883dfaa6754465e8d7fed83ea5d546a => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:01.304469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915fae7-1e88-4b83-80c3-fa3b9a234b9e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:01.306449 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4915fae7-1e88-4b83-80c3-fa3b9a234b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:01.306696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e69610-4fa7-4dff-ab77-7ba09e2b92a9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:01.308379 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-30e69610-4fa7-4dff-ab77-7ba09e2b92a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:01.385155 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e69610-4fa7-4dff-ab77-7ba09e2b92a9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:01.390002 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fe064-6bd4-4ec1-8e99-2f091e6d8692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:01.390430 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4915fae7-1e88-4b83-80c3-fa3b9a234b9e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:01.390873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fe064-6bd4-4ec1-8e99-2f091e6d8692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:01.391232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fe064-6bd4-4ec1-8e99-2f091e6d8692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:01.391447 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fe064-6bd4-4ec1-8e99-2f091e6d8692 admin admin] PATH_INFO: `/v3/projects/d967901f812b445696c811906b902d93` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:01.392643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fe064-6bd4-4ec1-8e99-2f091e6d8692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d967901f812b445696c811906b902d93)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:01.394602 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fe064-6bd4-4ec1-8e99-2f091e6d8692 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:01.395631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad8dae-48a7-4c3c-9cb1-94b893671a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:01.396699 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad8dae-48a7-4c3c-9cb1-94b893671a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:01.397311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad8dae-48a7-4c3c-9cb1-94b893671a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:01.397663 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad8dae-48a7-4c3c-9cb1-94b893671a8f admin admin] PATH_INFO: `/v3/projects/2875f1f411b245f4805eb9e95306063d/users/2109160a00894044a5d07516ab1aed2e/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:01.414447 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad8dae-48a7-4c3c-9cb1-94b893671a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2875f1f411b245f4805eb9e95306063d, user_id=2109160a00894044a5d07516ab1aed2e, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:01.417785 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad8dae-48a7-4c3c-9cb1-94b893671a8f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:01.497275 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1071/2128] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:01 2022] PUT /identity/v3/projects/2875f1f411b245f4805eb9e95306063d/users/2109160a00894044a5d07516ab1aed2e/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:01.501760 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad8dae-48a7-4c3c-9cb1-94b893671a8f admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:01.510102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-850fe064-6bd4-4ec1-8e99-2f091e6d8692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd967901f812b445696c811906b902d93', 'request_id': 'req-850fe064-6bd4-4ec1-8e99-2f091e6d8692'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:01.515451 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-850fe064-6bd4-4ec1-8e99-2f091e6d8692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd967901f812b445696c811906b902d93', 'request_id': 'req-850fe064-6bd4-4ec1-8e99-2f091e6d8692'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:01.521828 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-850fe064-6bd4-4ec1-8e99-2f091e6d8692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd967901f812b445696c811906b902d93', 'request_id': 'req-850fe064-6bd4-4ec1-8e99-2f091e6d8692'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:01.564242 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad8dae-48a7-4c3c-9cb1-94b893671a8f admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:01.617058 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-850fe064-6bd4-4ec1-8e99-2f091e6d8692 admin admin] The token cache is being invalidate because project d967901f812b445696c811906b902d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:01.617346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-850fe064-6bd4-4ec1-8e99-2f091e6d8692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:01.617997 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-850fe064-6bd4-4ec1-8e99-2f091e6d8692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:01.619000 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85470abb-8a2f-4156-8b92-dc703a8b3cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:01.619563 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1058/2129] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:01 2022] DELETE /identity/v3/projects/d967901f812b445696c811906b902d93 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:01.622618 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85470abb-8a2f-4156-8b92-dc703a8b3cc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:01.622618 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85470abb-8a2f-4156-8b92-dc703a8b3cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:01.622618 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85470abb-8a2f-4156-8b92-dc703a8b3cc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:01.622889 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d959055-9f88-4cb7-9fee-816ee7736640 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:01.622963 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85470abb-8a2f-4156-8b92-dc703a8b3cc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:01.623048 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d959055-9f88-4cb7-9fee-816ee7736640 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:01.623048 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d959055-9f88-4cb7-9fee-816ee7736640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:01.623218 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85470abb-8a2f-4156-8b92-dc703a8b3cc3 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:01.639142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6d959055-9f88-4cb7-9fee-816ee7736640 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:01.640379 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6d959055-9f88-4cb7-9fee-816ee7736640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:01.648416 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1059/2130] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:01.649685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb879b4-f2e0-4149-a46d-2f83ff263c2e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:01.650064 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb879b4-f2e0-4149-a46d-2f83ff263c2e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:01.650351 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb879b4-f2e0-4149-a46d-2f83ff263c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:01.667778 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-9bb879b4-f2e0-4149-a46d-2f83ff263c2e None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:01.668963 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9bb879b4-f2e0-4149-a46d-2f83ff263c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:01.676790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1060/2131] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:01.678283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb879b4-f2e0-4149-a46d-2f83ff263c2e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:01.679597 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9bb879b4-f2e0-4149-a46d-2f83ff263c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:01.691226 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb879b4-f2e0-4149-a46d-2f83ff263c2e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:01.695905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f081b-b4a3-4f01-978c-a127a2e6c1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:01.696755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f081b-b4a3-4f01-978c-a127a2e6c1b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:01.697040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f081b-b4a3-4f01-978c-a127a2e6c1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:01.697317 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7f081b-b4a3-4f01-978c-a127a2e6c1b2 admin admin] PATH_INFO: `/v3/users/a3e1aa6c219c447e9a17f3d3ba4a4fe1` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:01.698648 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f081b-b4a3-4f01-978c-a127a2e6c1b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3e1aa6c219c447e9a17f3d3ba4a4fe1)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:01.700633 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7f081b-b4a3-4f01-978c-a127a2e6c1b2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:01.731236 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1072/2132] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:38:01 2022] POST /identity/v3/users => generated 296 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:01.732063 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85470abb-8a2f-4156-8b92-dc703a8b3cc3 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:01.734398 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-85470abb-8a2f-4156-8b92-dc703a8b3cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:01.791038 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85470abb-8a2f-4156-8b92-dc703a8b3cc3 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:01.794769 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714a9be-258d-477e-af45-2949af1e4851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:01.795425 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714a9be-258d-477e-af45-2949af1e4851 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:01.795711 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714a9be-258d-477e-af45-2949af1e4851 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:01.795994 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714a9be-258d-477e-af45-2949af1e4851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:01.805717 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714a9be-258d-477e-af45-2949af1e4851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:01.810073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714a9be-258d-477e-af45-2949af1e4851 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:01.812871 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:01.818623 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1073/2133] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:01.819879 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714a9be-258d-477e-af45-2949af1e4851 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:01.821139 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d714a9be-258d-477e-af45-2949af1e4851 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:01.832160 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714a9be-258d-477e-af45-2949af1e4851 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:01.836161 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fa934-bdd8-4327-8111-3e33028749d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:01.836801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fa934-bdd8-4327-8111-3e33028749d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:01.837085 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fa934-bdd8-4327-8111-3e33028749d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:01.837392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fa934-bdd8-4327-8111-3e33028749d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:01.847086 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fa934-bdd8-4327-8111-3e33028749d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:01.848820 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fa934-bdd8-4327-8111-3e33028749d1 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:01.858749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1074/2134] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:01.859713 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fa934-bdd8-4327-8111-3e33028749d1 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:01.861282 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-693fa934-bdd8-4327-8111-3e33028749d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:01.876383 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fa934-bdd8-4327-8111-3e33028749d1 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:01.883274 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b99ce6-6377-476a-b21b-62ffc0732a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:01.884042 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b99ce6-6377-476a-b21b-62ffc0732a5d admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:01.884413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b99ce6-6377-476a-b21b-62ffc0732a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:01.884747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b99ce6-6377-476a-b21b-62ffc0732a5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:01.885587 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b99ce6-6377-476a-b21b-62ffc0732a5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:01.887412 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b99ce6-6377-476a-b21b-62ffc0732a5d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:01.890640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8e7f081b-b4a3-4f01-978c-a127a2e6c1b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3e1aa6c219c447e9a17f3d3ba4a4fe1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:01.891510 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8e7f081b-b4a3-4f01-978c-a127a2e6c1b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3e1aa6c219c447e9a17f3d3ba4a4fe1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:01.892306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8e7f081b-b4a3-4f01-978c-a127a2e6c1b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3e1aa6c219c447e9a17f3d3ba4a4fe1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:01.899499 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1075/2135] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:01.903729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b99ce6-6377-476a-b21b-62ffc0732a5d admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:01.906138 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-58b99ce6-6377-476a-b21b-62ffc0732a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:01.907529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8e7f081b-b4a3-4f01-978c-a127a2e6c1b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3e1aa6c219c447e9a17f3d3ba4a4fe1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:01.919560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b99ce6-6377-476a-b21b-62ffc0732a5d admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:01.924415 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8c4aa-7f72-4e6f-86b9-cfba305ae456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:01.926869 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8c4aa-7f72-4e6f-86b9-cfba305ae456 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:01.926869 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8c4aa-7f72-4e6f-86b9-cfba305ae456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:01.926869 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8c4aa-7f72-4e6f-86b9-cfba305ae456 admin admin] PATH_INFO: `/v3/projects/5be012c3a2684ccb8aa82b63ed8d6523/users/bded20d3904c456480b9944d95da14f4/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:01.941136 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8c4aa-7f72-4e6f-86b9-cfba305ae456 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be012c3a2684ccb8aa82b63ed8d6523, user_id=bded20d3904c456480b9944d95da14f4, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:01.943917 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8c4aa-7f72-4e6f-86b9-cfba305ae456 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:02.036947 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-8e7f081b-b4a3-4f01-978c-a127a2e6c1b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3e1aa6c219c447e9a17f3d3ba4a4fe1'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:02.045855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1076/2136] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:01 2022] PUT /identity/v3/projects/5be012c3a2684ccb8aa82b63ed8d6523/users/bded20d3904c456480b9944d95da14f4/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:02.049592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8c4aa-7f72-4e6f-86b9-cfba305ae456 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:02.056042 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1061/2137] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:38:01 2022] DELETE /identity/v3/users/a3e1aa6c219c447e9a17f3d3ba4a4fe1 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:02.131155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8c4aa-7f72-4e6f-86b9-cfba305ae456 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:02.198894 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10df8968-b7fc-4240-80a0-71569be228ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:02.199576 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df8968-b7fc-4240-80a0-71569be228ac admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:02.199862 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df8968-b7fc-4240-80a0-71569be228ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:02.200140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10df8968-b7fc-4240-80a0-71569be228ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:02.201094 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df8968-b7fc-4240-80a0-71569be228ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:02.202610 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10df8968-b7fc-4240-80a0-71569be228ac admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:02.216603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1077/2138] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:38:02.217782 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f081b-b4a3-4f01-978c-a127a2e6c1b2 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:02.228362 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7f081b-b4a3-4f01-978c-a127a2e6c1b2 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:02.234097 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab838f-4a36-4cb5-967c-55a6bf1d4269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:02.234390 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab838f-4a36-4cb5-967c-55a6bf1d4269 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:02.234675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab838f-4a36-4cb5-967c-55a6bf1d4269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:02.235006 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab838f-4a36-4cb5-967c-55a6bf1d4269 admin admin] PATH_INFO: `/v3/projects/5be012c3a2684ccb8aa82b63ed8d6523/users/bded20d3904c456480b9944d95da14f4/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:02.237054 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab838f-4a36-4cb5-967c-55a6bf1d4269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5be012c3a2684ccb8aa82b63ed8d6523, user_id=bded20d3904c456480b9944d95da14f4, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:02.241120 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab838f-4a36-4cb5-967c-55a6bf1d4269 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:02.251750 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1062/2139] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:02 2022] PUT /identity/v3/projects/5be012c3a2684ccb8aa82b63ed8d6523/users/bded20d3904c456480b9944d95da14f4/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:38:02.268826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c298b83-4604-4e23-858f-1f01c0a0bef4 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:02.268826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c298b83-4604-4e23-858f-1f01c0a0bef4 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:02.268826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c298b83-4604-4e23-858f-1f01c0a0bef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:02.297970 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-7c298b83-4604-4e23-858f-1f01c0a0bef4 None None] MFA Rules not processed for user `bded20d3904c456480b9944d95da14f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:02.299262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7c298b83-4604-4e23-858f-1f01c0a0bef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:02.385302 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1078/2140] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:02.398804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab838f-4a36-4cb5-967c-55a6bf1d4269 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:02.400644 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f9ab838f-4a36-4cb5-967c-55a6bf1d4269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:02.440880 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:02.467234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab838f-4a36-4cb5-967c-55a6bf1d4269 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:02.471429 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9020bb-b7f2-4144-ade9-a88f45bda83d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:02.472166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9020bb-b7f2-4144-ade9-a88f45bda83d service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:02.472525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9020bb-b7f2-4144-ade9-a88f45bda83d service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:02.472878 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9020bb-b7f2-4144-ade9-a88f45bda83d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:02.484301 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9020bb-b7f2-4144-ade9-a88f45bda83d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:02.485793 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9020bb-b7f2-4144-ade9-a88f45bda83d service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:02.497079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1063/2141] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:38:02.502487 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c298b83-4604-4e23-858f-1f01c0a0bef4 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:02.504208 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7c298b83-4604-4e23-858f-1f01c0a0bef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:02.628986 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c298b83-4604-4e23-858f-1f01c0a0bef4 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:02.637443 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fee66-6624-4acc-b81b-7dfe9a1afaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:02.638501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fee66-6624-4acc-b81b-7dfe9a1afaa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:02.638769 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fee66-6624-4acc-b81b-7dfe9a1afaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:02.639101 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61fee66-6624-4acc-b81b-7dfe9a1afaa2 admin admin] PATH_INFO: `/v3/projects/3732376b5397456da592b67b1e1796c2` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:02.640322 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fee66-6624-4acc-b81b-7dfe9a1afaa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3732376b5397456da592b67b1e1796c2)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:02.647313 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61fee66-6624-4acc-b81b-7dfe9a1afaa2 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:02.679005 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9020bb-b7f2-4144-ade9-a88f45bda83d service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:02.680467 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-de9020bb-b7f2-4144-ade9-a88f45bda83d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:02.705310 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9020bb-b7f2-4144-ade9-a88f45bda83d service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:02.725886 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05410b60-7d64-40a9-8d5e-023dee7e94af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:02.726933 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410b60-7d64-40a9-8d5e-023dee7e94af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:02.727376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410b60-7d64-40a9-8d5e-023dee7e94af admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:02.727796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410b60-7d64-40a9-8d5e-023dee7e94af admin admin] PATH_INFO: `/v3/projects/43fea9e74900432babcb4e7ea07d6c13` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:02.729838 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05410b60-7d64-40a9-8d5e-023dee7e94af admin admin] RBAC: Authorizing `identity:delete_project(project_id=43fea9e74900432babcb4e7ea07d6c13)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:02.734793 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05410b60-7d64-40a9-8d5e-023dee7e94af admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:02.848293 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f61fee66-6624-4acc-b81b-7dfe9a1afaa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3732376b5397456da592b67b1e1796c2', 'request_id': 'req-f61fee66-6624-4acc-b81b-7dfe9a1afaa2'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:02.853640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f61fee66-6624-4acc-b81b-7dfe9a1afaa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3732376b5397456da592b67b1e1796c2', 'request_id': 'req-f61fee66-6624-4acc-b81b-7dfe9a1afaa2'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:02.859711 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f61fee66-6624-4acc-b81b-7dfe9a1afaa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3732376b5397456da592b67b1e1796c2', 'request_id': 'req-f61fee66-6624-4acc-b81b-7dfe9a1afaa2'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:02.894355 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-05410b60-7d64-40a9-8d5e-023dee7e94af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43fea9e74900432babcb4e7ea07d6c13', 'request_id': 'req-05410b60-7d64-40a9-8d5e-023dee7e94af'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:02.900518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-05410b60-7d64-40a9-8d5e-023dee7e94af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43fea9e74900432babcb4e7ea07d6c13', 'request_id': 'req-05410b60-7d64-40a9-8d5e-023dee7e94af'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:02.907563 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-05410b60-7d64-40a9-8d5e-023dee7e94af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43fea9e74900432babcb4e7ea07d6c13', 'request_id': 'req-05410b60-7d64-40a9-8d5e-023dee7e94af'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:02.970173 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f61fee66-6624-4acc-b81b-7dfe9a1afaa2 admin admin] The token cache is being invalidate because project 3732376b5397456da592b67b1e1796c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:02.970468 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f61fee66-6624-4acc-b81b-7dfe9a1afaa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:02.971140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f61fee66-6624-4acc-b81b-7dfe9a1afaa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:02.972738 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1079/2142] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:02 2022] DELETE /identity/v3/projects/3732376b5397456da592b67b1e1796c2 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:02.977296 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fee66-6624-4acc-b81b-7dfe9a1afaa2 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:02.979059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f61fee66-6624-4acc-b81b-7dfe9a1afaa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:03.044682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61fee66-6624-4acc-b81b-7dfe9a1afaa2 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:03.096940 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-05410b60-7d64-40a9-8d5e-023dee7e94af admin admin] The token cache is being invalidate because project 43fea9e74900432babcb4e7ea07d6c13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:03.097374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-05410b60-7d64-40a9-8d5e-023dee7e94af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:03.098190 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-05410b60-7d64-40a9-8d5e-023dee7e94af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:03.099879 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1064/2143] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:02 2022] DELETE /identity/v3/projects/43fea9e74900432babcb4e7ea07d6c13 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:03.104788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05410b60-7d64-40a9-8d5e-023dee7e94af admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:03.106517 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-05410b60-7d64-40a9-8d5e-023dee7e94af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:03.107698 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c9d01-5bdc-4c50-9f8c-14fd3c1371e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:03.108704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c9d01-5bdc-4c50-9f8c-14fd3c1371e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:03.108995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c9d01-5bdc-4c50-9f8c-14fd3c1371e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:03.109278 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c9d01-5bdc-4c50-9f8c-14fd3c1371e6 admin admin] PATH_INFO: `/v3/users/28b3a3bd3a5f4173a6a5985b03914629` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:03.110567 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c9d01-5bdc-4c50-9f8c-14fd3c1371e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28b3a3bd3a5f4173a6a5985b03914629)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:03.112584 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c9d01-5bdc-4c50-9f8c-14fd3c1371e6 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:03.122826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05410b60-7d64-40a9-8d5e-023dee7e94af admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:03.128647 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64524c-1bca-4e5b-891b-994e2656ddc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:03.129544 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64524c-1bca-4e5b-891b-994e2656ddc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:03.130056 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64524c-1bca-4e5b-891b-994e2656ddc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:03.130539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64524c-1bca-4e5b-891b-994e2656ddc0 admin admin] PATH_INFO: `/v3/users/b22f611211dc485eb13d856ddb93e105` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:03.132639 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64524c-1bca-4e5b-891b-994e2656ddc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b22f611211dc485eb13d856ddb93e105)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:03.136518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64524c-1bca-4e5b-891b-994e2656ddc0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:03.506275 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b28c9d01-5bdc-4c50-9f8c-14fd3c1371e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28b3a3bd3a5f4173a6a5985b03914629'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:03.508191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b28c9d01-5bdc-4c50-9f8c-14fd3c1371e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28b3a3bd3a5f4173a6a5985b03914629'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:03.508956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b28c9d01-5bdc-4c50-9f8c-14fd3c1371e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28b3a3bd3a5f4173a6a5985b03914629'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:03.510325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2b64524c-1bca-4e5b-891b-994e2656ddc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b22f611211dc485eb13d856ddb93e105'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:03.511182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2b64524c-1bca-4e5b-891b-994e2656ddc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b22f611211dc485eb13d856ddb93e105'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:03.511957 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2b64524c-1bca-4e5b-891b-994e2656ddc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b22f611211dc485eb13d856ddb93e105'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:03.524221 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b28c9d01-5bdc-4c50-9f8c-14fd3c1371e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28b3a3bd3a5f4173a6a5985b03914629'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:03.526332 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2b64524c-1bca-4e5b-891b-994e2656ddc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b22f611211dc485eb13d856ddb93e105'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:03.532705 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b28c9d01-5bdc-4c50-9f8c-14fd3c1371e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28b3a3bd3a5f4173a6a5985b03914629'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:03.619252 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2b64524c-1bca-4e5b-891b-994e2656ddc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b22f611211dc485eb13d856ddb93e105'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:03.632478 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1065/2144] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:38:03 2022] DELETE /identity/v3/users/b22f611211dc485eb13d856ddb93e105 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:38:03.633329 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64524c-1bca-4e5b-891b-994e2656ddc0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:03.634988 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2b64524c-1bca-4e5b-891b-994e2656ddc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:03.706197 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1080/2145] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:38:02 2022] DELETE /identity/v3/users/28b3a3bd3a5f4173a6a5985b03914629 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:38:03.712320 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64524c-1bca-4e5b-891b-994e2656ddc0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:03.808324 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c4f23-6248-4a96-98df-9ccbc4506569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:03.809746 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c4f23-6248-4a96-98df-9ccbc4506569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:03.810164 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c4f23-6248-4a96-98df-9ccbc4506569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:03.810583 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c4f23-6248-4a96-98df-9ccbc4506569 admin admin] PATH_INFO: `/v3/users/27ce42eee08843b0b5d56231c6c06558` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:03.813693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c4f23-6248-4a96-98df-9ccbc4506569 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27ce42eee08843b0b5d56231c6c06558)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:03.815959 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c4f23-6248-4a96-98df-9ccbc4506569 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:03.884127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c9d01-5bdc-4c50-9f8c-14fd3c1371e6 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:03.885690 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b28c9d01-5bdc-4c50-9f8c-14fd3c1371e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:03.961393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c9d01-5bdc-4c50-9f8c-14fd3c1371e6 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:03.968486 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a397a-9296-45df-8d90-cb8428884b61 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bded20d3904c456480b9944d95da14f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5be012c3a2684ccb8aa82b63ed8d6523', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:03.969320 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a397a-9296-45df-8d90-cb8428884b61 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:03.969726 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a397a-9296-45df-8d90-cb8428884b61 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:03.970412 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a397a-9296-45df-8d90-cb8428884b61 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:03.971500 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a397a-9296-45df-8d90-cb8428884b61 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:38:03.972050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a397a-9296-45df-8d90-cb8428884b61 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:03.974894 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a397a-9296-45df-8d90-cb8428884b61 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:03.990244 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1081/2146] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:38:03.994424 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a397a-9296-45df-8d90-cb8428884b61 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:03.997100 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2b8a397a-9296-45df-8d90-cb8428884b61 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:04.013696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a397a-9296-45df-8d90-cb8428884b61 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:04.019462 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58958cb1-a3ba-4672-b5b9-608ad8470213 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bded20d3904c456480b9944d95da14f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5be012c3a2684ccb8aa82b63ed8d6523', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:04.020694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58958cb1-a3ba-4672-b5b9-608ad8470213 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:04.021406 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58958cb1-a3ba-4672-b5b9-608ad8470213 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:04.022336 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58958cb1-a3ba-4672-b5b9-608ad8470213 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:04.023315 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58958cb1-a3ba-4672-b5b9-608ad8470213 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:04.029914 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58958cb1-a3ba-4672-b5b9-608ad8470213 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:04.111924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-db5c4f23-6248-4a96-98df-9ccbc4506569 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27ce42eee08843b0b5d56231c6c06558'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:04.113460 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-db5c4f23-6248-4a96-98df-9ccbc4506569 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27ce42eee08843b0b5d56231c6c06558'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:04.114683 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-db5c4f23-6248-4a96-98df-9ccbc4506569 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27ce42eee08843b0b5d56231c6c06558'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:04.137751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-db5c4f23-6248-4a96-98df-9ccbc4506569 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27ce42eee08843b0b5d56231c6c06558'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:04.159751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1082/2147] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:38:03 2022] POST /identity/v3/projects => generated 354 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:38:04.163658 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58958cb1-a3ba-4672-b5b9-608ad8470213 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:04.165589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-58958cb1-a3ba-4672-b5b9-608ad8470213 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:04.233038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-db5c4f23-6248-4a96-98df-9ccbc4506569 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27ce42eee08843b0b5d56231c6c06558'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:04.247333 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58958cb1-a3ba-4672-b5b9-608ad8470213 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:04.254415 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6550f-6dd4-4470-b74e-6b8a1da6f07a tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bded20d3904c456480b9944d95da14f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5be012c3a2684ccb8aa82b63ed8d6523', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:04.255406 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6550f-6dd4-4470-b74e-6b8a1da6f07a tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:04.255847 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6550f-6dd4-4470-b74e-6b8a1da6f07a tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:04.256885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6550f-6dd4-4470-b74e-6b8a1da6f07a tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:04.257858 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6550f-6dd4-4470-b74e-6b8a1da6f07a tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:38:04.258320 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6550f-6dd4-4470-b74e-6b8a1da6f07a tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:04.260486 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6550f-6dd4-4470-b74e-6b8a1da6f07a tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:04.260798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1066/2148] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:38:03 2022] DELETE /identity/v3/users/27ce42eee08843b0b5d56231c6c06558 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:04.271340 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c4f23-6248-4a96-98df-9ccbc4506569 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:04.273280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-db5c4f23-6248-4a96-98df-9ccbc4506569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:04.277664 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1083/2149] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:38:04.279318 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67338ec-6a21-47da-bb4b-1eef2c658259 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:04.285854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67338ec-6a21-47da-bb4b-1eef2c658259 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:04.285854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67338ec-6a21-47da-bb4b-1eef2c658259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:04.441036 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b67338ec-6a21-47da-bb4b-1eef2c658259 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:04.442594 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b67338ec-6a21-47da-bb4b-1eef2c658259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:04.469986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c4f23-6248-4a96-98df-9ccbc4506569 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:04.484181 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224dab6-819b-401b-bac0-9b8a8a0a361e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:04.485627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224dab6-819b-401b-bac0-9b8a8a0a361e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:04.485627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224dab6-819b-401b-bac0-9b8a8a0a361e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:04.485980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224dab6-819b-401b-bac0-9b8a8a0a361e admin admin] PATH_INFO: `/v3/projects/419da1d2da5a4f3cbe89cbb256b176db` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:04.491229 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224dab6-819b-401b-bac0-9b8a8a0a361e admin admin] RBAC: Authorizing `identity:delete_project(project_id=419da1d2da5a4f3cbe89cbb256b176db)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:04.493356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224dab6-819b-401b-bac0-9b8a8a0a361e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:04.565194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1084/2150] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:04.567031 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67338ec-6a21-47da-bb4b-1eef2c658259 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:04.583705 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:04.640606 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c224dab6-819b-401b-bac0-9b8a8a0a361e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '419da1d2da5a4f3cbe89cbb256b176db', 'request_id': 'req-c224dab6-819b-401b-bac0-9b8a8a0a361e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:04.651206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c224dab6-819b-401b-bac0-9b8a8a0a361e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '419da1d2da5a4f3cbe89cbb256b176db', 'request_id': 'req-c224dab6-819b-401b-bac0-9b8a8a0a361e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:04.661913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c224dab6-819b-401b-bac0-9b8a8a0a361e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '419da1d2da5a4f3cbe89cbb256b176db', 'request_id': 'req-c224dab6-819b-401b-bac0-9b8a8a0a361e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:04.668369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67338ec-6a21-47da-bb4b-1eef2c658259 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:04.741584 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0db2f-660f-4fe4-a311-0ca42e65ac66 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bded20d3904c456480b9944d95da14f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5be012c3a2684ccb8aa82b63ed8d6523', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:04.742838 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0db2f-660f-4fe4-a311-0ca42e65ac66 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:04.743119 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0db2f-660f-4fe4-a311-0ca42e65ac66 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:04.743396 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0db2f-660f-4fe4-a311-0ca42e65ac66 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] PATH_INFO: `/v3/projects/c71ad510255d46499d24cae30baaa486` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:04.745203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0db2f-660f-4fe4-a311-0ca42e65ac66 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c71ad510255d46499d24cae30baaa486)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:04.747211 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b0db2f-660f-4fe4-a311-0ca42e65ac66 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:04.757400 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c224dab6-819b-401b-bac0-9b8a8a0a361e admin admin] The token cache is being invalidate because project 419da1d2da5a4f3cbe89cbb256b176db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:04.758657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c224dab6-819b-401b-bac0-9b8a8a0a361e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:04.763354 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c224dab6-819b-401b-bac0-9b8a8a0a361e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:04.765790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1067/2151] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:04 2022] DELETE /identity/v3/projects/419da1d2da5a4f3cbe89cbb256b176db => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:04.767888 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224dab6-819b-401b-bac0-9b8a8a0a361e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:04.770773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c224dab6-819b-401b-bac0-9b8a8a0a361e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:04.857518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224dab6-819b-401b-bac0-9b8a8a0a361e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:04.862844 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b7408a-07bf-43e5-8f19-4955cdecdc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:04.864438 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7408a-07bf-43e5-8f19-4955cdecdc92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:04.864969 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7408a-07bf-43e5-8f19-4955cdecdc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:04.865855 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b7408a-07bf-43e5-8f19-4955cdecdc92 admin admin] PATH_INFO: `/v3/projects/04d73d57e8114cc38afff54b9a4511cd` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:04.867215 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7408a-07bf-43e5-8f19-4955cdecdc92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04d73d57e8114cc38afff54b9a4511cd)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:04.869298 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b7408a-07bf-43e5-8f19-4955cdecdc92 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:04.910587 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-43b0db2f-660f-4fe4-a311-0ca42e65ac66 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c71ad510255d46499d24cae30baaa486', 'request_id': 'req-43b0db2f-660f-4fe4-a311-0ca42e65ac66'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:04.916427 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-43b0db2f-660f-4fe4-a311-0ca42e65ac66 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c71ad510255d46499d24cae30baaa486', 'request_id': 'req-43b0db2f-660f-4fe4-a311-0ca42e65ac66'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:04.922647 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-43b0db2f-660f-4fe4-a311-0ca42e65ac66 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c71ad510255d46499d24cae30baaa486', 'request_id': 'req-43b0db2f-660f-4fe4-a311-0ca42e65ac66'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:04.988144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-66b7408a-07bf-43e5-8f19-4955cdecdc92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04d73d57e8114cc38afff54b9a4511cd', 'request_id': 'req-66b7408a-07bf-43e5-8f19-4955cdecdc92'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:04.993447 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:04.998535 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-43b0db2f-660f-4fe4-a311-0ca42e65ac66 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] The token cache is being invalidate because project c71ad510255d46499d24cae30baaa486 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:04.998828 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-43b0db2f-660f-4fe4-a311-0ca42e65ac66 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:05.001121 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-43b0db2f-660f-4fe4-a311-0ca42e65ac66 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:05.002567 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-66b7408a-07bf-43e5-8f19-4955cdecdc92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04d73d57e8114cc38afff54b9a4511cd', 'request_id': 'req-66b7408a-07bf-43e5-8f19-4955cdecdc92'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:05.004573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1085/2152] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:04 2022] DELETE /identity/v3/projects/c71ad510255d46499d24cae30baaa486 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:05.005474 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0db2f-660f-4fe4-a311-0ca42e65ac66 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:05.008085 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-43b0db2f-660f-4fe4-a311-0ca42e65ac66 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:05.011624 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-66b7408a-07bf-43e5-8f19-4955cdecdc92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04d73d57e8114cc38afff54b9a4511cd', 'request_id': 'req-66b7408a-07bf-43e5-8f19-4955cdecdc92'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:05.081674 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0db2f-660f-4fe4-a311-0ca42e65ac66 tempest-VolumeQuotaClassesTest-312097227 tempest-VolumeQuotaClassesTest-312097227-project-admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:05.130457 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-66b7408a-07bf-43e5-8f19-4955cdecdc92 admin admin] The token cache is being invalidate because project 04d73d57e8114cc38afff54b9a4511cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:05.130457 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-66b7408a-07bf-43e5-8f19-4955cdecdc92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:05.132042 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-66b7408a-07bf-43e5-8f19-4955cdecdc92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:05.135393 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1068/2153] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:04 2022] DELETE /identity/v3/projects/04d73d57e8114cc38afff54b9a4511cd => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:05.138306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cbd9a-00fe-49f1-a2d7-b459452caa26 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:05.139632 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cbd9a-00fe-49f1-a2d7-b459452caa26 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:05.140683 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cbd9a-00fe-49f1-a2d7-b459452caa26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:05.191607 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ab2cbd9a-00fe-49f1-a2d7-b459452caa26 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:05.196180 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ab2cbd9a-00fe-49f1-a2d7-b459452caa26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:05.230937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a5d1c-ed97-49e4-b376-26f1dfe39b89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:05.232313 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a5d1c-ed97-49e4-b376-26f1dfe39b89 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:05.232617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a5d1c-ed97-49e4-b376-26f1dfe39b89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:05.232942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a5d1c-ed97-49e4-b376-26f1dfe39b89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:05.238667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e57a5d1c-ed97-49e4-b376-26f1dfe39b89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:05.328953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a5d1c-ed97-49e4-b376-26f1dfe39b89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:05.330496 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a5d1c-ed97-49e4-b376-26f1dfe39b89 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:05.332955 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1069/2154] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:05.334799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb216f-4620-4a94-bff8-35336284043d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:05.335092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb216f-4620-4a94-bff8-35336284043d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:05.335374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb216f-4620-4a94-bff8-35336284043d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:05.343274 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1086/2155] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:05.344480 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21c001-96ce-4ecb-b227-e06aac87b24c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:05.344771 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21c001-96ce-4ecb-b227-e06aac87b24c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:05.345055 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf21c001-96ce-4ecb-b227-e06aac87b24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:05.359916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b2bb216f-4620-4a94-bff8-35336284043d None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:05.361273 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b2bb216f-4620-4a94-bff8-35336284043d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:05.368897 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-cf21c001-96ce-4ecb-b227-e06aac87b24c None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:05.370340 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cf21c001-96ce-4ecb-b227-e06aac87b24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:05.377836 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1070/2156] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:05.379635 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e89269-12c1-4739-bf0c-77975b1d74a4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:05.380012 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1087/2157] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:05.380160 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e89269-12c1-4739-bf0c-77975b1d74a4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:05.380256 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e89269-12c1-4739-bf0c-77975b1d74a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:05.385173 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21c001-96ce-4ecb-b227-e06aac87b24c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:05.396729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf21c001-96ce-4ecb-b227-e06aac87b24c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:05.402776 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48eb6e-16c9-4d71-855e-0924612b56de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:05.403551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48eb6e-16c9-4d71-855e-0924612b56de admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:05.403843 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48eb6e-16c9-4d71-855e-0924612b56de admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:05.404144 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a48eb6e-16c9-4d71-855e-0924612b56de admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:05.405139 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48eb6e-16c9-4d71-855e-0924612b56de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:38:05.405457 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48eb6e-16c9-4d71-855e-0924612b56de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:05.407133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f0e89269-12c1-4739-bf0c-77975b1d74a4 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:05.407655 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a48eb6e-16c9-4d71-855e-0924612b56de admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:05.408637 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f0e89269-12c1-4739-bf0c-77975b1d74a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:05.422616 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1071/2158] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:38:05.427139 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1088/2159] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:38:05.427477 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e89269-12c1-4739-bf0c-77975b1d74a4 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:05.429724 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48eb6e-16c9-4d71-855e-0924612b56de admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:05.442798 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a48eb6e-16c9-4d71-855e-0924612b56de admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:05.447778 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e89269-12c1-4739-bf0c-77975b1d74a4 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:05.449967 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764421e5-d18c-46b9-b034-949eb0ac2e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:05.450731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764421e5-d18c-46b9-b034-949eb0ac2e98 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:05.451214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764421e5-d18c-46b9-b034-949eb0ac2e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:05.451579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764421e5-d18c-46b9-b034-949eb0ac2e98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:05.453331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764421e5-d18c-46b9-b034-949eb0ac2e98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:05.453436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb6b66-7250-461a-bb94-f6b90976c62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:05.454024 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb6b66-7250-461a-bb94-f6b90976c62c admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:05.454673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb6b66-7250-461a-bb94-f6b90976c62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:05.454965 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb6b66-7250-461a-bb94-f6b90976c62c admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:05.455341 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764421e5-d18c-46b9-b034-949eb0ac2e98 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:05.455718 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb6b66-7250-461a-bb94-f6b90976c62c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:38:05.456031 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb6b66-7250-461a-bb94-f6b90976c62c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:05.457771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eb6b66-7250-461a-bb94-f6b90976c62c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:05.476447 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1072/2160] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:38:05.479104 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb6b66-7250-461a-bb94-f6b90976c62c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:05.495500 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb6b66-7250-461a-bb94-f6b90976c62c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:05.501147 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14106a3-dddb-4869-9220-d73138fce9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:05.501905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14106a3-dddb-4869-9220-d73138fce9cd admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:05.502192 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14106a3-dddb-4869-9220-d73138fce9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:05.502469 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14106a3-dddb-4869-9220-d73138fce9cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:05.503175 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14106a3-dddb-4869-9220-d73138fce9cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:05.505126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14106a3-dddb-4869-9220-d73138fce9cd admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:05.687655 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1089/2161] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:38:05 2022] POST /identity/v3/projects => generated 373 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:05.687859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1073/2162] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:38:05 2022] POST /identity/v3/projects => generated 373 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:05.688314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764421e5-d18c-46b9-b034-949eb0ac2e98 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:05.689214 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14106a3-dddb-4869-9220-d73138fce9cd admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:05.813407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14106a3-dddb-4869-9220-d73138fce9cd admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:05.821721 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f04bcc-bb27-4e66-8771-14846105fe0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:05.822094 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764421e5-d18c-46b9-b034-949eb0ac2e98 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:05.822454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f04bcc-bb27-4e66-8771-14846105fe0c admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:05.822949 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f04bcc-bb27-4e66-8771-14846105fe0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:05.823168 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f04bcc-bb27-4e66-8771-14846105fe0c admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:05.823913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f04bcc-bb27-4e66-8771-14846105fe0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:05.826060 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f04bcc-bb27-4e66-8771-14846105fe0c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:05.829980 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337c4f3-81db-40f1-b57c-3f613368fabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:05.830849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337c4f3-81db-40f1-b57c-3f613368fabd admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:05.833057 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337c4f3-81db-40f1-b57c-3f613368fabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:05.833057 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5337c4f3-81db-40f1-b57c-3f613368fabd admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:05.833057 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337c4f3-81db-40f1-b57c-3f613368fabd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:05.836753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5337c4f3-81db-40f1-b57c-3f613368fabd admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:05.951046 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1074/2163] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:38:05 2022] POST /identity/v3/users => generated 287 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:38:05.951243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1090/2164] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:38:05 2022] POST /identity/v3/users => generated 287 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:05.951606 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f04bcc-bb27-4e66-8771-14846105fe0c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:05.954534 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-85f04bcc-bb27-4e66-8771-14846105fe0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:05.970225 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f04bcc-bb27-4e66-8771-14846105fe0c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:05.973863 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337c4f3-81db-40f1-b57c-3f613368fabd admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:05.975813 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114de42-c1d2-45a6-9912-becb5deb4281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:05.976515 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114de42-c1d2-45a6-9912-becb5deb4281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:05.976820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114de42-c1d2-45a6-9912-becb5deb4281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:05.977153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114de42-c1d2-45a6-9912-becb5deb4281 admin admin] PATH_INFO: `/v3/users/7a1601a3f92a42af9bd775a0e8bf4687` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:05.978553 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114de42-c1d2-45a6-9912-becb5deb4281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a1601a3f92a42af9bd775a0e8bf4687)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:05.980789 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114de42-c1d2-45a6-9912-becb5deb4281 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:05.987266 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5337c4f3-81db-40f1-b57c-3f613368fabd admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:05.995537 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7e80a-d981-4aa2-8894-552fa0f4d2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:05.996387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7e80a-d981-4aa2-8894-552fa0f4d2d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:05.996744 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7e80a-d981-4aa2-8894-552fa0f4d2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:05.998332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7e80a-d981-4aa2-8894-552fa0f4d2d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:06.002414 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7e80a-d981-4aa2-8894-552fa0f4d2d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:06.002414 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7e80a-d981-4aa2-8894-552fa0f4d2d8 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:06.020732 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1091/2165] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:06.025479 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7e80a-d981-4aa2-8894-552fa0f4d2d8 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:06.038010 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7e80a-d981-4aa2-8894-552fa0f4d2d8 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:06.043900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c90420-9b66-4c00-a9e4-e6741619b260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:06.044589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c90420-9b66-4c00-a9e4-e6741619b260 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:06.045447 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c90420-9b66-4c00-a9e4-e6741619b260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:06.045447 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c90420-9b66-4c00-a9e4-e6741619b260 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:06.046133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c90420-9b66-4c00-a9e4-e6741619b260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:06.048359 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c90420-9b66-4c00-a9e4-e6741619b260 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:06.061062 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1092/2166] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:06.061926 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c90420-9b66-4c00-a9e4-e6741619b260 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:06.074730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c90420-9b66-4c00-a9e4-e6741619b260 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:06.081631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4683d07-143c-4992-86db-16fee8d8be86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:06.082632 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4683d07-143c-4992-86db-16fee8d8be86 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:06.083026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4683d07-143c-4992-86db-16fee8d8be86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:06.089770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4683d07-143c-4992-86db-16fee8d8be86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:06.094486 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4683d07-143c-4992-86db-16fee8d8be86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:06.094486 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4683d07-143c-4992-86db-16fee8d8be86 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:06.107526 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1093/2167] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:06.108793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4683d07-143c-4992-86db-16fee8d8be86 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:06.124458 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4683d07-143c-4992-86db-16fee8d8be86 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:06.129847 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144da678-bc26-41b1-9b8d-b466dad5951f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:06.130544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144da678-bc26-41b1-9b8d-b466dad5951f admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:06.131360 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144da678-bc26-41b1-9b8d-b466dad5951f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:06.131647 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144da678-bc26-41b1-9b8d-b466dad5951f admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:06.132451 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144da678-bc26-41b1-9b8d-b466dad5951f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:06.134114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144da678-bc26-41b1-9b8d-b466dad5951f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:06.154718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1094/2168] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:06.155568 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144da678-bc26-41b1-9b8d-b466dad5951f admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:06.167338 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144da678-bc26-41b1-9b8d-b466dad5951f admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:06.168493 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3114de42-c1d2-45a6-9912-becb5deb4281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a1601a3f92a42af9bd775a0e8bf4687'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:06.170529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3114de42-c1d2-45a6-9912-becb5deb4281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a1601a3f92a42af9bd775a0e8bf4687'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:06.172050 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3114de42-c1d2-45a6-9912-becb5deb4281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a1601a3f92a42af9bd775a0e8bf4687'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:06.174211 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc8376-48ab-4064-9273-fab4526f0e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:06.175375 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc8376-48ab-4064-9273-fab4526f0e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:06.175766 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc8376-48ab-4064-9273-fab4526f0e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:06.176148 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc8376-48ab-4064-9273-fab4526f0e9e admin admin] PATH_INFO: `/v3/projects/947bf78e0d9e4a9797485fefd117afb3/users/d9ac86461ecd4e6baa6b11fe869e8a4b/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:06.201484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc8376-48ab-4064-9273-fab4526f0e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=947bf78e0d9e4a9797485fefd117afb3, user_id=d9ac86461ecd4e6baa6b11fe869e8a4b, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:06.204471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3114de42-c1d2-45a6-9912-becb5deb4281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a1601a3f92a42af9bd775a0e8bf4687'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:06.206337 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc8376-48ab-4064-9273-fab4526f0e9e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:06.336961 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3114de42-c1d2-45a6-9912-becb5deb4281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a1601a3f92a42af9bd775a0e8bf4687'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:06.354899 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1075/2169] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:38:05 2022] DELETE /identity/v3/users/7a1601a3f92a42af9bd775a0e8bf4687 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:06.354899 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114de42-c1d2-45a6-9912-becb5deb4281 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:06.360745 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3114de42-c1d2-45a6-9912-becb5deb4281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:06.395353 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1095/2170] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:06 2022] PUT /identity/v3/projects/947bf78e0d9e4a9797485fefd117afb3/users/d9ac86461ecd4e6baa6b11fe869e8a4b/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:06.403190 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb302ad-9636-480f-abc5-09054c94b90f None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:06.403190 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb302ad-9636-480f-abc5-09054c94b90f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:06.403190 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb302ad-9636-480f-abc5-09054c94b90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:06.442889 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-ceb302ad-9636-480f-abc5-09054c94b90f None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:06.444179 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ceb302ad-9636-480f-abc5-09054c94b90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:06.457360 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114de42-c1d2-45a6-9912-becb5deb4281 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:06.542723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1096/2171] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:06.544216 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b9429-15a2-48ca-ac25-0e8d495e74e8 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:06.551374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b9429-15a2-48ca-ac25-0e8d495e74e8 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:06.552083 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b9429-15a2-48ca-ac25-0e8d495e74e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:06.587997 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-482b9429-15a2-48ca-ac25-0e8d495e74e8 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:06.590948 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-482b9429-15a2-48ca-ac25-0e8d495e74e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:06.596094 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19507d06-6a8d-41eb-891d-588a0efb3782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:06.598034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19507d06-6a8d-41eb-891d-588a0efb3782 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:06.598690 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19507d06-6a8d-41eb-891d-588a0efb3782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:06.599124 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19507d06-6a8d-41eb-891d-588a0efb3782 admin admin] PATH_INFO: `/v3/projects/ca0c250fc7644c09962309f05fa412d2/users/c4db3515cfee49d2a82eb5bda449b0db/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:06.604916 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1097/2172] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:06.606232 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b9429-15a2-48ca-ac25-0e8d495e74e8 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:06.607815 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-482b9429-15a2-48ca-ac25-0e8d495e74e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:06.657760 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19507d06-6a8d-41eb-891d-588a0efb3782 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0c250fc7644c09962309f05fa412d2, user_id=c4db3515cfee49d2a82eb5bda449b0db, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:06.660569 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19507d06-6a8d-41eb-891d-588a0efb3782 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:06.682542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b9429-15a2-48ca-ac25-0e8d495e74e8 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:06.688340 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4647e-6cff-4a94-ba2a-aea159bc63ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:06.689156 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4647e-6cff-4a94-ba2a-aea159bc63ec service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:06.689448 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4647e-6cff-4a94-ba2a-aea159bc63ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:06.689906 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4647e-6cff-4a94-ba2a-aea159bc63ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:06.701679 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4647e-6cff-4a94-ba2a-aea159bc63ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:06.703152 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4647e-6cff-4a94-ba2a-aea159bc63ec service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:06.716795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1098/2173] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:06.718421 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4647e-6cff-4a94-ba2a-aea159bc63ec service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:06.726693 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-60e4647e-6cff-4a94-ba2a-aea159bc63ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:06.744964 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4647e-6cff-4a94-ba2a-aea159bc63ec service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:06.758398 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650a68b-b997-4d66-9cfc-82dbfba5b170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:06.759617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650a68b-b997-4d66-9cfc-82dbfba5b170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:06.760107 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650a68b-b997-4d66-9cfc-82dbfba5b170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:06.760580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650a68b-b997-4d66-9cfc-82dbfba5b170 admin admin] PATH_INFO: `/v3/projects/44bf417771b34d29a032853776743ce3` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:06.762068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650a68b-b997-4d66-9cfc-82dbfba5b170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44bf417771b34d29a032853776743ce3)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:06.764693 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650a68b-b997-4d66-9cfc-82dbfba5b170 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:06.784934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1076/2174] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:06 2022] PUT /identity/v3/projects/ca0c250fc7644c09962309f05fa412d2/users/c4db3515cfee49d2a82eb5bda449b0db/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:06.786015 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19507d06-6a8d-41eb-891d-588a0efb3782 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:06.907308 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19507d06-6a8d-41eb-891d-588a0efb3782 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:06.931710 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82066b5d-9f9d-4e74-98ff-7b9c0a8ecc8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:06.933476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82066b5d-9f9d-4e74-98ff-7b9c0a8ecc8c service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:06.934184 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82066b5d-9f9d-4e74-98ff-7b9c0a8ecc8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:06.938992 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82066b5d-9f9d-4e74-98ff-7b9c0a8ecc8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:07.007958 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4650a68b-b997-4d66-9cfc-82dbfba5b170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44bf417771b34d29a032853776743ce3', 'request_id': 'req-4650a68b-b997-4d66-9cfc-82dbfba5b170'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:07.027213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4650a68b-b997-4d66-9cfc-82dbfba5b170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44bf417771b34d29a032853776743ce3', 'request_id': 'req-4650a68b-b997-4d66-9cfc-82dbfba5b170'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:07.043554 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4650a68b-b997-4d66-9cfc-82dbfba5b170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44bf417771b34d29a032853776743ce3', 'request_id': 'req-4650a68b-b997-4d66-9cfc-82dbfba5b170'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:07.057522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82066b5d-9f9d-4e74-98ff-7b9c0a8ecc8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:07.060371 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82066b5d-9f9d-4e74-98ff-7b9c0a8ecc8c service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:07.098984 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1077/2175] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:07.098984 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b8128-230d-4d6b-add1-6931a4ff642a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:07.098984 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b8128-230d-4d6b-add1-6931a4ff642a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:07.098984 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b8128-230d-4d6b-add1-6931a4ff642a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:07.127057 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c75b8128-230d-4d6b-add1-6931a4ff642a None None] MFA Rules not processed for user `c4db3515cfee49d2a82eb5bda449b0db`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:07.128608 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c75b8128-230d-4d6b-add1-6931a4ff642a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:07.218389 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4650a68b-b997-4d66-9cfc-82dbfba5b170 admin admin] The token cache is being invalidate because project 44bf417771b34d29a032853776743ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:07.219124 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4650a68b-b997-4d66-9cfc-82dbfba5b170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:07.220093 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4650a68b-b997-4d66-9cfc-82dbfba5b170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:07.222329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1099/2176] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:06 2022] DELETE /identity/v3/projects/44bf417771b34d29a032853776743ce3 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:07.227140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650a68b-b997-4d66-9cfc-82dbfba5b170 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:07.230214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4650a68b-b997-4d66-9cfc-82dbfba5b170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:07.235089 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1078/2177] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:07.249992 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b8128-230d-4d6b-add1-6931a4ff642a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:07.252691 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c75b8128-230d-4d6b-add1-6931a4ff642a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:07.395481 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b8128-230d-4d6b-add1-6931a4ff642a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:07.401124 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca54c86-dc24-4222-ac52-5b873da83d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:07.402479 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca54c86-dc24-4222-ac52-5b873da83d5a service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:07.402953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca54c86-dc24-4222-ac52-5b873da83d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:07.403163 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650a68b-b997-4d66-9cfc-82dbfba5b170 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:07.404250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca54c86-dc24-4222-ac52-5b873da83d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:07.407203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-eca54c86-dc24-4222-ac52-5b873da83d5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:07.420294 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b9530-4ec2-4fc7-a095-f019dc3f314a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:07.422015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b9530-4ec2-4fc7-a095-f019dc3f314a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:07.422481 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b9530-4ec2-4fc7-a095-f019dc3f314a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:07.422863 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b9530-4ec2-4fc7-a095-f019dc3f314a admin admin] PATH_INFO: `/v3/users/7a2fe6894f9b49e9bf8caa20321abec0` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:07.424763 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b9530-4ec2-4fc7-a095-f019dc3f314a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a2fe6894f9b49e9bf8caa20321abec0)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:07.426981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b9530-4ec2-4fc7-a095-f019dc3f314a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:07.452665 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca54c86-dc24-4222-ac52-5b873da83d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:07.455065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca54c86-dc24-4222-ac52-5b873da83d5a service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:07.492240 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1079/2178] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:38:07.562801 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca54c86-dc24-4222-ac52-5b873da83d5a service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:07.564576 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-eca54c86-dc24-4222-ac52-5b873da83d5a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:07.587419 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca54c86-dc24-4222-ac52-5b873da83d5a service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:07.608317 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e9ae8-806d-47b0-b810-14837e5101b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:07.609687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e9ae8-806d-47b0-b810-14837e5101b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:07.610979 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e9ae8-806d-47b0-b810-14837e5101b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:07.611563 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e9ae8-806d-47b0-b810-14837e5101b7 admin admin] PATH_INFO: `/v3/users/c4db3515cfee49d2a82eb5bda449b0db` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:07.613680 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e9ae8-806d-47b0-b810-14837e5101b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4db3515cfee49d2a82eb5bda449b0db)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:07.617035 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e9ae8-806d-47b0-b810-14837e5101b7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:07.700016 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-393b9530-4ec2-4fc7-a095-f019dc3f314a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a2fe6894f9b49e9bf8caa20321abec0'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:07.700979 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-393b9530-4ec2-4fc7-a095-f019dc3f314a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a2fe6894f9b49e9bf8caa20321abec0'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:07.701877 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-393b9530-4ec2-4fc7-a095-f019dc3f314a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a2fe6894f9b49e9bf8caa20321abec0'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:07.731179 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-393b9530-4ec2-4fc7-a095-f019dc3f314a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a2fe6894f9b49e9bf8caa20321abec0'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:07.743643 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-393b9530-4ec2-4fc7-a095-f019dc3f314a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a2fe6894f9b49e9bf8caa20321abec0'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:07.791272 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:07.865876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1100/2179] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:38:07 2022] DELETE /identity/v3/users/7a2fe6894f9b49e9bf8caa20321abec0 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:07.867133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b9530-4ec2-4fc7-a095-f019dc3f314a admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:07.868720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-393b9530-4ec2-4fc7-a095-f019dc3f314a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:07.921571 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b87e9ae8-806d-47b0-b810-14837e5101b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4db3515cfee49d2a82eb5bda449b0db'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:07.923149 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b87e9ae8-806d-47b0-b810-14837e5101b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4db3515cfee49d2a82eb5bda449b0db'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:07.924319 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b87e9ae8-806d-47b0-b810-14837e5101b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4db3515cfee49d2a82eb5bda449b0db'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:07.954224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b87e9ae8-806d-47b0-b810-14837e5101b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4db3515cfee49d2a82eb5bda449b0db'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:08.002052 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b9530-4ec2-4fc7-a095-f019dc3f314a admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:08.008788 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea2e28-6e84-42f6-aa27-9ae40d793b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:08.010095 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea2e28-6e84-42f6-aa27-9ae40d793b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:08.010616 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea2e28-6e84-42f6-aa27-9ae40d793b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:08.011115 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea2e28-6e84-42f6-aa27-9ae40d793b5f admin admin] PATH_INFO: `/v3/projects/21419eb4c7694a8eb312d3f9ad20a038` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:08.012822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea2e28-6e84-42f6-aa27-9ae40d793b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=21419eb4c7694a8eb312d3f9ad20a038)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:08.015457 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ea2e28-6e84-42f6-aa27-9ae40d793b5f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:08.024886 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b87e9ae8-806d-47b0-b810-14837e5101b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4db3515cfee49d2a82eb5bda449b0db'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:08.048815 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1080/2180] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:38:07 2022] DELETE /identity/v3/users/c4db3515cfee49d2a82eb5bda449b0db => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:08.054300 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ad546-6b27-436e-a257-95e014523ef7 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:08.055289 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ad546-6b27-436e-a257-95e014523ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:08.055881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ad546-6b27-436e-a257-95e014523ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:08.089437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-188ad546-6b27-436e-a257-95e014523ef7 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:08.091114 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-188ad546-6b27-436e-a257-95e014523ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:08.175951 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-80ea2e28-6e84-42f6-aa27-9ae40d793b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21419eb4c7694a8eb312d3f9ad20a038', 'request_id': 'req-80ea2e28-6e84-42f6-aa27-9ae40d793b5f'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:08.189766 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-80ea2e28-6e84-42f6-aa27-9ae40d793b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21419eb4c7694a8eb312d3f9ad20a038', 'request_id': 'req-80ea2e28-6e84-42f6-aa27-9ae40d793b5f'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:08.198221 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-80ea2e28-6e84-42f6-aa27-9ae40d793b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21419eb4c7694a8eb312d3f9ad20a038', 'request_id': 'req-80ea2e28-6e84-42f6-aa27-9ae40d793b5f'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:08.209886 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1081/2181] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:08.222725 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ad546-6b27-436e-a257-95e014523ef7 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:08.224191 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-188ad546-6b27-436e-a257-95e014523ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:08.269635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:08.276087 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-80ea2e28-6e84-42f6-aa27-9ae40d793b5f admin admin] The token cache is being invalidate because project 21419eb4c7694a8eb312d3f9ad20a038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:08.278340 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-80ea2e28-6e84-42f6-aa27-9ae40d793b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:08.281038 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-80ea2e28-6e84-42f6-aa27-9ae40d793b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:08.283800 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1101/2182] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:07 2022] DELETE /identity/v3/projects/21419eb4c7694a8eb312d3f9ad20a038 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:08.288944 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea2e28-6e84-42f6-aa27-9ae40d793b5f admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:08.290690 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-80ea2e28-6e84-42f6-aa27-9ae40d793b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:08.297240 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188ad546-6b27-436e-a257-95e014523ef7 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:08.416086 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee534410-6b32-4832-a69e-547ca7185352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:08.420946 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee534410-6b32-4832-a69e-547ca7185352 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:08.421658 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee534410-6b32-4832-a69e-547ca7185352 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:08.422723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee534410-6b32-4832-a69e-547ca7185352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:08.428489 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ee534410-6b32-4832-a69e-547ca7185352 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:08.445563 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea2e28-6e84-42f6-aa27-9ae40d793b5f admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:08.460876 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee534410-6b32-4832-a69e-547ca7185352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:08.462422 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cb017-42f7-4bc8-8c97-112aaf28d124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:08.463346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cb017-42f7-4bc8-8c97-112aaf28d124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:08.463632 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cb017-42f7-4bc8-8c97-112aaf28d124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:08.463911 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cb017-42f7-4bc8-8c97-112aaf28d124 admin admin] PATH_INFO: `/v3/users/bded20d3904c456480b9944d95da14f4` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:08.465473 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee534410-6b32-4832-a69e-547ca7185352 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:08.466048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cb017-42f7-4bc8-8c97-112aaf28d124 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bded20d3904c456480b9944d95da14f4)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:08.468750 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cb017-42f7-4bc8-8c97-112aaf28d124 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:08.486236 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1082/2183] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:08.732773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee534410-6b32-4832-a69e-547ca7185352 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:08.734591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ee534410-6b32-4832-a69e-547ca7185352 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:08.745525 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b14cb017-42f7-4bc8-8c97-112aaf28d124 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bded20d3904c456480b9944d95da14f4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:08.746360 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b14cb017-42f7-4bc8-8c97-112aaf28d124 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bded20d3904c456480b9944d95da14f4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:08.753356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b14cb017-42f7-4bc8-8c97-112aaf28d124 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bded20d3904c456480b9944d95da14f4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:08.758350 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee534410-6b32-4832-a69e-547ca7185352 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:08.767815 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b14cb017-42f7-4bc8-8c97-112aaf28d124 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bded20d3904c456480b9944d95da14f4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:08.777040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673bdad-7085-4fb2-8d76-ddf6a711952c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:08.778222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673bdad-7085-4fb2-8d76-ddf6a711952c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:08.778380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673bdad-7085-4fb2-8d76-ddf6a711952c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:08.778920 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673bdad-7085-4fb2-8d76-ddf6a711952c admin admin] PATH_INFO: `/v3/projects/b551d6c560154139953b7615460ce8a7` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:08.780919 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673bdad-7085-4fb2-8d76-ddf6a711952c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b551d6c560154139953b7615460ce8a7)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:08.783186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673bdad-7085-4fb2-8d76-ddf6a711952c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:08.785385 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b14cb017-42f7-4bc8-8c97-112aaf28d124 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bded20d3904c456480b9944d95da14f4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:08.896894 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1102/2184] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:38:08 2022] DELETE /identity/v3/users/bded20d3904c456480b9944d95da14f4 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:08.975540 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2673bdad-7085-4fb2-8d76-ddf6a711952c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b551d6c560154139953b7615460ce8a7', 'request_id': 'req-2673bdad-7085-4fb2-8d76-ddf6a711952c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:08.983493 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2673bdad-7085-4fb2-8d76-ddf6a711952c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b551d6c560154139953b7615460ce8a7', 'request_id': 'req-2673bdad-7085-4fb2-8d76-ddf6a711952c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:08.991540 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2673bdad-7085-4fb2-8d76-ddf6a711952c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b551d6c560154139953b7615460ce8a7', 'request_id': 'req-2673bdad-7085-4fb2-8d76-ddf6a711952c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:09.126165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2673bdad-7085-4fb2-8d76-ddf6a711952c admin admin] The token cache is being invalidate because project b551d6c560154139953b7615460ce8a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:09.133027 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2673bdad-7085-4fb2-8d76-ddf6a711952c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:09.133027 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2673bdad-7085-4fb2-8d76-ddf6a711952c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:09.133027 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1083/2185] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:08 2022] DELETE /identity/v3/projects/b551d6c560154139953b7615460ce8a7 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:09.137821 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4d8c5-d9a5-4f9a-ad21-68c2d5c98cd6 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:09.138122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4d8c5-d9a5-4f9a-ad21-68c2d5c98cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:09.138407 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4d8c5-d9a5-4f9a-ad21-68c2d5c98cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:09.176448 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-17d4d8c5-d9a5-4f9a-ad21-68c2d5c98cd6 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:09.179436 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-17d4d8c5-d9a5-4f9a-ad21-68c2d5c98cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:09.337566 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1103/2186] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:09.348820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6c776-f814-4b38-a4ad-7252d91e4662 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:09.349390 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6c776-f814-4b38-a4ad-7252d91e4662 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:09.350457 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6c776-f814-4b38-a4ad-7252d91e4662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:09.380963 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8ec6c776-f814-4b38-a4ad-7252d91e4662 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:09.382875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8ec6c776-f814-4b38-a4ad-7252d91e4662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:09.391499 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1084/2187] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:09.396994 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4d8c5-d9a5-4f9a-ad21-68c2d5c98cd6 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:09.407880 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4d8c5-d9a5-4f9a-ad21-68c2d5c98cd6 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:09.427765 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a5fee-d602-4dfd-9bf4-a2b0c935b2e5 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:09.428246 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a5fee-d602-4dfd-9bf4-a2b0c935b2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:09.428708 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a5fee-d602-4dfd-9bf4-a2b0c935b2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:09.452672 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b295d2-db52-437b-9940-d8dc3f6f0e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:09.454689 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b295d2-db52-437b-9940-d8dc3f6f0e40 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:09.455560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b295d2-db52-437b-9940-d8dc3f6f0e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:09.456086 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b295d2-db52-437b-9940-d8dc3f6f0e40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:09.465332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b295d2-db52-437b-9940-d8dc3f6f0e40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:38:09.469433 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b295d2-db52-437b-9940-d8dc3f6f0e40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:09.471640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b295d2-db52-437b-9940-d8dc3f6f0e40 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:09.503272 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1104/2188] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:38:09.507608 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b295d2-db52-437b-9940-d8dc3f6f0e40 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:09.523564 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a71a5fee-d602-4dfd-9bf4-a2b0c935b2e5 None None] MFA Rules not processed for user `d9ac86461ecd4e6baa6b11fe869e8a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:09.534585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a71a5fee-d602-4dfd-9bf4-a2b0c935b2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:09.534694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b295d2-db52-437b-9940-d8dc3f6f0e40 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:09.550965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3a41c-1656-4660-a25c-a85602bcf991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:09.552177 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3a41c-1656-4660-a25c-a85602bcf991 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:09.552672 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3a41c-1656-4660-a25c-a85602bcf991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:09.553197 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d3a41c-1656-4660-a25c-a85602bcf991 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:09.556056 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3a41c-1656-4660-a25c-a85602bcf991 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:09.572855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d3a41c-1656-4660-a25c-a85602bcf991 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:09.665243 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1085/2189] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:09.676318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a5fee-d602-4dfd-9bf4-a2b0c935b2e5 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:09.676318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a71a5fee-d602-4dfd-9bf4-a2b0c935b2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:09.782713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a5fee-d602-4dfd-9bf4-a2b0c935b2e5 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:09.795234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1105/2190] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:38:09 2022] POST /identity/v3/projects => generated 365 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:09.797954 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3a41c-1656-4660-a25c-a85602bcf991 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:09.803225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-87d3a41c-1656-4660-a25c-a85602bcf991 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:09.947471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95bd6a-dfff-493c-99ec-1961c1481bdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:09.948150 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95bd6a-dfff-493c-99ec-1961c1481bdb service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:09.948436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95bd6a-dfff-493c-99ec-1961c1481bdb service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:09.948714 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95bd6a-dfff-493c-99ec-1961c1481bdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:10.011960 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d3a41c-1656-4660-a25c-a85602bcf991 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:10.026205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20e2cd-bc85-4a12-9f23-aa482014a054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:10.028232 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20e2cd-bc85-4a12-9f23-aa482014a054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:10.029388 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20e2cd-bc85-4a12-9f23-aa482014a054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:10.029517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20e2cd-bc85-4a12-9f23-aa482014a054 admin admin] PATH_INFO: `/v3/projects/ca0c250fc7644c09962309f05fa412d2` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:10.034101 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20e2cd-bc85-4a12-9f23-aa482014a054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0c250fc7644c09962309f05fa412d2)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:10.036875 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20e2cd-bc85-4a12-9f23-aa482014a054 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:10.142839 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95bd6a-dfff-493c-99ec-1961c1481bdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:10.144346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95bd6a-dfff-493c-99ec-1961c1481bdb service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:10.158701 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1086/2191] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:10.159744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95bd6a-dfff-493c-99ec-1961c1481bdb service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:10.172126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95bd6a-dfff-493c-99ec-1961c1481bdb service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:10.179523 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bdbb3-b71a-43f7-9c88-2fda9282fe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:10.180382 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bdbb3-b71a-43f7-9c88-2fda9282fe3d admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:10.180818 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bdbb3-b71a-43f7-9c88-2fda9282fe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:10.183463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1bdbb3-b71a-43f7-9c88-2fda9282fe3d admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:10.183463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bdbb3-b71a-43f7-9c88-2fda9282fe3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:10.184406 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1bdbb3-b71a-43f7-9c88-2fda9282fe3d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:10.275477 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-db20e2cd-bc85-4a12-9f23-aa482014a054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0c250fc7644c09962309f05fa412d2', 'request_id': 'req-db20e2cd-bc85-4a12-9f23-aa482014a054'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:10.289853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-db20e2cd-bc85-4a12-9f23-aa482014a054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0c250fc7644c09962309f05fa412d2', 'request_id': 'req-db20e2cd-bc85-4a12-9f23-aa482014a054'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:10.314104 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-db20e2cd-bc85-4a12-9f23-aa482014a054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0c250fc7644c09962309f05fa412d2', 'request_id': 'req-db20e2cd-bc85-4a12-9f23-aa482014a054'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:10.334339 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1087/2192] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:38:10 2022] POST /identity/v3/users => generated 283 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:10.335079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bdbb3-b71a-43f7-9c88-2fda9282fe3d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:10.341666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8e1bdbb3-b71a-43f7-9c88-2fda9282fe3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:10.374860 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1bdbb3-b71a-43f7-9c88-2fda9282fe3d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:10.454456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db05972-4dad-42d3-9525-80c90d8b0bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:10.455295 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db05972-4dad-42d3-9525-80c90d8b0bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:10.455625 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db05972-4dad-42d3-9525-80c90d8b0bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:10.456085 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db05972-4dad-42d3-9525-80c90d8b0bcf admin admin] PATH_INFO: `/v3/projects/5be012c3a2684ccb8aa82b63ed8d6523` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:10.457684 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db05972-4dad-42d3-9525-80c90d8b0bcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5be012c3a2684ccb8aa82b63ed8d6523)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:10.460483 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db05972-4dad-42d3-9525-80c90d8b0bcf admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:10.464451 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-db20e2cd-bc85-4a12-9f23-aa482014a054 admin admin] The token cache is being invalidate because project ca0c250fc7644c09962309f05fa412d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:10.464975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-db20e2cd-bc85-4a12-9f23-aa482014a054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:10.465640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-db20e2cd-bc85-4a12-9f23-aa482014a054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:10.468915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1106/2193] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:09 2022] DELETE /identity/v3/projects/ca0c250fc7644c09962309f05fa412d2 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:10.473888 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20e2cd-bc85-4a12-9f23-aa482014a054 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:10.476080 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-db20e2cd-bc85-4a12-9f23-aa482014a054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:10.498860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20e2cd-bc85-4a12-9f23-aa482014a054 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:10.508708 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07071f28-5ebc-41c6-92a4-5593a61064eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:10.509445 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07071f28-5ebc-41c6-92a4-5593a61064eb admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:10.509766 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07071f28-5ebc-41c6-92a4-5593a61064eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:10.515070 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07071f28-5ebc-41c6-92a4-5593a61064eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:10.515070 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07071f28-5ebc-41c6-92a4-5593a61064eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:10.515070 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07071f28-5ebc-41c6-92a4-5593a61064eb admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:10.525013 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1107/2194] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:10.526595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ecc2d-e473-4a1f-a261-38f6fe9dda73 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:10.526842 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ecc2d-e473-4a1f-a261-38f6fe9dda73 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:10.527188 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ecc2d-e473-4a1f-a261-38f6fe9dda73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:10.549850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b50ecc2d-e473-4a1f-a261-38f6fe9dda73 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:10.551089 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b50ecc2d-e473-4a1f-a261-38f6fe9dda73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:10.560692 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1108/2195] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:10.562279 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe553f2-1dc0-4725-a4d7-4d5ee5d912a8 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:10.562646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe553f2-1dc0-4725-a4d7-4d5ee5d912a8 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:10.562994 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe553f2-1dc0-4725-a4d7-4d5ee5d912a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:10.593917 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-1fe553f2-1dc0-4725-a4d7-4d5ee5d912a8 None None] MFA Rules not processed for user `2109160a00894044a5d07516ab1aed2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:10.595196 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1fe553f2-1dc0-4725-a4d7-4d5ee5d912a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:10.614685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3db05972-4dad-42d3-9525-80c90d8b0bcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5be012c3a2684ccb8aa82b63ed8d6523', 'request_id': 'req-3db05972-4dad-42d3-9525-80c90d8b0bcf'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:10.621089 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3db05972-4dad-42d3-9525-80c90d8b0bcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5be012c3a2684ccb8aa82b63ed8d6523', 'request_id': 'req-3db05972-4dad-42d3-9525-80c90d8b0bcf'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:10.628591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3db05972-4dad-42d3-9525-80c90d8b0bcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5be012c3a2684ccb8aa82b63ed8d6523', 'request_id': 'req-3db05972-4dad-42d3-9525-80c90d8b0bcf'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:10.668904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1109/2196] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:10.669792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe553f2-1dc0-4725-a4d7-4d5ee5d912a8 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:10.683022 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe553f2-1dc0-4725-a4d7-4d5ee5d912a8 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:10.717933 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3db05972-4dad-42d3-9525-80c90d8b0bcf admin admin] The token cache is being invalidate because project 5be012c3a2684ccb8aa82b63ed8d6523 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:10.718229 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3db05972-4dad-42d3-9525-80c90d8b0bcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:10.719008 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3db05972-4dad-42d3-9525-80c90d8b0bcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:10.720623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1088/2197] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:10 2022] DELETE /identity/v3/projects/5be012c3a2684ccb8aa82b63ed8d6523 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:10.721912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c2fda-b4da-4b76-a25c-d9c10581539a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:10.722199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c2fda-b4da-4b76-a25c-d9c10581539a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:10.722529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c2fda-b4da-4b76-a25c-d9c10581539a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:10.741238 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-cd3c2fda-b4da-4b76-a25c-d9c10581539a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:10.742524 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cd3c2fda-b4da-4b76-a25c-d9c10581539a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:10.751498 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a212c0d-eb21-45b8-b754-98e04a1f9d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:10.752504 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a212c0d-eb21-45b8-b754-98e04a1f9d6d admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:10.752831 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a212c0d-eb21-45b8-b754-98e04a1f9d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:10.753113 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a212c0d-eb21-45b8-b754-98e04a1f9d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:10.754273 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a212c0d-eb21-45b8-b754-98e04a1f9d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:10.757123 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a212c0d-eb21-45b8-b754-98e04a1f9d6d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:10.768490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1110/2198] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:10.769458 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a212c0d-eb21-45b8-b754-98e04a1f9d6d admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:10.771197 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7a212c0d-eb21-45b8-b754-98e04a1f9d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:10.806124 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1089/2199] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:10.807468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0546e30-0d43-46e7-9047-43e3565073fe None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:10.807765 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0546e30-0d43-46e7-9047-43e3565073fe None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:10.808047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0546e30-0d43-46e7-9047-43e3565073fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:10.833661 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c0546e30-0d43-46e7-9047-43e3565073fe None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:10.834919 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c0546e30-0d43-46e7-9047-43e3565073fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:10.849964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1090/2200] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:10.849964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0546e30-0d43-46e7-9047-43e3565073fe None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:10.849964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c0546e30-0d43-46e7-9047-43e3565073fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:10.858220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a212c0d-eb21-45b8-b754-98e04a1f9d6d admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:10.858385 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0546e30-0d43-46e7-9047-43e3565073fe None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:10.863014 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee42c4a-dcc1-4a43-afd6-ab933aafc4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:10.863901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee42c4a-dcc1-4a43-afd6-ab933aafc4a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:10.864190 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee42c4a-dcc1-4a43-afd6-ab933aafc4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:10.864468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee42c4a-dcc1-4a43-afd6-ab933aafc4a2 admin admin] PATH_INFO: `/v3/projects/6c609fc2336b427d9f22cc0d9ff63388/users/ebeca74eeb9c4e4f92a099f8863103c4/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:10.866328 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64454466-f5cb-41c3-adc4-0f26a6bdbbf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:10.867340 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64454466-f5cb-41c3-adc4-0f26a6bdbbf2 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:10.867658 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64454466-f5cb-41c3-adc4-0f26a6bdbbf2 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:10.868153 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64454466-f5cb-41c3-adc4-0f26a6bdbbf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:10.870609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-64454466-f5cb-41c3-adc4-0f26a6bdbbf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:10.879918 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee42c4a-dcc1-4a43-afd6-ab933aafc4a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c609fc2336b427d9f22cc0d9ff63388, user_id=ebeca74eeb9c4e4f92a099f8863103c4, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:10.882716 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee42c4a-dcc1-4a43-afd6-ab933aafc4a2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:10.924957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:10.937842 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64454466-f5cb-41c3-adc4-0f26a6bdbbf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:10.939709 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64454466-f5cb-41c3-adc4-0f26a6bdbbf2 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:10.948978 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1111/2201] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:10.949905 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64454466-f5cb-41c3-adc4-0f26a6bdbbf2 service nova] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:10.964159 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64454466-f5cb-41c3-adc4-0f26a6bdbbf2 service nova] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:10.979322 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87062a-2452-44fd-9095-8030946f7c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:10.979322 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87062a-2452-44fd-9095-8030946f7c1b admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:10.979322 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87062a-2452-44fd-9095-8030946f7c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:10.979322 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87062a-2452-44fd-9095-8030946f7c1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:10.979637 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87062a-2452-44fd-9095-8030946f7c1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:38:10.979637 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87062a-2452-44fd-9095-8030946f7c1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:10.979637 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87062a-2452-44fd-9095-8030946f7c1b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:11.010721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1112/2202] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:38:11.010721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64f50c-7ade-4f61-b585-12bd3c3464b6 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:11.010721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64f50c-7ade-4f61-b585-12bd3c3464b6 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:11.010721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64f50c-7ade-4f61-b585-12bd3c3464b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:11.026191 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1091/2203] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:10 2022] PUT /identity/v3/projects/6c609fc2336b427d9f22cc0d9ff63388/users/ebeca74eeb9c4e4f92a099f8863103c4/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:11.027637 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee42c4a-dcc1-4a43-afd6-ab933aafc4a2 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:11.054144 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-ef64f50c-7ade-4f61-b585-12bd3c3464b6 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:11.066056 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ef64f50c-7ade-4f61-b585-12bd3c3464b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:11.152025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee42c4a-dcc1-4a43-afd6-ab933aafc4a2 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:11.158764 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1113/2204] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:11.160451 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71c1a7-73eb-4064-b74e-d957961cbc5b None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:11.160749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71c1a7-73eb-4064-b74e-d957961cbc5b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:11.161030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71c1a7-73eb-4064-b74e-d957961cbc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:11.168080 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4f5b0-212f-438a-a8ee-cd1dd3d30c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:11.169229 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4f5b0-212f-438a-a8ee-cd1dd3d30c3a admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:11.170403 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4f5b0-212f-438a-a8ee-cd1dd3d30c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:11.170403 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4f5b0-212f-438a-a8ee-cd1dd3d30c3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:11.171124 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4f5b0-212f-438a-a8ee-cd1dd3d30c3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:11.173600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4f5b0-212f-438a-a8ee-cd1dd3d30c3a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:11.214032 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-ef71c1a7-73eb-4064-b74e-d957961cbc5b None None] MFA Rules not processed for user `ebeca74eeb9c4e4f92a099f8863103c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:11.215381 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ef71c1a7-73eb-4064-b74e-d957961cbc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:11.293359 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1092/2205] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:38:11 2022] POST /identity/v3/projects => generated 375 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:11.297947 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4f5b0-212f-438a-a8ee-cd1dd3d30c3a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:11.320790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1114/2206] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:11.320790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71c1a7-73eb-4064-b74e-d957961cbc5b None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:11.333071 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71c1a7-73eb-4064-b74e-d957961cbc5b None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:11.376255 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4f5b0-212f-438a-a8ee-cd1dd3d30c3a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:11.382243 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0011b5-4198-4002-9b36-f4bdb0d356ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:11.382925 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0011b5-4198-4002-9b36-f4bdb0d356ed admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:11.383210 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0011b5-4198-4002-9b36-f4bdb0d356ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:11.383493 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0011b5-4198-4002-9b36-f4bdb0d356ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:11.384349 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0011b5-4198-4002-9b36-f4bdb0d356ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:38:11.384662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0011b5-4198-4002-9b36-f4bdb0d356ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:11.386570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0011b5-4198-4002-9b36-f4bdb0d356ed admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:11.400712 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1861ef-2127-4b56-a0d3-efb079de96bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:11.401234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1093/2207] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:38:11.401419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1861ef-2127-4b56-a0d3-efb079de96bc admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:11.401732 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1861ef-2127-4b56-a0d3-efb079de96bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:11.402024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1861ef-2127-4b56-a0d3-efb079de96bc admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:11.402241 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0011b5-4198-4002-9b36-f4bdb0d356ed admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:11.403752 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1861ef-2127-4b56-a0d3-efb079de96bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:11.405818 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1861ef-2127-4b56-a0d3-efb079de96bc admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:11.416545 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0011b5-4198-4002-9b36-f4bdb0d356ed admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:11.419088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbe95d-3a83-4989-9ed6-da8f95620155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:11.419982 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbe95d-3a83-4989-9ed6-da8f95620155 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:11.420272 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbe95d-3a83-4989-9ed6-da8f95620155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:11.420574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbe95d-3a83-4989-9ed6-da8f95620155 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:11.421380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbe95d-3a83-4989-9ed6-da8f95620155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:11.423347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbe95d-3a83-4989-9ed6-da8f95620155 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:11.530467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1115/2208] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:38:11 2022] POST /identity/v3/users => generated 288 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:11.531339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1861ef-2127-4b56-a0d3-efb079de96bc admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:11.544444 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1094/2209] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:38:11 2022] POST /identity/v3/projects => generated 367 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:11.544444 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbe95d-3a83-4989-9ed6-da8f95620155 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:11.548113 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1861ef-2127-4b56-a0d3-efb079de96bc admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:11.588566 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:11.657551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64362f7-3534-4813-9ecc-4dba884fc604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:11.659007 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64362f7-3534-4813-9ecc-4dba884fc604 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:11.661369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64362f7-3534-4813-9ecc-4dba884fc604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:11.662763 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64362f7-3534-4813-9ecc-4dba884fc604 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:11.664108 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64362f7-3534-4813-9ecc-4dba884fc604 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:11.668501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64362f7-3534-4813-9ecc-4dba884fc604 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:11.671843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbe95d-3a83-4989-9ed6-da8f95620155 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:11.679852 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d96784-b3fe-4685-b65e-ed997e97f4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:11.679852 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d96784-b3fe-4685-b65e-ed997e97f4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:11.679852 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d96784-b3fe-4685-b65e-ed997e97f4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:11.690304 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d96784-b3fe-4685-b65e-ed997e97f4a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:11.692260 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d96784-b3fe-4685-b65e-ed997e97f4a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:11.696031 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d96784-b3fe-4685-b65e-ed997e97f4a7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:11.715521 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1095/2210] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:11.716445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d96784-b3fe-4685-b65e-ed997e97f4a7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:11.728023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d96784-b3fe-4685-b65e-ed997e97f4a7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:11.733123 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad0522-4834-4b9c-ab74-839bd6ee403a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:11.734166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad0522-4834-4b9c-ab74-839bd6ee403a admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:11.734166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad0522-4834-4b9c-ab74-839bd6ee403a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:11.734433 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad0522-4834-4b9c-ab74-839bd6ee403a admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:11.735134 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad0522-4834-4b9c-ab74-839bd6ee403a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:11.737174 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad0522-4834-4b9c-ab74-839bd6ee403a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:11.787372 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1116/2211] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:38:11 2022] POST /identity/v3/projects => generated 409 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:11.788318 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64362f7-3534-4813-9ecc-4dba884fc604 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:11.811250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1096/2212] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:38:11 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:11.815796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad0522-4834-4b9c-ab74-839bd6ee403a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:11.831543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad0522-4834-4b9c-ab74-839bd6ee403a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:11.881229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64362f7-3534-4813-9ecc-4dba884fc604 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:11.888706 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ecc9b-d369-44ac-a16b-93ab5fb4e0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:11.889754 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ecc9b-d369-44ac-a16b-93ab5fb4e0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:11.890091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ecc9b-d369-44ac-a16b-93ab5fb4e0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:11.890471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ecc9b-d369-44ac-a16b-93ab5fb4e0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:11.891428 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ecc9b-d369-44ac-a16b-93ab5fb4e0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:11.894857 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ecc9b-d369-44ac-a16b-93ab5fb4e0d8 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:11.900731 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79036d9-1c5d-4ae8-926c-1aaab82d0648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:11.901874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79036d9-1c5d-4ae8-926c-1aaab82d0648 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:11.905384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79036d9-1c5d-4ae8-926c-1aaab82d0648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:11.905384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79036d9-1c5d-4ae8-926c-1aaab82d0648 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:11.905384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79036d9-1c5d-4ae8-926c-1aaab82d0648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:11.906169 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79036d9-1c5d-4ae8-926c-1aaab82d0648 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:11.908931 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1117/2213] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:11.913141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ecc9b-d369-44ac-a16b-93ab5fb4e0d8 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:11.923439 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ecc9b-d369-44ac-a16b-93ab5fb4e0d8 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:11.928382 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c462b9-3665-449d-8e5d-28b95bfbb69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:11.929062 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c462b9-3665-449d-8e5d-28b95bfbb69e admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:11.929351 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c462b9-3665-449d-8e5d-28b95bfbb69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:11.929637 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c462b9-3665-449d-8e5d-28b95bfbb69e admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:11.930412 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c462b9-3665-449d-8e5d-28b95bfbb69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:11.932023 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c462b9-3665-449d-8e5d-28b95bfbb69e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:11.942486 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1118/2214] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:11.943912 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c462b9-3665-449d-8e5d-28b95bfbb69e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:11.954019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c462b9-3665-449d-8e5d-28b95bfbb69e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:11.958834 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb1947-077b-4bb9-8fbc-d825399f4382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:11.959781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb1947-077b-4bb9-8fbc-d825399f4382 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:11.960066 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb1947-077b-4bb9-8fbc-d825399f4382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:11.960346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb1947-077b-4bb9-8fbc-d825399f4382 admin admin] PATH_INFO: `/v3/projects/bcf9e5856d0f4ead91b3510568d6a11d/users/8ecba3511a784b57a4dd069498b80b0e/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:11.976391 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb1947-077b-4bb9-8fbc-d825399f4382 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf9e5856d0f4ead91b3510568d6a11d, user_id=8ecba3511a784b57a4dd069498b80b0e, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:11.979244 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb1947-077b-4bb9-8fbc-d825399f4382 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:12.048884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1097/2215] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:38:11 2022] POST /identity/v3/users => generated 305 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:12.053793 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79036d9-1c5d-4ae8-926c-1aaab82d0648 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:12.064384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79036d9-1c5d-4ae8-926c-1aaab82d0648 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:12.071316 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69fe09-271c-4884-9cdc-f246c41a4c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:12.072239 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69fe09-271c-4884-9cdc-f246c41a4c6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:12.072590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69fe09-271c-4884-9cdc-f246c41a4c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:12.072899 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69fe09-271c-4884-9cdc-f246c41a4c6f admin admin] PATH_INFO: `/v3/projects/21a1f2ef37f1445ea90a61f09346fc85/users/b2f065b55dd54dbbb78dbf4091af5494/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:12.090974 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69fe09-271c-4884-9cdc-f246c41a4c6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=21a1f2ef37f1445ea90a61f09346fc85, user_id=b2f065b55dd54dbbb78dbf4091af5494, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:12.093879 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69fe09-271c-4884-9cdc-f246c41a4c6f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:12.106328 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1119/2216] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:11 2022] PUT /identity/v3/projects/bcf9e5856d0f4ead91b3510568d6a11d/users/8ecba3511a784b57a4dd069498b80b0e/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:12.108712 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb1947-077b-4bb9-8fbc-d825399f4382 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:12.190299 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb1947-077b-4bb9-8fbc-d825399f4382 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:12.198181 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1098/2217] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:12 2022] PUT /identity/v3/projects/21a1f2ef37f1445ea90a61f09346fc85/users/b2f065b55dd54dbbb78dbf4091af5494/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:12.199537 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef10de-c233-4891-879d-5960cbd68bc4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:12.199829 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef10de-c233-4891-879d-5960cbd68bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:12.200110 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef10de-c233-4891-879d-5960cbd68bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:12.252488 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-60ef10de-c233-4891-879d-5960cbd68bc4 None None] MFA Rules not processed for user `8ecba3511a784b57a4dd069498b80b0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:12.254708 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-60ef10de-c233-4891-879d-5960cbd68bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:12.292226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385869f-ede4-49e5-8423-25c5dc174a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:12.292923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385869f-ede4-49e5-8423-25c5dc174a05 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:12.293243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385869f-ede4-49e5-8423-25c5dc174a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:12.293559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385869f-ede4-49e5-8423-25c5dc174a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:12.294302 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385869f-ede4-49e5-8423-25c5dc174a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:12.296063 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385869f-ede4-49e5-8423-25c5dc174a05 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:12.310673 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1120/2218] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:12.311680 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385869f-ede4-49e5-8423-25c5dc174a05 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:12.322115 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385869f-ede4-49e5-8423-25c5dc174a05 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:12.326964 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd55a4-087b-459f-babe-0e9a94c7a1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:12.327646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd55a4-087b-459f-babe-0e9a94c7a1f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:12.327953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd55a4-087b-459f-babe-0e9a94c7a1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:12.328214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd55a4-087b-459f-babe-0e9a94c7a1f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:12.328937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd55a4-087b-459f-babe-0e9a94c7a1f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:12.330579 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cd55a4-087b-459f-babe-0e9a94c7a1f6 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:12.336892 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1099/2219] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:12.337876 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef10de-c233-4891-879d-5960cbd68bc4 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:12.343544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1121/2220] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:12.347233 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd55a4-087b-459f-babe-0e9a94c7a1f6 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:12.353534 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef10de-c233-4891-879d-5960cbd68bc4 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:12.358331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d65b4-f9c0-4884-b7b4-4c363e8fbe42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:12.359391 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd55a4-087b-459f-babe-0e9a94c7a1f6 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:12.359511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d65b4-f9c0-4884-b7b4-4c363e8fbe42 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:12.359622 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d65b4-f9c0-4884-b7b4-4c363e8fbe42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:12.359814 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d65b4-f9c0-4884-b7b4-4c363e8fbe42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:12.360541 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d65b4-f9c0-4884-b7b4-4c363e8fbe42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:12.362195 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d65b4-f9c0-4884-b7b4-4c363e8fbe42 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:12.363982 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd16484-18a4-40f0-a0b1-769c6bc450d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:12.364937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd16484-18a4-40f0-a0b1-769c6bc450d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:12.365228 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd16484-18a4-40f0-a0b1-769c6bc450d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:12.365509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd16484-18a4-40f0-a0b1-769c6bc450d3 admin admin] PATH_INFO: `/v3/projects/21a1f2ef37f1445ea90a61f09346fc85/users/b2f065b55dd54dbbb78dbf4091af5494/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:12.367666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd16484-18a4-40f0-a0b1-769c6bc450d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21a1f2ef37f1445ea90a61f09346fc85, user_id=b2f065b55dd54dbbb78dbf4091af5494, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:12.370402 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd16484-18a4-40f0-a0b1-769c6bc450d3 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:12.372938 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1100/2221] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:12.373843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d65b4-f9c0-4884-b7b4-4c363e8fbe42 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:12.375560 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0a8d65b4-f9c0-4884-b7b4-4c363e8fbe42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:12.392515 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1122/2222] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:12 2022] PUT /identity/v3/projects/21a1f2ef37f1445ea90a61f09346fc85/users/b2f065b55dd54dbbb78dbf4091af5494/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:38:12.393387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd16484-18a4-40f0-a0b1-769c6bc450d3 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:12.452554 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d65b4-f9c0-4884-b7b4-4c363e8fbe42 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:12.460513 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd16484-18a4-40f0-a0b1-769c6bc450d3 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:12.465535 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c42a7-c2ca-4284-b1be-0b466fd54c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:12.466474 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c42a7-c2ca-4284-b1be-0b466fd54c5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:12.466903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c42a7-c2ca-4284-b1be-0b466fd54c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:12.467195 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c42a7-c2ca-4284-b1be-0b466fd54c5d admin admin] PATH_INFO: `/v3/projects/d56e0564e6064dddbb02f215c24d3e19/users/8ca3f44b5f5646759f18600fd54ac40e/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:12.500531 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c42a7-c2ca-4284-b1be-0b466fd54c5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d56e0564e6064dddbb02f215c24d3e19, user_id=8ca3f44b5f5646759f18600fd54ac40e, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:12.503930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1c42a7-c2ca-4284-b1be-0b466fd54c5d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:12.519343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b0e9bf-f375-47d8-b628-d54167d40a34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:12.520018 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0e9bf-f375-47d8-b628-d54167d40a34 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:12.522496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0e9bf-f375-47d8-b628-d54167d40a34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:12.523708 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b0e9bf-f375-47d8-b628-d54167d40a34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:12.585680 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1123/2223] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:12 2022] PUT /identity/v3/projects/d56e0564e6064dddbb02f215c24d3e19/users/8ca3f44b5f5646759f18600fd54ac40e/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:12.587024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ff7ce-ed1d-4d77-adc9-c2a385b56680 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:12.587451 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ff7ce-ed1d-4d77-adc9-c2a385b56680 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:12.587736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ff7ce-ed1d-4d77-adc9-c2a385b56680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:12.615248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0e9bf-f375-47d8-b628-d54167d40a34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:12.616898 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b0e9bf-f375-47d8-b628-d54167d40a34 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:12.627003 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-525ff7ce-ed1d-4d77-adc9-c2a385b56680 None None] MFA Rules not processed for user `b2f065b55dd54dbbb78dbf4091af5494`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:12.628562 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-525ff7ce-ed1d-4d77-adc9-c2a385b56680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:12.631607 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1101/2224] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:12.634209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9247ff1-ba01-4239-ac7e-d208154a6662 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:12.634209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9247ff1-ba01-4239-ac7e-d208154a6662 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:12.634889 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9247ff1-ba01-4239-ac7e-d208154a6662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:12.681052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b9247ff1-ba01-4239-ac7e-d208154a6662 None None] MFA Rules not processed for user `8ca3f44b5f5646759f18600fd54ac40e`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:12.683191 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b9247ff1-ba01-4239-ac7e-d208154a6662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:12.777634 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1124/2225] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:12 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:12.800797 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ff7ce-ed1d-4d77-adc9-c2a385b56680 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:12.812928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1102/2226] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:12 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:12.819769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9247ff1-ba01-4239-ac7e-d208154a6662 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:12.893840 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ff7ce-ed1d-4d77-adc9-c2a385b56680 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:12.903040 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1071c-8d44-439b-a5eb-fff953dfbc7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:12.904026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1071c-8d44-439b-a5eb-fff953dfbc7e service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:12.904142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1071c-8d44-439b-a5eb-fff953dfbc7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:12.904430 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1071c-8d44-439b-a5eb-fff953dfbc7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:12.928435 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1071c-8d44-439b-a5eb-fff953dfbc7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:12.930138 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1071c-8d44-439b-a5eb-fff953dfbc7e service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:12.950585 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1125/2227] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:12 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:12.972921 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9247ff1-ba01-4239-ac7e-d208154a6662 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:12.981296 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597729c4-55c5-45ac-8474-c32474b5e160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:12.982201 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597729c4-55c5-45ac-8474-c32474b5e160 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:12.982494 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597729c4-55c5-45ac-8474-c32474b5e160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:12.983518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597729c4-55c5-45ac-8474-c32474b5e160 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:12.984497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597729c4-55c5-45ac-8474-c32474b5e160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:12.987347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597729c4-55c5-45ac-8474-c32474b5e160 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:13.112498 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1103/2228] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:38:12 2022] POST /identity/v3/projects => generated 409 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:38:13.120560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1071c-8d44-439b-a5eb-fff953dfbc7e service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:13.143868 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1071c-8d44-439b-a5eb-fff953dfbc7e service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:13.241116 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058bd80-39d6-4d8a-91d8-0d72fa4c0e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:13.242129 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058bd80-39d6-4d8a-91d8-0d72fa4c0e61 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:13.242457 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058bd80-39d6-4d8a-91d8-0d72fa4c0e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:13.242724 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058bd80-39d6-4d8a-91d8-0d72fa4c0e61 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:13.243503 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058bd80-39d6-4d8a-91d8-0d72fa4c0e61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:13.245682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058bd80-39d6-4d8a-91d8-0d72fa4c0e61 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:13.428442 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597729c4-55c5-45ac-8474-c32474b5e160 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:13.468885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1126/2229] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:38:13 2022] POST /identity/v3/users => generated 311 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:13.468885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a1d2a-3b63-4c6f-9240-e19d4b5767f0 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:13.469109 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a1d2a-3b63-4c6f-9240-e19d4b5767f0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:13.469490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a1d2a-3b63-4c6f-9240-e19d4b5767f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:13.493249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-530a1d2a-3b63-4c6f-9240-e19d4b5767f0 None None] MFA Rules not processed for user `d9ac86461ecd4e6baa6b11fe869e8a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:13.495424 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-530a1d2a-3b63-4c6f-9240-e19d4b5767f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:13.501974 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:13.539822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597729c4-55c5-45ac-8474-c32474b5e160 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:13.546847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32764bbe-0b87-4feb-9101-fd92bcc58d5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:13.548083 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32764bbe-0b87-4feb-9101-fd92bcc58d5f service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:13.548741 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32764bbe-0b87-4feb-9101-fd92bcc58d5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:13.549169 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32764bbe-0b87-4feb-9101-fd92bcc58d5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:13.577439 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1127/2230] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:13.582508 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a1d2a-3b63-4c6f-9240-e19d4b5767f0 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:13.613146 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a1d2a-3b63-4c6f-9240-e19d4b5767f0 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:13.638799 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b2e55-18e1-4451-8435-955c37df861b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:13.639276 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b2e55-18e1-4451-8435-955c37df861b admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:13.639414 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b2e55-18e1-4451-8435-955c37df861b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:13.639685 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b2e55-18e1-4451-8435-955c37df861b admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:13.640436 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b2e55-18e1-4451-8435-955c37df861b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:13.647765 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74b2e55-18e1-4451-8435-955c37df861b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:13.673467 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32764bbe-0b87-4feb-9101-fd92bcc58d5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:13.674976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32764bbe-0b87-4feb-9101-fd92bcc58d5f service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:13.681071 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1128/2231] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:13.687059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b2e55-18e1-4451-8435-955c37df861b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:13.723232 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74b2e55-18e1-4451-8435-955c37df861b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:13.725945 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1104/2232] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:13.742059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd81e7e-30d8-4b14-b347-2a619e0afb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:13.743717 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd81e7e-30d8-4b14-b347-2a619e0afb65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:13.744189 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd81e7e-30d8-4b14-b347-2a619e0afb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:13.746507 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd81e7e-30d8-4b14-b347-2a619e0afb65 admin admin] PATH_INFO: `/v3/projects/20487799bfb4432e806d92e331d16f35/users/66501799a4724c518104f81c2932445b/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:13.769742 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd81e7e-30d8-4b14-b347-2a619e0afb65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20487799bfb4432e806d92e331d16f35, user_id=66501799a4724c518104f81c2932445b, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:13.774873 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd81e7e-30d8-4b14-b347-2a619e0afb65 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:13.857259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1129/2233] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:13 2022] PUT /identity/v3/projects/20487799bfb4432e806d92e331d16f35/users/66501799a4724c518104f81c2932445b/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:13.857955 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32764bbe-0b87-4feb-9101-fd92bcc58d5f service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:13.881108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32764bbe-0b87-4feb-9101-fd92bcc58d5f service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:13.950249 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30283eb5-17e5-46a9-a444-25ee03d361d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:13.951100 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30283eb5-17e5-46a9-a444-25ee03d361d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:13.951400 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30283eb5-17e5-46a9-a444-25ee03d361d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:13.951713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30283eb5-17e5-46a9-a444-25ee03d361d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:13.952869 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30283eb5-17e5-46a9-a444-25ee03d361d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:13.954797 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30283eb5-17e5-46a9-a444-25ee03d361d0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:13.985213 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1105/2234] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:13.986553 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd81e7e-30d8-4b14-b347-2a619e0afb65 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:14.006858 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd81e7e-30d8-4b14-b347-2a619e0afb65 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:14.012530 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce7f94-2e4e-4f81-87f1-563b47c9980b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:14.014541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce7f94-2e4e-4f81-87f1-563b47c9980b admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:14.014828 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce7f94-2e4e-4f81-87f1-563b47c9980b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:14.015156 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce7f94-2e4e-4f81-87f1-563b47c9980b admin admin] PATH_INFO: `/v3/projects/20487799bfb4432e806d92e331d16f35/users/66501799a4724c518104f81c2932445b/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:14.017477 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce7f94-2e4e-4f81-87f1-563b47c9980b admin admin] RBAC: Authorizing `identity:create_grant(project_id=20487799bfb4432e806d92e331d16f35, user_id=66501799a4724c518104f81c2932445b, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:14.033825 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce7f94-2e4e-4f81-87f1-563b47c9980b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:14.038596 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1130/2235] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:13 2022] PUT /identity/v3/projects/20487799bfb4432e806d92e331d16f35/users/66501799a4724c518104f81c2932445b/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:14.049075 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a9c71-8d1b-45d6-87b2-2bdf519325b8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:14.049370 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a9c71-8d1b-45d6-87b2-2bdf519325b8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:14.049660 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a9c71-8d1b-45d6-87b2-2bdf519325b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:14.083282 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-174a9c71-8d1b-45d6-87b2-2bdf519325b8 None None] MFA Rules not processed for user `66501799a4724c518104f81c2932445b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:14.084708 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-174a9c71-8d1b-45d6-87b2-2bdf519325b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:14.186735 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1106/2236] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:14 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:38:14.595281 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce7f94-2e4e-4f81-87f1-563b47c9980b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:14.713319 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce7f94-2e4e-4f81-87f1-563b47c9980b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:14.717510 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6dcac-9caf-45e6-97f1-1c02f2466fa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:14.718390 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6dcac-9caf-45e6-97f1-1c02f2466fa5 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:14.718747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6dcac-9caf-45e6-97f1-1c02f2466fa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:14.719099 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6dcac-9caf-45e6-97f1-1c02f2466fa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:14.730168 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6dcac-9caf-45e6-97f1-1c02f2466fa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:14.732877 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f6dcac-9caf-45e6-97f1-1c02f2466fa5 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:14.745097 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1131/2237] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:14 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:14.776451 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4ee08-4249-4432-85c6-6d6b8bfc9c5f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:14.777030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4ee08-4249-4432-85c6-6d6b8bfc9c5f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:14.777030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4ee08-4249-4432-85c6-6d6b8bfc9c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:14.804686 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-32e4ee08-4249-4432-85c6-6d6b8bfc9c5f None None] MFA Rules not processed for user `2109160a00894044a5d07516ab1aed2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:14.804686 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-32e4ee08-4249-4432-85c6-6d6b8bfc9c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:14.893807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1107/2238] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:15.459279 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6dcac-9caf-45e6-97f1-1c02f2466fa5 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:15.460882 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-59f6dcac-9caf-45e6-97f1-1c02f2466fa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:15.484515 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6dcac-9caf-45e6-97f1-1c02f2466fa5 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:15.490059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d1085-30a4-4d3b-bab7-5ae5f5c8cea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:15.491289 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d1085-30a4-4d3b-bab7-5ae5f5c8cea2 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:15.491720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d1085-30a4-4d3b-bab7-5ae5f5c8cea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:15.492160 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d1085-30a4-4d3b-bab7-5ae5f5c8cea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:15.494215 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-188d1085-30a4-4d3b-bab7-5ae5f5c8cea2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:15.527614 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4ee08-4249-4432-85c6-6d6b8bfc9c5f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:15.540494 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4ee08-4249-4432-85c6-6d6b8bfc9c5f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:15.551529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e11bb-3f58-41e3-9f3f-b6f7db978512 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:15.553029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e11bb-3f58-41e3-9f3f-b6f7db978512 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:15.553680 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e11bb-3f58-41e3-9f3f-b6f7db978512 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:15.554087 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e11bb-3f58-41e3-9f3f-b6f7db978512 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:15.593119 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d1085-30a4-4d3b-bab7-5ae5f5c8cea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:15.598108 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d1085-30a4-4d3b-bab7-5ae5f5c8cea2 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:15.621336 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1132/2239] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:15 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:15.648910 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e11bb-3f58-41e3-9f3f-b6f7db978512 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:15.650629 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e11bb-3f58-41e3-9f3f-b6f7db978512 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:15.674916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1108/2240] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:15 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:15.847638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:17.453147 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:18.725200 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:20.367138 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:21.677368 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:22.058946 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:22.120523 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d1085-30a4-4d3b-bab7-5ae5f5c8cea2 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:22.243797 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d1085-30a4-4d3b-bab7-5ae5f5c8cea2 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:22.263305 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4832f-efe6-44ce-92bb-be872813eb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:22.266424 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4832f-efe6-44ce-92bb-be872813eb34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:22.270720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4832f-efe6-44ce-92bb-be872813eb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:22.271295 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff4832f-efe6-44ce-92bb-be872813eb34 admin admin] PATH_INFO: `/v3/users/ebeca74eeb9c4e4f92a099f8863103c4` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:22.275569 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4832f-efe6-44ce-92bb-be872813eb34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebeca74eeb9c4e4f92a099f8863103c4)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:22.278020 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff4832f-efe6-44ce-92bb-be872813eb34 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:22.622604 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-cff4832f-efe6-44ce-92bb-be872813eb34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebeca74eeb9c4e4f92a099f8863103c4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:22.625071 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-cff4832f-efe6-44ce-92bb-be872813eb34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebeca74eeb9c4e4f92a099f8863103c4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:22.625746 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-cff4832f-efe6-44ce-92bb-be872813eb34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebeca74eeb9c4e4f92a099f8863103c4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:22.667794 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-cff4832f-efe6-44ce-92bb-be872813eb34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebeca74eeb9c4e4f92a099f8863103c4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:22.684225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-cff4832f-efe6-44ce-92bb-be872813eb34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebeca74eeb9c4e4f92a099f8863103c4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:22.781754 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1133/2241] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:38:22 2022] DELETE /identity/v3/users/ebeca74eeb9c4e4f92a099f8863103c4 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:22.784011 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd71b98-c046-41de-a47d-01a63215fad1 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:22.784640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd71b98-c046-41de-a47d-01a63215fad1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:22.784640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd71b98-c046-41de-a47d-01a63215fad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:22.805343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-3dd71b98-c046-41de-a47d-01a63215fad1 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:22.806862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3dd71b98-c046-41de-a47d-01a63215fad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:22.885913 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1109/2242] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:22.897316 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4832f-efe6-44ce-92bb-be872813eb34 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:22.899671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cff4832f-efe6-44ce-92bb-be872813eb34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:22.994554 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff4832f-efe6-44ce-92bb-be872813eb34 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:22.999804 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45959468-11e4-461e-8689-34d8336c5b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:23.000462 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45959468-11e4-461e-8689-34d8336c5b1c service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:23.003278 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45959468-11e4-461e-8689-34d8336c5b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:23.003278 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45959468-11e4-461e-8689-34d8336c5b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:23.014411 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45959468-11e4-461e-8689-34d8336c5b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:23.016276 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45959468-11e4-461e-8689-34d8336c5b1c service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:23.028866 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1134/2243] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:23.618334 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:23.860130 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd71b98-c046-41de-a47d-01a63215fad1 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:23.861775 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3dd71b98-c046-41de-a47d-01a63215fad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:23.886828 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd71b98-c046-41de-a47d-01a63215fad1 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:23.894862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb68faa-2f15-4517-80e0-3678647799ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:23.896789 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb68faa-2f15-4517-80e0-3678647799ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:23.898207 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb68faa-2f15-4517-80e0-3678647799ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:23.899770 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb68faa-2f15-4517-80e0-3678647799ca admin admin] PATH_INFO: `/v3/projects/6c609fc2336b427d9f22cc0d9ff63388` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:23.912105 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb68faa-2f15-4517-80e0-3678647799ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c609fc2336b427d9f22cc0d9ff63388)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:23.912105 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb68faa-2f15-4517-80e0-3678647799ca admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:24.064157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7eb68faa-2f15-4517-80e0-3678647799ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c609fc2336b427d9f22cc0d9ff63388', 'request_id': 'req-7eb68faa-2f15-4517-80e0-3678647799ca'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:24.071528 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7eb68faa-2f15-4517-80e0-3678647799ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c609fc2336b427d9f22cc0d9ff63388', 'request_id': 'req-7eb68faa-2f15-4517-80e0-3678647799ca'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:24.080179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7eb68faa-2f15-4517-80e0-3678647799ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c609fc2336b427d9f22cc0d9ff63388', 'request_id': 'req-7eb68faa-2f15-4517-80e0-3678647799ca'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:24.141094 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:24.203890 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7eb68faa-2f15-4517-80e0-3678647799ca admin admin] The token cache is being invalidate because project 6c609fc2336b427d9f22cc0d9ff63388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:24.204215 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7eb68faa-2f15-4517-80e0-3678647799ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:24.204922 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-7eb68faa-2f15-4517-80e0-3678647799ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:24.206984 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1110/2244] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:23 2022] DELETE /identity/v3/projects/6c609fc2336b427d9f22cc0d9ff63388 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:38:24.211770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45959468-11e4-461e-8689-34d8336c5b1c service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:24.222730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45959468-11e4-461e-8689-34d8336c5b1c service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:24.326823 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9922f-6c8d-4bbc-816a-fc1908d1029e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:24.330309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9922f-6c8d-4bbc-816a-fc1908d1029e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:24.330737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9922f-6c8d-4bbc-816a-fc1908d1029e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:24.331966 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9922f-6c8d-4bbc-816a-fc1908d1029e admin admin] PATH_INFO: `/v3/users/b2f065b55dd54dbbb78dbf4091af5494` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:24.334225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9922f-6c8d-4bbc-816a-fc1908d1029e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f065b55dd54dbbb78dbf4091af5494)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:24.339383 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9922f-6c8d-4bbc-816a-fc1908d1029e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:24.355075 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb68faa-2f15-4517-80e0-3678647799ca admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:24.356725 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7eb68faa-2f15-4517-80e0-3678647799ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:24.387544 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb68faa-2f15-4517-80e0-3678647799ca admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:24.403309 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36222e5a-cd1f-4198-97d1-8fac8a518492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:24.404512 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36222e5a-cd1f-4198-97d1-8fac8a518492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:24.405003 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36222e5a-cd1f-4198-97d1-8fac8a518492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:24.405392 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36222e5a-cd1f-4198-97d1-8fac8a518492 admin admin] PATH_INFO: `/v3/users/8ca3f44b5f5646759f18600fd54ac40e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:24.406844 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36222e5a-cd1f-4198-97d1-8fac8a518492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ca3f44b5f5646759f18600fd54ac40e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:24.409233 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36222e5a-cd1f-4198-97d1-8fac8a518492 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:24.608822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6bf9922f-6c8d-4bbc-816a-fc1908d1029e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f065b55dd54dbbb78dbf4091af5494'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:24.609657 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6bf9922f-6c8d-4bbc-816a-fc1908d1029e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f065b55dd54dbbb78dbf4091af5494'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:24.610316 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6bf9922f-6c8d-4bbc-816a-fc1908d1029e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f065b55dd54dbbb78dbf4091af5494'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:24.625032 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6bf9922f-6c8d-4bbc-816a-fc1908d1029e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f065b55dd54dbbb78dbf4091af5494'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:24.637930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-6bf9922f-6c8d-4bbc-816a-fc1908d1029e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f065b55dd54dbbb78dbf4091af5494'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:24.675346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36222e5a-cd1f-4198-97d1-8fac8a518492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ca3f44b5f5646759f18600fd54ac40e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:24.691525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36222e5a-cd1f-4198-97d1-8fac8a518492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ca3f44b5f5646759f18600fd54ac40e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:24.691525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36222e5a-cd1f-4198-97d1-8fac8a518492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ca3f44b5f5646759f18600fd54ac40e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:24.711584 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36222e5a-cd1f-4198-97d1-8fac8a518492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ca3f44b5f5646759f18600fd54ac40e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:24.731545 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1135/2245] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:38:24 2022] DELETE /identity/v3/users/b2f065b55dd54dbbb78dbf4091af5494 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:24.809395 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36222e5a-cd1f-4198-97d1-8fac8a518492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ca3f44b5f5646759f18600fd54ac40e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:24.829377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1111/2246] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:38:24 2022] DELETE /identity/v3/users/8ca3f44b5f5646759f18600fd54ac40e => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:38:24.834148 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac7035-ced0-4fb3-94e1-32bfdd722849 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:24.834547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac7035-ced0-4fb3-94e1-32bfdd722849 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:24.834937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac7035-ced0-4fb3-94e1-32bfdd722849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:24.854685 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-2eac7035-ced0-4fb3-94e1-32bfdd722849 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:24.856045 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2eac7035-ced0-4fb3-94e1-32bfdd722849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:24.924414 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1136/2247] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:24.934960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36222e5a-cd1f-4198-97d1-8fac8a518492 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:24.939877 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-36222e5a-cd1f-4198-97d1-8fac8a518492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:25.036083 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36222e5a-cd1f-4198-97d1-8fac8a518492 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:25.047813 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68101c75-66fb-454b-9651-bfbf45335080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:25.049192 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68101c75-66fb-454b-9651-bfbf45335080 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:25.052186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68101c75-66fb-454b-9651-bfbf45335080 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:25.053787 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68101c75-66fb-454b-9651-bfbf45335080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:25.083149 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68101c75-66fb-454b-9651-bfbf45335080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:25.084918 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68101c75-66fb-454b-9651-bfbf45335080 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:25.100957 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1112/2248] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:25.475278 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac7035-ced0-4fb3-94e1-32bfdd722849 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:25.477306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2eac7035-ced0-4fb3-94e1-32bfdd722849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:25.497123 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac7035-ced0-4fb3-94e1-32bfdd722849 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:25.513633 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe1ae8c-3872-4112-8fa2-3d15fef8a928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:25.514582 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1ae8c-3872-4112-8fa2-3d15fef8a928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:25.514870 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1ae8c-3872-4112-8fa2-3d15fef8a928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:25.515146 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe1ae8c-3872-4112-8fa2-3d15fef8a928 admin admin] PATH_INFO: `/v3/projects/21a1f2ef37f1445ea90a61f09346fc85` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:25.516554 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1ae8c-3872-4112-8fa2-3d15fef8a928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21a1f2ef37f1445ea90a61f09346fc85)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:25.519105 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe1ae8c-3872-4112-8fa2-3d15fef8a928 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:25.669182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1fe1ae8c-3872-4112-8fa2-3d15fef8a928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21a1f2ef37f1445ea90a61f09346fc85', 'request_id': 'req-1fe1ae8c-3872-4112-8fa2-3d15fef8a928'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:25.675585 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1fe1ae8c-3872-4112-8fa2-3d15fef8a928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21a1f2ef37f1445ea90a61f09346fc85', 'request_id': 'req-1fe1ae8c-3872-4112-8fa2-3d15fef8a928'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:25.682749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1fe1ae8c-3872-4112-8fa2-3d15fef8a928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21a1f2ef37f1445ea90a61f09346fc85', 'request_id': 'req-1fe1ae8c-3872-4112-8fa2-3d15fef8a928'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:25.787247 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68101c75-66fb-454b-9651-bfbf45335080 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:25.788769 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-68101c75-66fb-454b-9651-bfbf45335080 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:25.806092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68101c75-66fb-454b-9651-bfbf45335080 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:25.823326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1fe1ae8c-3872-4112-8fa2-3d15fef8a928 admin admin] The token cache is being invalidate because project 21a1f2ef37f1445ea90a61f09346fc85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:25.824154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1fe1ae8c-3872-4112-8fa2-3d15fef8a928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:25.824899 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1fe1ae8c-3872-4112-8fa2-3d15fef8a928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:25.829920 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1137/2249] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:25 2022] DELETE /identity/v3/projects/21a1f2ef37f1445ea90a61f09346fc85 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:25.836492 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f6057-5d79-48d5-9eea-ccc4f6f3f2c3 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:25.837094 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f6057-5d79-48d5-9eea-ccc4f6f3f2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:25.837536 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3f6057-5d79-48d5-9eea-ccc4f6f3f2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:25.863053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9c3f6057-5d79-48d5-9eea-ccc4f6f3f2c3 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:25.864320 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9c3f6057-5d79-48d5-9eea-ccc4f6f3f2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:25.887911 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a95733-a906-4357-ad5d-38ff3031ea42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:25.888881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a95733-a906-4357-ad5d-38ff3031ea42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:25.889243 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a95733-a906-4357-ad5d-38ff3031ea42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:25.889598 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a95733-a906-4357-ad5d-38ff3031ea42 admin admin] PATH_INFO: `/v3/projects/d56e0564e6064dddbb02f215c24d3e19` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:25.890901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a95733-a906-4357-ad5d-38ff3031ea42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d56e0564e6064dddbb02f215c24d3e19)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:25.892822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a95733-a906-4357-ad5d-38ff3031ea42 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:25.932536 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1138/2250] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:25.940142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e6488-e366-42e7-9b51-b266fee1623e None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:25.940436 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e6488-e366-42e7-9b51-b266fee1623e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:25.940718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e6488-e366-42e7-9b51-b266fee1623e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:25.961644 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-592e6488-e366-42e7-9b51-b266fee1623e None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:25.962934 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-592e6488-e366-42e7-9b51-b266fee1623e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:25.975692 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1139/2251] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:38:25.989358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e6488-e366-42e7-9b51-b266fee1623e None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:26.000037 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e6488-e366-42e7-9b51-b266fee1623e None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:26.005835 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e123ae6-0717-4420-9590-ac64526ab881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:26.006548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e123ae6-0717-4420-9590-ac64526ab881 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:26.006974 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e123ae6-0717-4420-9590-ac64526ab881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:26.007178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e123ae6-0717-4420-9590-ac64526ab881 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:26.007930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e123ae6-0717-4420-9590-ac64526ab881 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:38:26.008247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e123ae6-0717-4420-9590-ac64526ab881 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:26.010221 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e123ae6-0717-4420-9590-ac64526ab881 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:26.033231 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1140/2252] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:38:26.037962 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e123ae6-0717-4420-9590-ac64526ab881 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:26.048882 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e123ae6-0717-4420-9590-ac64526ab881 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:26.067701 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a1a95733-a906-4357-ad5d-38ff3031ea42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd56e0564e6064dddbb02f215c24d3e19', 'request_id': 'req-a1a95733-a906-4357-ad5d-38ff3031ea42'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:26.078097 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a1a95733-a906-4357-ad5d-38ff3031ea42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd56e0564e6064dddbb02f215c24d3e19', 'request_id': 'req-a1a95733-a906-4357-ad5d-38ff3031ea42'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:26.086386 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a1a95733-a906-4357-ad5d-38ff3031ea42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd56e0564e6064dddbb02f215c24d3e19', 'request_id': 'req-a1a95733-a906-4357-ad5d-38ff3031ea42'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:26.115248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e0fd3-fd63-4871-8346-ecd2153596ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:26.115919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e0fd3-fd63-4871-8346-ecd2153596ce admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:26.116208 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e0fd3-fd63-4871-8346-ecd2153596ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:26.116529 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e0fd3-fd63-4871-8346-ecd2153596ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:26.117211 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e0fd3-fd63-4871-8346-ecd2153596ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:26.119192 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e0fd3-fd63-4871-8346-ecd2153596ce admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:26.163852 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a1a95733-a906-4357-ad5d-38ff3031ea42 admin admin] The token cache is being invalidate because project d56e0564e6064dddbb02f215c24d3e19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:26.164808 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a1a95733-a906-4357-ad5d-38ff3031ea42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:26.170096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a1a95733-a906-4357-ad5d-38ff3031ea42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:26.175869 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1113/2253] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:25 2022] DELETE /identity/v3/projects/d56e0564e6064dddbb02f215c24d3e19 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:26.178968 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a95733-a906-4357-ad5d-38ff3031ea42 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:26.180447 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a1a95733-a906-4357-ad5d-38ff3031ea42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:26.211477 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a95733-a906-4357-ad5d-38ff3031ea42 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:26.232287 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3f61f-205b-4b6f-b02e-8167091fa821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:26.233253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3f61f-205b-4b6f-b02e-8167091fa821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:26.233594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3f61f-205b-4b6f-b02e-8167091fa821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:26.233917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3f61f-205b-4b6f-b02e-8167091fa821 admin admin] PATH_INFO: `/v3/users/66501799a4724c518104f81c2932445b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:26.235219 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3f61f-205b-4b6f-b02e-8167091fa821 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66501799a4724c518104f81c2932445b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:26.237242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3f61f-205b-4b6f-b02e-8167091fa821 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:26.268816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1141/2254] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:38:26 2022] POST /identity/v3/projects => generated 387 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:38:26.273101 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e0fd3-fd63-4871-8346-ecd2153596ce admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:26.275372 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ce1e0fd3-fd63-4871-8346-ecd2153596ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:26.353452 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e0fd3-fd63-4871-8346-ecd2153596ce admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:26.359428 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03634b-98b1-4144-8040-955999d5fb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:26.360149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03634b-98b1-4144-8040-955999d5fb21 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:26.361198 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03634b-98b1-4144-8040-955999d5fb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:26.361198 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03634b-98b1-4144-8040-955999d5fb21 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:26.361574 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03634b-98b1-4144-8040-955999d5fb21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:26.363678 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03634b-98b1-4144-8040-955999d5fb21 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:26.460920 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:26.573406 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1142/2255] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:38:26 2022] POST /identity/v3/users => generated 294 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:26.575514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03634b-98b1-4144-8040-955999d5fb21 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:26.582132 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-77b3f61f-205b-4b6f-b02e-8167091fa821 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66501799a4724c518104f81c2932445b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:26.583526 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-77b3f61f-205b-4b6f-b02e-8167091fa821 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66501799a4724c518104f81c2932445b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:26.584152 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-77b3f61f-205b-4b6f-b02e-8167091fa821 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66501799a4724c518104f81c2932445b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:26.587238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03634b-98b1-4144-8040-955999d5fb21 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:26.592570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c418fe-5cd8-41ed-99c2-43bffb00b0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:26.593273 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c418fe-5cd8-41ed-99c2-43bffb00b0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:26.593575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c418fe-5cd8-41ed-99c2-43bffb00b0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:26.593881 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c418fe-5cd8-41ed-99c2-43bffb00b0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:26.594634 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c418fe-5cd8-41ed-99c2-43bffb00b0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:26.596302 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c418fe-5cd8-41ed-99c2-43bffb00b0f8 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:26.600717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-77b3f61f-205b-4b6f-b02e-8167091fa821 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66501799a4724c518104f81c2932445b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:26.607849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1143/2256] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:26.612247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c418fe-5cd8-41ed-99c2-43bffb00b0f8 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:26.614160 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-74c418fe-5cd8-41ed-99c2-43bffb00b0f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:26.627609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c418fe-5cd8-41ed-99c2-43bffb00b0f8 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:26.632902 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724788a-3738-440a-9351-822cd4878464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:26.633615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724788a-3738-440a-9351-822cd4878464 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:26.633950 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724788a-3738-440a-9351-822cd4878464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:26.634237 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724788a-3738-440a-9351-822cd4878464 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:26.635025 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724788a-3738-440a-9351-822cd4878464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:26.636873 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724788a-3738-440a-9351-822cd4878464 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:26.648940 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1144/2257] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:38:26.653380 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724788a-3738-440a-9351-822cd4878464 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:26.666978 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724788a-3738-440a-9351-822cd4878464 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:26.672128 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896fe17-f434-4f98-a567-0de67d5adf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:26.673065 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896fe17-f434-4f98-a567-0de67d5adf30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:26.673351 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896fe17-f434-4f98-a567-0de67d5adf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:26.673631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0896fe17-f434-4f98-a567-0de67d5adf30 admin admin] PATH_INFO: `/v3/projects/efff66c4d4cc4d3f8a8ddd446e0a125a/users/c52539e442794f09bada5f1e67a0b7bb/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:26.690803 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896fe17-f434-4f98-a567-0de67d5adf30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efff66c4d4cc4d3f8a8ddd446e0a125a, user_id=c52539e442794f09bada5f1e67a0b7bb, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:26.694250 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0896fe17-f434-4f98-a567-0de67d5adf30 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:26.723353 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-77b3f61f-205b-4b6f-b02e-8167091fa821 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66501799a4724c518104f81c2932445b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:26.738662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1114/2258] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:38:26 2022] DELETE /identity/v3/users/66501799a4724c518104f81c2932445b => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:38:26.851689 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1145/2259] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:26 2022] PUT /identity/v3/projects/efff66c4d4cc4d3f8a8ddd446e0a125a/users/c52539e442794f09bada5f1e67a0b7bb/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:38:26.870955 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cd362-27f0-4c70-950d-c42837c9b7d6 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:26.872844 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cd362-27f0-4c70-950d-c42837c9b7d6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:26.873412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cd362-27f0-4c70-950d-c42837c9b7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:26.912604 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ab2cd362-27f0-4c70-950d-c42837c9b7d6 None None] MFA Rules not processed for user `c52539e442794f09bada5f1e67a0b7bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:26.913475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ab2cd362-27f0-4c70-950d-c42837c9b7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:26.984784 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1115/2260] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:26.990028 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896fe17-f434-4f98-a567-0de67d5adf30 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:27.098770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0896fe17-f434-4f98-a567-0de67d5adf30 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:27.105946 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f34ee5-a0e6-4f55-9625-a41d829df6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:27.106633 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f34ee5-a0e6-4f55-9625-a41d829df6a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:27.106923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f34ee5-a0e6-4f55-9625-a41d829df6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:27.107204 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f34ee5-a0e6-4f55-9625-a41d829df6a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:27.107931 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f34ee5-a0e6-4f55-9625-a41d829df6a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:27.109928 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f34ee5-a0e6-4f55-9625-a41d829df6a6 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:27.251654 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1146/2261] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:38:26 2022] POST /identity/v3/projects => generated 385 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:27.253016 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cd362-27f0-4c70-950d-c42837c9b7d6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:27.264782 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2cd362-27f0-4c70-950d-c42837c9b7d6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:27.323335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe318622-fff8-4fc9-a072-46c32d8f020d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:27.324064 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe318622-fff8-4fc9-a072-46c32d8f020d admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:27.328476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe318622-fff8-4fc9-a072-46c32d8f020d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:27.328476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe318622-fff8-4fc9-a072-46c32d8f020d admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:27.328476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe318622-fff8-4fc9-a072-46c32d8f020d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:27.328476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe318622-fff8-4fc9-a072-46c32d8f020d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:27.362641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f34ee5-a0e6-4f55-9625-a41d829df6a6 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:27.364957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d3f34ee5-a0e6-4f55-9625-a41d829df6a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:27.377592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f34ee5-a0e6-4f55-9625-a41d829df6a6 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:27.382986 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768de0ad-3f09-4112-b20f-f3d95f985019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:27.383859 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768de0ad-3f09-4112-b20f-f3d95f985019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:27.384146 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768de0ad-3f09-4112-b20f-f3d95f985019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:27.384428 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768de0ad-3f09-4112-b20f-f3d95f985019 admin admin] PATH_INFO: `/v3/projects/20487799bfb4432e806d92e331d16f35` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:27.385614 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768de0ad-3f09-4112-b20f-f3d95f985019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20487799bfb4432e806d92e331d16f35)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:27.387643 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768de0ad-3f09-4112-b20f-f3d95f985019 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:27.484453 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1116/2262] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:38:27 2022] POST /identity/v3/users => generated 299 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:27.488560 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe318622-fff8-4fc9-a072-46c32d8f020d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:27.499173 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe318622-fff8-4fc9-a072-46c32d8f020d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:27.503972 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f026fd9-1155-4cef-ad34-bed4db5a1ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:27.504727 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f026fd9-1155-4cef-ad34-bed4db5a1ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:27.505020 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f026fd9-1155-4cef-ad34-bed4db5a1ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:27.505305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f026fd9-1155-4cef-ad34-bed4db5a1ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:27.506136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f026fd9-1155-4cef-ad34-bed4db5a1ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:27.507760 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f026fd9-1155-4cef-ad34-bed4db5a1ef9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:27.522588 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1117/2263] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:38:27.523514 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f026fd9-1155-4cef-ad34-bed4db5a1ef9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:27.533747 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f026fd9-1155-4cef-ad34-bed4db5a1ef9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:27.538083 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:27.541302 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737f833-6ccb-489a-a569-c1d582eb7436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:27.542967 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737f833-6ccb-489a-a569-c1d582eb7436 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:27.543478 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737f833-6ccb-489a-a569-c1d582eb7436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:27.543948 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f737f833-6ccb-489a-a569-c1d582eb7436 admin admin] PATH_INFO: `/v3/projects/7a47325c34ee45e192f718d4b71c5c3e/users/1b31ea448ab2422c9d7f9e8a0dd409f3/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:27.566883 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737f833-6ccb-489a-a569-c1d582eb7436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a47325c34ee45e192f718d4b71c5c3e, user_id=1b31ea448ab2422c9d7f9e8a0dd409f3, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:27.566883 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f737f833-6ccb-489a-a569-c1d582eb7436 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:27.571610 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-768de0ad-3f09-4112-b20f-f3d95f985019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20487799bfb4432e806d92e331d16f35', 'request_id': 'req-768de0ad-3f09-4112-b20f-f3d95f985019'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:27.577918 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-768de0ad-3f09-4112-b20f-f3d95f985019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20487799bfb4432e806d92e331d16f35', 'request_id': 'req-768de0ad-3f09-4112-b20f-f3d95f985019'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:27.587146 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-768de0ad-3f09-4112-b20f-f3d95f985019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20487799bfb4432e806d92e331d16f35', 'request_id': 'req-768de0ad-3f09-4112-b20f-f3d95f985019'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:27.658917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1118/2264] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:27 2022] PUT /identity/v3/projects/7a47325c34ee45e192f718d4b71c5c3e/users/1b31ea448ab2422c9d7f9e8a0dd409f3/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:27.662616 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737f833-6ccb-489a-a569-c1d582eb7436 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:27.721750 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-768de0ad-3f09-4112-b20f-f3d95f985019 admin admin] The token cache is being invalidate because project 20487799bfb4432e806d92e331d16f35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:27.722332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-768de0ad-3f09-4112-b20f-f3d95f985019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:27.722998 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-768de0ad-3f09-4112-b20f-f3d95f985019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:27.723487 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f737f833-6ccb-489a-a569-c1d582eb7436 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:27.724593 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1147/2265] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:27 2022] DELETE /identity/v3/projects/20487799bfb4432e806d92e331d16f35 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:38:27.728665 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fdade-6bc2-430f-ad35-a760d438910c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:27.729300 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d1149-bc7d-4e38-840f-9a9ecd8a2548 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:27.729457 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fdade-6bc2-430f-ad35-a760d438910c admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:27.729591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d1149-bc7d-4e38-840f-9a9ecd8a2548 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:27.729722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fdade-6bc2-430f-ad35-a760d438910c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:27.729895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d1149-bc7d-4e38-840f-9a9ecd8a2548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:27.730025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fdade-6bc2-430f-ad35-a760d438910c admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:27.730646 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fdade-6bc2-430f-ad35-a760d438910c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:27.732503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fdade-6bc2-430f-ad35-a760d438910c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:27.743019 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1119/2266] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:38:27.747025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fdade-6bc2-430f-ad35-a760d438910c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:27.747497 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-e81d1149-bc7d-4e38-840f-9a9ecd8a2548 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:27.748733 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e81d1149-bc7d-4e38-840f-9a9ecd8a2548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:27.748862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8c6fdade-6bc2-430f-ad35-a760d438910c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:27.764896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1148/2267] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:38:27.765141 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fdade-6bc2-430f-ad35-a760d438910c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:27.767215 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c939e-e555-42e6-a737-bcc317bcbe0e None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:27.767571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c939e-e555-42e6-a737-bcc317bcbe0e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:27.767865 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c939e-e555-42e6-a737-bcc317bcbe0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:27.768847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6f475-b594-4db2-b591-4daf37fb1e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:27.771292 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6f475-b594-4db2-b591-4daf37fb1e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:27.772272 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6f475-b594-4db2-b591-4daf37fb1e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:27.773136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6f475-b594-4db2-b591-4daf37fb1e39 admin admin] PATH_INFO: `/v3/projects/7a47325c34ee45e192f718d4b71c5c3e/users/1b31ea448ab2422c9d7f9e8a0dd409f3/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:27.779216 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6f475-b594-4db2-b591-4daf37fb1e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a47325c34ee45e192f718d4b71c5c3e, user_id=1b31ea448ab2422c9d7f9e8a0dd409f3, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:27.782977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6f475-b594-4db2-b591-4daf37fb1e39 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:27.788329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-205c939e-e555-42e6-a737-bcc317bcbe0e None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:27.789543 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-205c939e-e555-42e6-a737-bcc317bcbe0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:27.796942 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1120/2268] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:27 2022] PUT /identity/v3/projects/7a47325c34ee45e192f718d4b71c5c3e/users/1b31ea448ab2422c9d7f9e8a0dd409f3/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:38:27.811106 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417372ec-0a97-414f-8ee9-1b45d405cb56 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:27.811399 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417372ec-0a97-414f-8ee9-1b45d405cb56 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:27.811684 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417372ec-0a97-414f-8ee9-1b45d405cb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:27.843934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-417372ec-0a97-414f-8ee9-1b45d405cb56 None None] MFA Rules not processed for user `1b31ea448ab2422c9d7f9e8a0dd409f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:27.845094 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-417372ec-0a97-414f-8ee9-1b45d405cb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:27.863015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1149/2269] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:38:27.867248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c939e-e555-42e6-a737-bcc317bcbe0e None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:27.876780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c939e-e555-42e6-a737-bcc317bcbe0e None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:27.882228 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a325e84-4c23-43d4-abd0-f92a75c53f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:27.882865 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a325e84-4c23-43d4-abd0-f92a75c53f62 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:27.883184 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a325e84-4c23-43d4-abd0-f92a75c53f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:27.883461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a325e84-4c23-43d4-abd0-f92a75c53f62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:27.884197 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a325e84-4c23-43d4-abd0-f92a75c53f62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:38:27.884543 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a325e84-4c23-43d4-abd0-f92a75c53f62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:27.886247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a325e84-4c23-43d4-abd0-f92a75c53f62 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:27.902041 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1150/2270] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:38:27.906523 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a325e84-4c23-43d4-abd0-f92a75c53f62 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:27.918309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a325e84-4c23-43d4-abd0-f92a75c53f62 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:27.923399 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe6cb3-6922-41d2-a6f1-4c871af0e5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:27.924091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe6cb3-6922-41d2-a6f1-4c871af0e5e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:27.930027 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe6cb3-6922-41d2-a6f1-4c871af0e5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:27.930027 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe6cb3-6922-41d2-a6f1-4c871af0e5e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:27.930027 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe6cb3-6922-41d2-a6f1-4c871af0e5e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:27.930027 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe6cb3-6922-41d2-a6f1-4c871af0e5e9 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:27.948615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1121/2271] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:27.962216 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417372ec-0a97-414f-8ee9-1b45d405cb56 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:27.962216 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-417372ec-0a97-414f-8ee9-1b45d405cb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:28.033299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417372ec-0a97-414f-8ee9-1b45d405cb56 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:28.045884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca36863-1dcd-4922-98ea-c11a177672f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:28.046742 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca36863-1dcd-4922-98ea-c11a177672f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:28.047041 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca36863-1dcd-4922-98ea-c11a177672f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:28.047327 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca36863-1dcd-4922-98ea-c11a177672f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:28.051918 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1151/2272] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:38:27 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:38:28.053731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe6cb3-6922-41d2-a6f1-4c871af0e5e9 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:28.060782 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca36863-1dcd-4922-98ea-c11a177672f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:28.062462 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca36863-1dcd-4922-98ea-c11a177672f5 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:28.092791 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1122/2273] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:38:28.173521 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe6cb3-6922-41d2-a6f1-4c871af0e5e9 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:28.180996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e1645-4fcc-41fb-8033-37ff4cecb399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:28.182336 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e1645-4fcc-41fb-8033-37ff4cecb399 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:28.182778 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e1645-4fcc-41fb-8033-37ff4cecb399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:28.183274 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e1645-4fcc-41fb-8033-37ff4cecb399 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:28.184414 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e1645-4fcc-41fb-8033-37ff4cecb399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:28.186820 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e1645-4fcc-41fb-8033-37ff4cecb399 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:28.336600 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1152/2274] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:38:28 2022] POST /identity/v3/users => generated 287 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:28.342215 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca36863-1dcd-4922-98ea-c11a177672f5 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:28.354425 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca36863-1dcd-4922-98ea-c11a177672f5 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:28.359099 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b378744-4ded-4c99-842c-bbaf028f1ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:28.360285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b378744-4ded-4c99-842c-bbaf028f1ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:28.361158 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b378744-4ded-4c99-842c-bbaf028f1ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:28.361446 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b378744-4ded-4c99-842c-bbaf028f1ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:28.362293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b378744-4ded-4c99-842c-bbaf028f1ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:28.364200 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b378744-4ded-4c99-842c-bbaf028f1ee6 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:28.382376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1123/2275] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:28.387318 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e1645-4fcc-41fb-8033-37ff4cecb399 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:28.403985 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e1645-4fcc-41fb-8033-37ff4cecb399 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:28.416335 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d4118a-bbcb-43b8-9d4c-3335a1d3a997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:28.417049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4118a-bbcb-43b8-9d4c-3335a1d3a997 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:28.417413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4118a-bbcb-43b8-9d4c-3335a1d3a997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:28.417812 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d4118a-bbcb-43b8-9d4c-3335a1d3a997 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:28.418763 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4118a-bbcb-43b8-9d4c-3335a1d3a997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:28.420361 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d4118a-bbcb-43b8-9d4c-3335a1d3a997 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:28.436574 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1153/2276] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:28.438143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b378744-4ded-4c99-842c-bbaf028f1ee6 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:28.456188 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b378744-4ded-4c99-842c-bbaf028f1ee6 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:28.461237 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ed9e0-fa7c-4067-8b59-fb658c88bbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:28.463845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ed9e0-fa7c-4067-8b59-fb658c88bbed admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:28.464241 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ed9e0-fa7c-4067-8b59-fb658c88bbed admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:28.464548 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ed9e0-fa7c-4067-8b59-fb658c88bbed admin admin] PATH_INFO: `/v3/projects/f95af90027664baf9c46bde2ff74bd4b/users/d7d9315e6b5d48b796d4084b104cb26d/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:28.486722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ed9e0-fa7c-4067-8b59-fb658c88bbed admin admin] RBAC: Authorizing `identity:create_grant(project_id=f95af90027664baf9c46bde2ff74bd4b, user_id=d7d9315e6b5d48b796d4084b104cb26d, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:28.489528 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ed9e0-fa7c-4067-8b59-fb658c88bbed admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:28.579795 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1124/2277] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:28 2022] PUT /identity/v3/projects/f95af90027664baf9c46bde2ff74bd4b/users/d7d9315e6b5d48b796d4084b104cb26d/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:38:28.591005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae8906-b2c7-4d6d-ba40-fb67399d4c3d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:28.591872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae8906-b2c7-4d6d-ba40-fb67399d4c3d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:28.592174 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae8906-b2c7-4d6d-ba40-fb67399d4c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:28.640901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-93ae8906-b2c7-4d6d-ba40-fb67399d4c3d None None] MFA Rules not processed for user `d7d9315e6b5d48b796d4084b104cb26d`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:28.642467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-93ae8906-b2c7-4d6d-ba40-fb67399d4c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:28.732552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1154/2278] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:28.748677 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ed9e0-fa7c-4067-8b59-fb658c88bbed admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:28.756431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-658ed9e0-fa7c-4067-8b59-fb658c88bbed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:28.828995 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ed9e0-fa7c-4067-8b59-fb658c88bbed admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:28.833407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02b0e4-1c34-4301-8be5-e068866c4078 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:28.834188 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02b0e4-1c34-4301-8be5-e068866c4078 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:28.834474 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02b0e4-1c34-4301-8be5-e068866c4078 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:28.834756 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02b0e4-1c34-4301-8be5-e068866c4078 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:28.843641 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c02b0e4-1c34-4301-8be5-e068866c4078 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:28.845087 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c02b0e4-1c34-4301-8be5-e068866c4078 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:28.855262 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1125/2279] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:28.880511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae8906-b2c7-4d6d-ba40-fb67399d4c3d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:28.981517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae8906-b2c7-4d6d-ba40-fb67399d4c3d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:28.986459 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc919d6d-6952-4d43-a42d-8a5c1aa83221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:28.987463 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc919d6d-6952-4d43-a42d-8a5c1aa83221 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:28.987753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc919d6d-6952-4d43-a42d-8a5c1aa83221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:28.988029 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc919d6d-6952-4d43-a42d-8a5c1aa83221 admin admin] PATH_INFO: `/v3/users/d7d9315e6b5d48b796d4084b104cb26d` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:28.989260 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc919d6d-6952-4d43-a42d-8a5c1aa83221 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7d9315e6b5d48b796d4084b104cb26d)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:28.991274 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc919d6d-6952-4d43-a42d-8a5c1aa83221 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:29.111970 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02b0e4-1c34-4301-8be5-e068866c4078 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:29.113415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6c02b0e4-1c34-4301-8be5-e068866c4078 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:29.127210 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02b0e4-1c34-4301-8be5-e068866c4078 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:29.137461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9892b-b2c6-4248-b265-9089e074acde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:29.138486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9892b-b2c6-4248-b265-9089e074acde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:29.138776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9892b-b2c6-4248-b265-9089e074acde admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:29.139057 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9892b-b2c6-4248-b265-9089e074acde admin admin] PATH_INFO: `/v3/users/8ecba3511a784b57a4dd069498b80b0e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:29.140263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9892b-b2c6-4248-b265-9089e074acde admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ecba3511a784b57a4dd069498b80b0e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:29.142478 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9892b-b2c6-4248-b265-9089e074acde admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:29.342313 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bc919d6d-6952-4d43-a42d-8a5c1aa83221 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7d9315e6b5d48b796d4084b104cb26d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:29.342313 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bc919d6d-6952-4d43-a42d-8a5c1aa83221 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7d9315e6b5d48b796d4084b104cb26d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:29.342313 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bc919d6d-6952-4d43-a42d-8a5c1aa83221 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7d9315e6b5d48b796d4084b104cb26d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:29.351212 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bc919d6d-6952-4d43-a42d-8a5c1aa83221 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7d9315e6b5d48b796d4084b104cb26d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:29.361259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bc919d6d-6952-4d43-a42d-8a5c1aa83221 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7d9315e6b5d48b796d4084b104cb26d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:29.649784 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1155/2280] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:38:28 2022] DELETE /identity/v3/users/d7d9315e6b5d48b796d4084b104cb26d => generated 0 bytes in 770 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:29.664266 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-44a9892b-b2c6-4248-b265-9089e074acde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ecba3511a784b57a4dd069498b80b0e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:29.665117 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-44a9892b-b2c6-4248-b265-9089e074acde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ecba3511a784b57a4dd069498b80b0e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:29.665870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-44a9892b-b2c6-4248-b265-9089e074acde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ecba3511a784b57a4dd069498b80b0e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:29.670242 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6f5af-43e2-4c90-beb1-0713a366ed30 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:29.670700 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6f5af-43e2-4c90-beb1-0713a366ed30 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:29.671021 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6f5af-43e2-4c90-beb1-0713a366ed30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:29.682924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-44a9892b-b2c6-4248-b265-9089e074acde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ecba3511a784b57a4dd069498b80b0e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:29.692730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-aad6f5af-43e2-4c90-beb1-0713a366ed30 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:29.694150 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-aad6f5af-43e2-4c90-beb1-0713a366ed30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:29.766492 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1156/2281] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:38:29.776983 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6f5af-43e2-4c90-beb1-0713a366ed30 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:29.778385 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-aad6f5af-43e2-4c90-beb1-0713a366ed30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:29.837993 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6f5af-43e2-4c90-beb1-0713a366ed30 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:29.843017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bb9f4-a8a9-4e5f-b648-8d13da8c8fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:29.843679 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bb9f4-a8a9-4e5f-b648-8d13da8c8fcd service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:29.843970 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bb9f4-a8a9-4e5f-b648-8d13da8c8fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:29.844247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bb9f4-a8a9-4e5f-b648-8d13da8c8fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:29.853737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bb9f4-a8a9-4e5f-b648-8d13da8c8fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:29.855188 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bb9f4-a8a9-4e5f-b648-8d13da8c8fcd service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:29.864975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1157/2282] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:38:29.872949 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-44a9892b-b2c6-4248-b265-9089e074acde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ecba3511a784b57a4dd069498b80b0e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:29.910312 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1126/2283] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:38:29 2022] DELETE /identity/v3/users/8ecba3511a784b57a4dd069498b80b0e => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:38:29.915560 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007740a-2e6b-4cfb-a94f-a4f8488367ea None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:29.915901 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007740a-2e6b-4cfb-a94f-a4f8488367ea None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:29.916395 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007740a-2e6b-4cfb-a94f-a4f8488367ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:29.941541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-1007740a-2e6b-4cfb-a94f-a4f8488367ea None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:29.943287 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1007740a-2e6b-4cfb-a94f-a4f8488367ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:29.983856 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9892b-b2c6-4248-b265-9089e074acde admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:29.985599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-44a9892b-b2c6-4248-b265-9089e074acde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:30.040557 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1158/2284] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:30.051997 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007740a-2e6b-4cfb-a94f-a4f8488367ea None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:30.066790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9892b-b2c6-4248-b265-9089e074acde admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:30.072672 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9759371-789a-48c1-a044-1d95e103c38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:30.073811 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9759371-789a-48c1-a044-1d95e103c38c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:30.074095 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9759371-789a-48c1-a044-1d95e103c38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:30.074372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9759371-789a-48c1-a044-1d95e103c38c admin admin] PATH_INFO: `/v3/users/c52539e442794f09bada5f1e67a0b7bb` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:30.075594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9759371-789a-48c1-a044-1d95e103c38c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c52539e442794f09bada5f1e67a0b7bb)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:30.077548 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9759371-789a-48c1-a044-1d95e103c38c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:30.109096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007740a-2e6b-4cfb-a94f-a4f8488367ea None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:30.112907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbca61-8534-4e54-8f85-b5c880672b06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:30.113437 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbca61-8534-4e54-8f85-b5c880672b06 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:30.113756 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbca61-8534-4e54-8f85-b5c880672b06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:30.114039 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfbca61-8534-4e54-8f85-b5c880672b06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:30.124446 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbca61-8534-4e54-8f85-b5c880672b06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:30.126083 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfbca61-8534-4e54-8f85-b5c880672b06 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:30.136356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1159/2285] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:30.408915 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbca61-8534-4e54-8f85-b5c880672b06 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:30.410012 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8bfbca61-8534-4e54-8f85-b5c880672b06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:30.426270 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c9759371-789a-48c1-a044-1d95e103c38c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c52539e442794f09bada5f1e67a0b7bb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:30.429890 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c9759371-789a-48c1-a044-1d95e103c38c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c52539e442794f09bada5f1e67a0b7bb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:30.432172 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c9759371-789a-48c1-a044-1d95e103c38c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c52539e442794f09bada5f1e67a0b7bb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:30.433220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfbca61-8534-4e54-8f85-b5c880672b06 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:30.439659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d56adf-9051-4ef4-8036-440758cb354d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:30.440905 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d56adf-9051-4ef4-8036-440758cb354d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:30.441277 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d56adf-9051-4ef4-8036-440758cb354d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:30.441623 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d56adf-9051-4ef4-8036-440758cb354d admin admin] PATH_INFO: `/v3/projects/f95af90027664baf9c46bde2ff74bd4b` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:30.443868 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d56adf-9051-4ef4-8036-440758cb354d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f95af90027664baf9c46bde2ff74bd4b)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:30.449596 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d56adf-9051-4ef4-8036-440758cb354d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:30.449745 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c9759371-789a-48c1-a044-1d95e103c38c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c52539e442794f09bada5f1e67a0b7bb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:30.556148 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-c9759371-789a-48c1-a044-1d95e103c38c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c52539e442794f09bada5f1e67a0b7bb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:30.581123 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1127/2286] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:38:29 2022] DELETE /identity/v3/users/c52539e442794f09bada5f1e67a0b7bb => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:30.585919 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d0a39-63c6-42cf-a738-902e049e6cbf None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:30.586222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d0a39-63c6-42cf-a738-902e049e6cbf None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:30.586507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d0a39-63c6-42cf-a738-902e049e6cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:30.597436 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-59d56adf-9051-4ef4-8036-440758cb354d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f95af90027664baf9c46bde2ff74bd4b', 'request_id': 'req-59d56adf-9051-4ef4-8036-440758cb354d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:30.603553 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-59d56adf-9051-4ef4-8036-440758cb354d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f95af90027664baf9c46bde2ff74bd4b', 'request_id': 'req-59d56adf-9051-4ef4-8036-440758cb354d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:30.604623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-265d0a39-63c6-42cf-a738-902e049e6cbf None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:30.605961 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-265d0a39-63c6-42cf-a738-902e049e6cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:30.609749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-59d56adf-9051-4ef4-8036-440758cb354d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f95af90027664baf9c46bde2ff74bd4b', 'request_id': 'req-59d56adf-9051-4ef4-8036-440758cb354d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:30.665189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1128/2287] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:30.675727 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d0a39-63c6-42cf-a738-902e049e6cbf None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:30.677353 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-265d0a39-63c6-42cf-a738-902e049e6cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:30.707726 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-59d56adf-9051-4ef4-8036-440758cb354d admin admin] The token cache is being invalidate because project f95af90027664baf9c46bde2ff74bd4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:30.708305 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-59d56adf-9051-4ef4-8036-440758cb354d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:30.708793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-59d56adf-9051-4ef4-8036-440758cb354d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:30.710489 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1160/2288] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:30 2022] DELETE /identity/v3/projects/f95af90027664baf9c46bde2ff74bd4b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:38:30.711738 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d56adf-9051-4ef4-8036-440758cb354d admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:30.712924 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-59d56adf-9051-4ef4-8036-440758cb354d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:30.728103 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d56adf-9051-4ef4-8036-440758cb354d admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:30.734053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484e89d0-55c5-45cd-ae73-a2c39494d00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:30.735333 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e89d0-55c5-45cd-ae73-a2c39494d00e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:30.735819 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e89d0-55c5-45cd-ae73-a2c39494d00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:30.736294 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484e89d0-55c5-45cd-ae73-a2c39494d00e admin admin] PATH_INFO: `/v3/projects/bcf9e5856d0f4ead91b3510568d6a11d` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:30.737840 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e89d0-55c5-45cd-ae73-a2c39494d00e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf9e5856d0f4ead91b3510568d6a11d)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:30.741614 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484e89d0-55c5-45cd-ae73-a2c39494d00e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:30.769153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d0a39-63c6-42cf-a738-902e049e6cbf None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:30.776953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b195fc-7522-4dfc-8146-ec28cd72677b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:30.776953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b195fc-7522-4dfc-8146-ec28cd72677b service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:30.776953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b195fc-7522-4dfc-8146-ec28cd72677b service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:30.777855 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b195fc-7522-4dfc-8146-ec28cd72677b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:30.780008 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a2b195fc-7522-4dfc-8146-ec28cd72677b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:30.793878 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b195fc-7522-4dfc-8146-ec28cd72677b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:30.795490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b195fc-7522-4dfc-8146-ec28cd72677b service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:30.807143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1129/2289] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:38:30.808530 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e84c3-6109-4a1c-b777-fdf646752f81 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:30.808906 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e84c3-6109-4a1c-b777-fdf646752f81 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:30.809230 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3e84c3-6109-4a1c-b777-fdf646752f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:30.832935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-ab3e84c3-6109-4a1c-b777-fdf646752f81 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:30.836153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ab3e84c3-6109-4a1c-b777-fdf646752f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:30.847222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1130/2290] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:30.858901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665c238-5e80-4b1b-bd95-d528f5bbbf65 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:30.859247 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665c238-5e80-4b1b-bd95-d528f5bbbf65 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:30.859701 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665c238-5e80-4b1b-bd95-d528f5bbbf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:30.892866 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7665c238-5e80-4b1b-bd95-d528f5bbbf65 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:30.894742 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7665c238-5e80-4b1b-bd95-d528f5bbbf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:30.905526 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-484e89d0-55c5-45cd-ae73-a2c39494d00e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf9e5856d0f4ead91b3510568d6a11d', 'request_id': 'req-484e89d0-55c5-45cd-ae73-a2c39494d00e'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:30.925992 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-484e89d0-55c5-45cd-ae73-a2c39494d00e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf9e5856d0f4ead91b3510568d6a11d', 'request_id': 'req-484e89d0-55c5-45cd-ae73-a2c39494d00e'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:30.935621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-484e89d0-55c5-45cd-ae73-a2c39494d00e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf9e5856d0f4ead91b3510568d6a11d', 'request_id': 'req-484e89d0-55c5-45cd-ae73-a2c39494d00e'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:30.957470 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:31.004184 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1131/2291] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:31.004184 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665c238-5e80-4b1b-bd95-d528f5bbbf65 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:31.013273 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665c238-5e80-4b1b-bd95-d528f5bbbf65 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:31.019640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe1ec0-ccd6-4494-bb6c-494c1234baad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:31.020567 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe1ec0-ccd6-4494-bb6c-494c1234baad admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:31.021480 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe1ec0-ccd6-4494-bb6c-494c1234baad admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:31.021928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe1ec0-ccd6-4494-bb6c-494c1234baad admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:31.023025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe1ec0-ccd6-4494-bb6c-494c1234baad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:38:31.023434 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe1ec0-ccd6-4494-bb6c-494c1234baad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:31.025307 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbe1ec0-ccd6-4494-bb6c-494c1234baad admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:31.050591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1132/2292] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:38:31.054640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe1ec0-ccd6-4494-bb6c-494c1234baad admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:31.072920 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe1ec0-ccd6-4494-bb6c-494c1234baad admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:31.076880 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-484e89d0-55c5-45cd-ae73-a2c39494d00e admin admin] The token cache is being invalidate because project bcf9e5856d0f4ead91b3510568d6a11d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:31.077173 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-484e89d0-55c5-45cd-ae73-a2c39494d00e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:31.078825 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-484e89d0-55c5-45cd-ae73-a2c39494d00e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:31.081529 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1161/2293] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:30 2022] DELETE /identity/v3/projects/bcf9e5856d0f4ead91b3510568d6a11d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:31.087646 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928fc9e-1a08-47a1-853d-71b34ac4e145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:31.090158 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928fc9e-1a08-47a1-853d-71b34ac4e145 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:31.090158 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928fc9e-1a08-47a1-853d-71b34ac4e145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:31.090158 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928fc9e-1a08-47a1-853d-71b34ac4e145 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:31.090496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928fc9e-1a08-47a1-853d-71b34ac4e145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:31.092620 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928fc9e-1a08-47a1-853d-71b34ac4e145 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:31.094151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a152e-1c93-4b78-9dd0-ec8128504742 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:31.094449 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a152e-1c93-4b78-9dd0-ec8128504742 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:31.094733 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a152e-1c93-4b78-9dd0-ec8128504742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:31.118165 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-7e9a152e-1c93-4b78-9dd0-ec8128504742 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:31.119407 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7e9a152e-1c93-4b78-9dd0-ec8128504742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:31.129746 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1162/2294] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:38:31.136747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbb3e8-80ca-4b54-a61d-d1f55839be61 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:31.137036 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbb3e8-80ca-4b54-a61d-d1f55839be61 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:31.137454 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edbb3e8-80ca-4b54-a61d-d1f55839be61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:31.167160 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-1edbb3e8-80ca-4b54-a61d-d1f55839be61 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:31.168738 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1edbb3e8-80ca-4b54-a61d-d1f55839be61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:31.188752 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1163/2295] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:38:31.190049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbb3e8-80ca-4b54-a61d-d1f55839be61 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:31.207681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edbb3e8-80ca-4b54-a61d-d1f55839be61 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:31.215125 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494eabf-d7d7-4d6c-bfe3-2c79c278f21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:31.215376 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494eabf-d7d7-4d6c-bfe3-2c79c278f21c admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:31.215952 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494eabf-d7d7-4d6c-bfe3-2c79c278f21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:31.216239 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e494eabf-d7d7-4d6c-bfe3-2c79c278f21c admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:31.216978 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494eabf-d7d7-4d6c-bfe3-2c79c278f21c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:38:31.217285 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494eabf-d7d7-4d6c-bfe3-2c79c278f21c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:31.219161 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e494eabf-d7d7-4d6c-bfe3-2c79c278f21c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:31.240513 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1164/2296] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:38:31.245589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494eabf-d7d7-4d6c-bfe3-2c79c278f21c admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:31.256438 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e494eabf-d7d7-4d6c-bfe3-2c79c278f21c admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:31.263165 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d1f62-2c11-49aa-acdf-d51d270f4ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:31.263863 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d1f62-2c11-49aa-acdf-d51d270f4ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:31.263982 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d1f62-2c11-49aa-acdf-d51d270f4ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:31.264376 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d1f62-2c11-49aa-acdf-d51d270f4ce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:31.265586 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d1f62-2c11-49aa-acdf-d51d270f4ce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:31.268758 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d1f62-2c11-49aa-acdf-d51d270f4ce3 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:31.332285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1133/2297] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:38:31 2022] POST /identity/v3/projects => generated 371 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:31.334186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928fc9e-1a08-47a1-853d-71b34ac4e145 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:31.335939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0928fc9e-1a08-47a1-853d-71b34ac4e145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:31.399856 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928fc9e-1a08-47a1-853d-71b34ac4e145 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:31.404380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbaf72-591b-4133-88da-51a63073fe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:31.407417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbaf72-591b-4133-88da-51a63073fe6f admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:31.407417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbaf72-591b-4133-88da-51a63073fe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:31.407417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbaf72-591b-4133-88da-51a63073fe6f admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:31.407417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbaf72-591b-4133-88da-51a63073fe6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:31.408423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbaf72-591b-4133-88da-51a63073fe6f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:31.537888 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1165/2298] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:38:31 2022] POST /identity/v3/projects => generated 383 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:31.539558 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d1f62-2c11-49aa-acdf-d51d270f4ce3 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:31.609327 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d1f62-2c11-49aa-acdf-d51d270f4ce3 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:31.616988 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1134/2299] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:38:31 2022] POST /identity/v3/users => generated 286 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:38:31.618242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbaf72-591b-4133-88da-51a63073fe6f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:31.620560 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4bbbaf72-591b-4133-88da-51a63073fe6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:31.628143 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aac1d1-e229-4864-b59c-ed77b0936dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:31.628806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aac1d1-e229-4864-b59c-ed77b0936dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:31.630850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aac1d1-e229-4864-b59c-ed77b0936dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:31.630850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aac1d1-e229-4864-b59c-ed77b0936dc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:31.631520 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aac1d1-e229-4864-b59c-ed77b0936dc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:31.635580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aac1d1-e229-4864-b59c-ed77b0936dc3 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:31.650133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbaf72-591b-4133-88da-51a63073fe6f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:31.650133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f1781-e16a-49b5-86cb-b68083ba3320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:31.651193 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f1781-e16a-49b5-86cb-b68083ba3320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:31.651193 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f1781-e16a-49b5-86cb-b68083ba3320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:31.651601 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f1781-e16a-49b5-86cb-b68083ba3320 admin admin] PATH_INFO: `/v3/projects/efff66c4d4cc4d3f8a8ddd446e0a125a` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:31.652624 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f1781-e16a-49b5-86cb-b68083ba3320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efff66c4d4cc4d3f8a8ddd446e0a125a)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:31.654635 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f1781-e16a-49b5-86cb-b68083ba3320 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:31.842606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1166/2300] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:38:31 2022] POST /identity/v3/users => generated 292 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:38:31.843295 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aac1d1-e229-4864-b59c-ed77b0936dc3 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:31.855425 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aac1d1-e229-4864-b59c-ed77b0936dc3 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:31.860325 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1241ab1-fcfb-42d7-8450-f967e75d51b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:31.860982 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1241ab1-fcfb-42d7-8450-f967e75d51b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:31.861270 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1241ab1-fcfb-42d7-8450-f967e75d51b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:31.861549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1241ab1-fcfb-42d7-8450-f967e75d51b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:31.862309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1241ab1-fcfb-42d7-8450-f967e75d51b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:31.863912 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1241ab1-fcfb-42d7-8450-f967e75d51b9 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:31.873833 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1167/2301] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:31.874729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1241ab1-fcfb-42d7-8450-f967e75d51b9 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:31.886325 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1241ab1-fcfb-42d7-8450-f967e75d51b9 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:31.891244 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b1333-2036-4b62-bff7-1da57047e9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:31.893444 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b1333-2036-4b62-bff7-1da57047e9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:31.893444 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b1333-2036-4b62-bff7-1da57047e9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:31.893444 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b1333-2036-4b62-bff7-1da57047e9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:31.893444 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b1333-2036-4b62-bff7-1da57047e9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:31.894823 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b1333-2036-4b62-bff7-1da57047e9e9 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:31.903673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2c9f1781-e16a-49b5-86cb-b68083ba3320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efff66c4d4cc4d3f8a8ddd446e0a125a', 'request_id': 'req-2c9f1781-e16a-49b5-86cb-b68083ba3320'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:31.911351 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1168/2302] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:31.911351 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b1333-2036-4b62-bff7-1da57047e9e9 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:31.911686 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2c9f1781-e16a-49b5-86cb-b68083ba3320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efff66c4d4cc4d3f8a8ddd446e0a125a', 'request_id': 'req-2c9f1781-e16a-49b5-86cb-b68083ba3320'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:31.920988 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2c9f1781-e16a-49b5-86cb-b68083ba3320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efff66c4d4cc4d3f8a8ddd446e0a125a', 'request_id': 'req-2c9f1781-e16a-49b5-86cb-b68083ba3320'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:31.932892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b1333-2036-4b62-bff7-1da57047e9e9 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:31.996569 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07d95b-5cbb-465b-9207-aebdcc5b6e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:31.997250 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07d95b-5cbb-465b-9207-aebdcc5b6e37 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:31.997531 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07d95b-5cbb-465b-9207-aebdcc5b6e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:31.997841 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07d95b-5cbb-465b-9207-aebdcc5b6e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:31.998573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07d95b-5cbb-465b-9207-aebdcc5b6e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:32.000169 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07d95b-5cbb-465b-9207-aebdcc5b6e37 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:32.031447 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1169/2303] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:32.034102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07d95b-5cbb-465b-9207-aebdcc5b6e37 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:32.047800 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07d95b-5cbb-465b-9207-aebdcc5b6e37 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:32.054664 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bc69a-baf1-422a-a861-f44168ee5364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:32.055513 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bc69a-baf1-422a-a861-f44168ee5364 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:32.055899 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bc69a-baf1-422a-a861-f44168ee5364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:32.056389 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bc69a-baf1-422a-a861-f44168ee5364 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:32.057192 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bc69a-baf1-422a-a861-f44168ee5364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:32.059133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bc69a-baf1-422a-a861-f44168ee5364 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:32.062674 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2c9f1781-e16a-49b5-86cb-b68083ba3320 admin admin] The token cache is being invalidate because project efff66c4d4cc4d3f8a8ddd446e0a125a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:32.063045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2c9f1781-e16a-49b5-86cb-b68083ba3320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:32.064547 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2c9f1781-e16a-49b5-86cb-b68083ba3320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:32.067562 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1135/2304] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:31 2022] DELETE /identity/v3/projects/efff66c4d4cc4d3f8a8ddd446e0a125a => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:32.068432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f1781-e16a-49b5-86cb-b68083ba3320 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:32.072485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2c9f1781-e16a-49b5-86cb-b68083ba3320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:32.084323 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1170/2305] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:32.084323 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bc69a-baf1-422a-a861-f44168ee5364 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:32.090860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-135bc69a-baf1-422a-a861-f44168ee5364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:32.094231 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f1781-e16a-49b5-86cb-b68083ba3320 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:32.109609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bc69a-baf1-422a-a861-f44168ee5364 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:32.118208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c52cd1-b2db-4a66-909d-d36ec557b3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:32.119125 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c52cd1-b2db-4a66-909d-d36ec557b3e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:32.119404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c52cd1-b2db-4a66-909d-d36ec557b3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:32.119677 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c52cd1-b2db-4a66-909d-d36ec557b3e8 admin admin] PATH_INFO: `/v3/projects/96892b21c83f4cbe92764b8569538504/users/fde47e056b9448dea79d5f3f5761eef4/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:32.126252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a99e3-7e54-4971-b6c9-82549fc67ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:32.127400 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a99e3-7e54-4971-b6c9-82549fc67ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:32.127960 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a99e3-7e54-4971-b6c9-82549fc67ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:32.129238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a99e3-7e54-4971-b6c9-82549fc67ee7 admin admin] PATH_INFO: `/v3/users/1b31ea448ab2422c9d7f9e8a0dd409f3` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:32.131395 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a99e3-7e54-4971-b6c9-82549fc67ee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b31ea448ab2422c9d7f9e8a0dd409f3)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:32.133552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a99e3-7e54-4971-b6c9-82549fc67ee7 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:32.148620 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c52cd1-b2db-4a66-909d-d36ec557b3e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96892b21c83f4cbe92764b8569538504, user_id=fde47e056b9448dea79d5f3f5761eef4, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:32.151730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c52cd1-b2db-4a66-909d-d36ec557b3e8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:32.269777 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1136/2306] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:32 2022] PUT /identity/v3/projects/96892b21c83f4cbe92764b8569538504/users/fde47e056b9448dea79d5f3f5761eef4/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:32.269777 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c52cd1-b2db-4a66-909d-d36ec557b3e8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:32.269777 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-23c52cd1-b2db-4a66-909d-d36ec557b3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:32.348713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c52cd1-b2db-4a66-909d-d36ec557b3e8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:32.354348 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42430c7e-2385-4cc2-ad71-ce63dd923e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:32.355416 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42430c7e-2385-4cc2-ad71-ce63dd923e28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:32.355706 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42430c7e-2385-4cc2-ad71-ce63dd923e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:32.355993 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42430c7e-2385-4cc2-ad71-ce63dd923e28 admin admin] PATH_INFO: `/v3/projects/c9edf51a28c042b4a6f868003a008e03/users/865e36ae67344c0dbca9dcccca58da42/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:32.372415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42430c7e-2385-4cc2-ad71-ce63dd923e28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9edf51a28c042b4a6f868003a008e03, user_id=865e36ae67344c0dbca9dcccca58da42, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:32.375237 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42430c7e-2385-4cc2-ad71-ce63dd923e28 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:32.456763 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-284a99e3-7e54-4971-b6c9-82549fc67ee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b31ea448ab2422c9d7f9e8a0dd409f3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:32.457456 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-284a99e3-7e54-4971-b6c9-82549fc67ee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b31ea448ab2422c9d7f9e8a0dd409f3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:32.458144 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-284a99e3-7e54-4971-b6c9-82549fc67ee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b31ea448ab2422c9d7f9e8a0dd409f3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:32.471271 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-284a99e3-7e54-4971-b6c9-82549fc67ee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b31ea448ab2422c9d7f9e8a0dd409f3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:32.479385 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-284a99e3-7e54-4971-b6c9-82549fc67ee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b31ea448ab2422c9d7f9e8a0dd409f3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:32.531397 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:32.537693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1137/2307] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:32 2022] PUT /identity/v3/projects/c9edf51a28c042b4a6f868003a008e03/users/865e36ae67344c0dbca9dcccca58da42/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:32.539013 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77975126-e67a-49e9-b34f-e10fc577da95 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:32.539307 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77975126-e67a-49e9-b34f-e10fc577da95 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:32.539590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77975126-e67a-49e9-b34f-e10fc577da95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:32.564839 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-77975126-e67a-49e9-b34f-e10fc577da95 None None] MFA Rules not processed for user `fde47e056b9448dea79d5f3f5761eef4`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:32.566098 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-77975126-e67a-49e9-b34f-e10fc577da95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:32.568330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1171/2308] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:38:32 2022] DELETE /identity/v3/users/1b31ea448ab2422c9d7f9e8a0dd409f3 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:32.569762 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d080a-fd9b-40e4-a61d-22905f6f04c0 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:32.570057 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d080a-fd9b-40e4-a61d-22905f6f04c0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:32.570334 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d080a-fd9b-40e4-a61d-22905f6f04c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:32.589461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-4c4d080a-fd9b-40e4-a61d-22905f6f04c0 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:32.591039 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4c4d080a-fd9b-40e4-a61d-22905f6f04c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:32.640214 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1138/2309] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:32.653494 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77975126-e67a-49e9-b34f-e10fc577da95 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:32.655441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-77975126-e67a-49e9-b34f-e10fc577da95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:32.667433 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1172/2310] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:32.677483 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d080a-fd9b-40e4-a61d-22905f6f04c0 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:32.679629 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4c4d080a-fd9b-40e4-a61d-22905f6f04c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:32.737838 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4d080a-fd9b-40e4-a61d-22905f6f04c0 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:32.738324 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77975126-e67a-49e9-b34f-e10fc577da95 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:32.741947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98f2dc-dad0-43a6-b4e6-915806eeef5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:32.742601 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98f2dc-dad0-43a6-b4e6-915806eeef5e service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:32.742752 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ae0b6-b155-458f-98a5-1ac5f3ee5849 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8948dc6a55344eaa85e2a6092215ec6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:32.742885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98f2dc-dad0-43a6-b4e6-915806eeef5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:32.743157 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98f2dc-dad0-43a6-b4e6-915806eeef5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:32.743380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ae0b6-b155-458f-98a5-1ac5f3ee5849 service glance] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:32.743818 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ae0b6-b155-458f-98a5-1ac5f3ee5849 service glance] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:32.744100 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ae0b6-b155-458f-98a5-1ac5f3ee5849 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:32.752247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98f2dc-dad0-43a6-b4e6-915806eeef5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:32.752547 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ae0b6-b155-458f-98a5-1ac5f3ee5849 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:32.753682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98f2dc-dad0-43a6-b4e6-915806eeef5e service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:32.753998 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ae0b6-b155-458f-98a5-1ac5f3ee5849 service glance] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:32.763467 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1139/2311] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:38:32.765878 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1173/2312] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:38:33.239959 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ae0b6-b155-458f-98a5-1ac5f3ee5849 service glance] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:33.242248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f41ae0b6-b155-458f-98a5-1ac5f3ee5849 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:33.261605 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ae0b6-b155-458f-98a5-1ac5f3ee5849 service glance] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:33.267697 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f2a12-c6a0-495f-ba46-b5caa7dbf8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:33.268967 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f2a12-c6a0-495f-ba46-b5caa7dbf8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:33.269624 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f2a12-c6a0-495f-ba46-b5caa7dbf8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:33.270387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f2a12-c6a0-495f-ba46-b5caa7dbf8b2 admin admin] PATH_INFO: `/v3/projects/7a47325c34ee45e192f718d4b71c5c3e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:33.273052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f2a12-c6a0-495f-ba46-b5caa7dbf8b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a47325c34ee45e192f718d4b71c5c3e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:33.275243 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f2a12-c6a0-495f-ba46-b5caa7dbf8b2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:33.556109 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6e0f2a12-c6a0-495f-ba46-b5caa7dbf8b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a47325c34ee45e192f718d4b71c5c3e', 'request_id': 'req-6e0f2a12-c6a0-495f-ba46-b5caa7dbf8b2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:33.561912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6e0f2a12-c6a0-495f-ba46-b5caa7dbf8b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a47325c34ee45e192f718d4b71c5c3e', 'request_id': 'req-6e0f2a12-c6a0-495f-ba46-b5caa7dbf8b2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:33.568780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6e0f2a12-c6a0-495f-ba46-b5caa7dbf8b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a47325c34ee45e192f718d4b71c5c3e', 'request_id': 'req-6e0f2a12-c6a0-495f-ba46-b5caa7dbf8b2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:33.703633 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6e0f2a12-c6a0-495f-ba46-b5caa7dbf8b2 admin admin] The token cache is being invalidate because project 7a47325c34ee45e192f718d4b71c5c3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:33.704157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6e0f2a12-c6a0-495f-ba46-b5caa7dbf8b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:33.705258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6e0f2a12-c6a0-495f-ba46-b5caa7dbf8b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:33.707101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1140/2313] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:33 2022] DELETE /identity/v3/projects/7a47325c34ee45e192f718d4b71c5c3e => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:33.713993 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647bcd1-cd1a-46a6-a88f-3e50cd258500 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:33.714825 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647bcd1-cd1a-46a6-a88f-3e50cd258500 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:33.715294 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647bcd1-cd1a-46a6-a88f-3e50cd258500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:33.741664 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b647bcd1-cd1a-46a6-a88f-3e50cd258500 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:33.743211 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b647bcd1-cd1a-46a6-a88f-3e50cd258500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:33.807891 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1174/2314] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:33.815968 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f93ea3-afcf-42ab-8691-1bdd28df8fc6 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:33.816262 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f93ea3-afcf-42ab-8691-1bdd28df8fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:33.816546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f93ea3-afcf-42ab-8691-1bdd28df8fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:33.837328 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-01f93ea3-afcf-42ab-8691-1bdd28df8fc6 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:33.838676 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-01f93ea3-afcf-42ab-8691-1bdd28df8fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:33.853119 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1141/2315] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:33.857777 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647bcd1-cd1a-46a6-a88f-3e50cd258500 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:33.870702 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647bcd1-cd1a-46a6-a88f-3e50cd258500 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:33.876500 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21119d57-1ad4-4d69-834c-4ed0c42770d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:33.877408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21119d57-1ad4-4d69-834c-4ed0c42770d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:33.877756 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21119d57-1ad4-4d69-834c-4ed0c42770d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:33.887767 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21119d57-1ad4-4d69-834c-4ed0c42770d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:33.887767 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21119d57-1ad4-4d69-834c-4ed0c42770d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:38:33.887767 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21119d57-1ad4-4d69-834c-4ed0c42770d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:33.887767 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21119d57-1ad4-4d69-834c-4ed0c42770d4 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:33.897122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1175/2316] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:38:33.901686 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f93ea3-afcf-42ab-8691-1bdd28df8fc6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:33.911670 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f93ea3-afcf-42ab-8691-1bdd28df8fc6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:33.917135 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea91d69-e467-4693-abb1-4cf9b0865e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:33.917856 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea91d69-e467-4693-abb1-4cf9b0865e6f admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:33.918141 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea91d69-e467-4693-abb1-4cf9b0865e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:33.918429 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea91d69-e467-4693-abb1-4cf9b0865e6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:33.920597 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea91d69-e467-4693-abb1-4cf9b0865e6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:33.921042 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea91d69-e467-4693-abb1-4cf9b0865e6f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:34.062776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1142/2317] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:38:33 2022] POST /identity/v3/projects => generated 381 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:34.063702 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21119d57-1ad4-4d69-834c-4ed0c42770d4 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:34.075717 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21119d57-1ad4-4d69-834c-4ed0c42770d4 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:34.172388 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8c5d9-3712-4440-af29-da35b8640b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:34.173208 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8c5d9-3712-4440-af29-da35b8640b0f admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:34.173461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8c5d9-3712-4440-af29-da35b8640b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:34.173762 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8c5d9-3712-4440-af29-da35b8640b0f admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:34.175589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8c5d9-3712-4440-af29-da35b8640b0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:34.177667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8c5d9-3712-4440-af29-da35b8640b0f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:34.369998 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1176/2318] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:38:34 2022] POST /identity/v3/users => generated 291 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:38:34.372496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea91d69-e467-4693-abb1-4cf9b0865e6f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:34.383881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea91d69-e467-4693-abb1-4cf9b0865e6f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:34.392852 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c119e-7918-4f49-b572-d92384068c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:34.393772 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c119e-7918-4f49-b572-d92384068c36 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:34.394223 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c119e-7918-4f49-b572-d92384068c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:34.394500 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c119e-7918-4f49-b572-d92384068c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:34.395241 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c119e-7918-4f49-b572-d92384068c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:34.397288 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c119e-7918-4f49-b572-d92384068c36 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:34.538798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1143/2319] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:38:34.542795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8c5d9-3712-4440-af29-da35b8640b0f admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:34.553500 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8c5d9-3712-4440-af29-da35b8640b0f admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:34.560781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922171e-c278-4689-bd9e-c6d40d35555b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:34.561678 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922171e-c278-4689-bd9e-c6d40d35555b admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:34.574414 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922171e-c278-4689-bd9e-c6d40d35555b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:34.574414 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922171e-c278-4689-bd9e-c6d40d35555b admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:34.574414 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922171e-c278-4689-bd9e-c6d40d35555b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:34.574414 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922171e-c278-4689-bd9e-c6d40d35555b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:34.580470 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1177/2320] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:34.584503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c119e-7918-4f49-b572-d92384068c36 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:34.597722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c119e-7918-4f49-b572-d92384068c36 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:34.604466 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eeff1-6172-48c6-8e12-748b167b96d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:34.605364 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eeff1-6172-48c6-8e12-748b167b96d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:34.605643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eeff1-6172-48c6-8e12-748b167b96d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:34.605946 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1eeff1-6172-48c6-8e12-748b167b96d8 admin admin] PATH_INFO: `/v3/projects/5435e92f930643809f94224a79347189/users/c786db9f1a474c1f84cc3d0b96886c2d/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:34.633496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1eeff1-6172-48c6-8e12-748b167b96d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5435e92f930643809f94224a79347189, user_id=c786db9f1a474c1f84cc3d0b96886c2d, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:34.633496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1eeff1-6172-48c6-8e12-748b167b96d8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:34.770538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1144/2321] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:34 2022] PUT /identity/v3/projects/5435e92f930643809f94224a79347189/users/c786db9f1a474c1f84cc3d0b96886c2d/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:34.782499 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018da3c-5d5c-40e2-8037-5792aa31ce0d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:34.783566 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018da3c-5d5c-40e2-8037-5792aa31ce0d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:34.783992 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018da3c-5d5c-40e2-8037-5792aa31ce0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:34.824878 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-4018da3c-5d5c-40e2-8037-5792aa31ce0d None None] MFA Rules not processed for user `c786db9f1a474c1f84cc3d0b96886c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:34.827501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4018da3c-5d5c-40e2-8037-5792aa31ce0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:34.918323 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1178/2322] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:34.919400 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eeff1-6172-48c6-8e12-748b167b96d8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:34.990908 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1eeff1-6172-48c6-8e12-748b167b96d8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:34.996575 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5ef80-f0fd-4733-8768-205a19b9586b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:34.997404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5ef80-f0fd-4733-8768-205a19b9586b admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:34.998185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5ef80-f0fd-4733-8768-205a19b9586b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:34.998823 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5ef80-f0fd-4733-8768-205a19b9586b admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:34.999708 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5ef80-f0fd-4733-8768-205a19b9586b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:35.001726 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5ef80-f0fd-4733-8768-205a19b9586b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:35.117438 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1145/2323] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:38:34 2022] POST /identity/v3/projects => generated 381 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:35.121282 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018da3c-5d5c-40e2-8037-5792aa31ce0d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:35.133691 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018da3c-5d5c-40e2-8037-5792aa31ce0d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:35.201747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10037e7-7565-4929-97cc-b690dacc9f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:35.202565 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10037e7-7565-4929-97cc-b690dacc9f82 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:35.202956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10037e7-7565-4929-97cc-b690dacc9f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:35.203623 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10037e7-7565-4929-97cc-b690dacc9f82 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:35.204434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10037e7-7565-4929-97cc-b690dacc9f82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:35.206926 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10037e7-7565-4929-97cc-b690dacc9f82 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:35.391467 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8d705-d24a-4058-b0a5-98afdf9aa1ab None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:35.392136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8d705-d24a-4058-b0a5-98afdf9aa1ab None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:35.392136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8d705-d24a-4058-b0a5-98afdf9aa1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:35.430958 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1179/2324] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:38:35 2022] POST /identity/v3/users => generated 297 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:35.432268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c6e8d705-d24a-4058-b0a5-98afdf9aa1ab None None] MFA Rules not processed for user `865e36ae67344c0dbca9dcccca58da42`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:35.439164 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c6e8d705-d24a-4058-b0a5-98afdf9aa1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:35.439677 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10037e7-7565-4929-97cc-b690dacc9f82 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:35.465350 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10037e7-7565-4929-97cc-b690dacc9f82 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:35.473485 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb3d2a-4ac7-4a98-9486-5c6aa3dff977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:35.474289 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb3d2a-4ac7-4a98-9486-5c6aa3dff977 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:35.474575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb3d2a-4ac7-4a98-9486-5c6aa3dff977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:35.475057 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb3d2a-4ac7-4a98-9486-5c6aa3dff977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:35.475909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb3d2a-4ac7-4a98-9486-5c6aa3dff977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:35.477653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb3d2a-4ac7-4a98-9486-5c6aa3dff977 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:35.491870 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1180/2325] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:38:35.497215 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb3d2a-4ac7-4a98-9486-5c6aa3dff977 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:35.508331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb3d2a-4ac7-4a98-9486-5c6aa3dff977 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:35.515506 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd5fb7-b04c-44b8-be85-96d2dfd299ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:35.516592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd5fb7-b04c-44b8-be85-96d2dfd299ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:35.516907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd5fb7-b04c-44b8-be85-96d2dfd299ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:35.517226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd5fb7-b04c-44b8-be85-96d2dfd299ac admin admin] PATH_INFO: `/v3/projects/a1e2a655f4544d00b3f2bd3479d126bb/users/f874e90e126241a68c4b39740c3ecf54/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:35.538951 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd5fb7-b04c-44b8-be85-96d2dfd299ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e2a655f4544d00b3f2bd3479d126bb, user_id=f874e90e126241a68c4b39740c3ecf54, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:35.544280 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd5fb7-b04c-44b8-be85-96d2dfd299ac admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:35.551244 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1146/2326] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:38:35.563280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8d705-d24a-4058-b0a5-98afdf9aa1ab None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:35.564703 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c6e8d705-d24a-4058-b0a5-98afdf9aa1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:35.629143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8d705-d24a-4058-b0a5-98afdf9aa1ab None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:35.632848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ef0a9-ec7b-4656-a665-fc247339ec80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:35.633737 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ef0a9-ec7b-4656-a665-fc247339ec80 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:35.633907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ef0a9-ec7b-4656-a665-fc247339ec80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:35.634570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ef0a9-ec7b-4656-a665-fc247339ec80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:35.645521 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ef0a9-ec7b-4656-a665-fc247339ec80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:35.648681 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ef0a9-ec7b-4656-a665-fc247339ec80 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:35.658793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1181/2327] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:35 2022] PUT /identity/v3/projects/a1e2a655f4544d00b3f2bd3479d126bb/users/f874e90e126241a68c4b39740c3ecf54/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:35.663133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd5fb7-b04c-44b8-be85-96d2dfd299ac admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:35.670537 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1147/2328] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:38:35.780927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd5fb7-b04c-44b8-be85-96d2dfd299ac admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:35.788490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980eb7c2-0dad-41a5-bc18-1343d274e6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:35.793015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980eb7c2-0dad-41a5-bc18-1343d274e6ca admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:35.798367 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980eb7c2-0dad-41a5-bc18-1343d274e6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:35.798753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980eb7c2-0dad-41a5-bc18-1343d274e6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:35.799562 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980eb7c2-0dad-41a5-bc18-1343d274e6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:35.803595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980eb7c2-0dad-41a5-bc18-1343d274e6ca admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:35.838800 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1182/2329] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:35 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:38:35.839368 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ef0a9-ec7b-4656-a665-fc247339ec80 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:35.861595 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ef0a9-ec7b-4656-a665-fc247339ec80 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:35.870576 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d94a8-78cb-4f39-94c7-014502690507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:35.876082 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d94a8-78cb-4f39-94c7-014502690507 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:35.876579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d94a8-78cb-4f39-94c7-014502690507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:35.877025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d94a8-78cb-4f39-94c7-014502690507 admin admin] PATH_INFO: `/v3/projects/a1e2a655f4544d00b3f2bd3479d126bb/users/f874e90e126241a68c4b39740c3ecf54/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:35.879569 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d94a8-78cb-4f39-94c7-014502690507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e2a655f4544d00b3f2bd3479d126bb, user_id=f874e90e126241a68c4b39740c3ecf54, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:35.883121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d94a8-78cb-4f39-94c7-014502690507 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:35.908704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1148/2330] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:35 2022] PUT /identity/v3/projects/a1e2a655f4544d00b3f2bd3479d126bb/users/f874e90e126241a68c4b39740c3ecf54/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:38:35.911644 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bf2de-7819-47c5-bcdf-aa7041287273 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:35.912250 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bf2de-7819-47c5-bcdf-aa7041287273 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:35.912695 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5bf2de-7819-47c5-bcdf-aa7041287273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:35.952576 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-2d5bf2de-7819-47c5-bcdf-aa7041287273 None None] MFA Rules not processed for user `f874e90e126241a68c4b39740c3ecf54`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:35.953849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2d5bf2de-7819-47c5-bcdf-aa7041287273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:36.088091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1183/2331] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:36.502590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d94a8-78cb-4f39-94c7-014502690507 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:36.504327 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-629d94a8-78cb-4f39-94c7-014502690507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:36.580049 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d94a8-78cb-4f39-94c7-014502690507 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:36.586063 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef9a3f-52af-4514-9aa9-2c42f8146481 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:36.586744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef9a3f-52af-4514-9aa9-2c42f8146481 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:36.587079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef9a3f-52af-4514-9aa9-2c42f8146481 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:36.587514 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef9a3f-52af-4514-9aa9-2c42f8146481 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:36.599764 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef9a3f-52af-4514-9aa9-2c42f8146481 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:36.602286 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afef9a3f-52af-4514-9aa9-2c42f8146481 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:36.629929 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1149/2332] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:36.872510 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bf2de-7819-47c5-bcdf-aa7041287273 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:36.887584 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5bf2de-7819-47c5-bcdf-aa7041287273 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:36.892807 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0219d-39a8-4329-ac3d-cbf023ade018 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:36.893866 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0219d-39a8-4329-ac3d-cbf023ade018 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:36.894599 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0219d-39a8-4329-ac3d-cbf023ade018 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:36.895107 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0219d-39a8-4329-ac3d-cbf023ade018 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:36.981364 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e0219d-39a8-4329-ac3d-cbf023ade018 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:36.983680 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e0219d-39a8-4329-ac3d-cbf023ade018 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:37.002934 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1184/2333] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:37.642611 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9a649-0c51-4a3b-b3c0-fffdaaac150f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:37.643160 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9a649-0c51-4a3b-b3c0-fffdaaac150f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:37.643160 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d9a649-0c51-4a3b-b3c0-fffdaaac150f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:37.685363 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0219d-39a8-4329-ac3d-cbf023ade018 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:37.685657 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c0d9a649-0c51-4a3b-b3c0-fffdaaac150f None None] MFA Rules not processed for user `1f09a9a483934c88a06be690f02fba4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:37.687330 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c0d9a649-0c51-4a3b-b3c0-fffdaaac150f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:37.744601 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:37.791404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1150/2334] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:37.851533 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0219d-39a8-4329-ac3d-cbf023ade018 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:37.857265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1312c28-e303-4aff-ad2f-cfd33eb2205e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:37.859793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1312c28-e303-4aff-ad2f-cfd33eb2205e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:37.859793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1312c28-e303-4aff-ad2f-cfd33eb2205e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:37.859793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1312c28-e303-4aff-ad2f-cfd33eb2205e admin admin] PATH_INFO: `/v3/users/c786db9f1a474c1f84cc3d0b96886c2d` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:37.860744 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1312c28-e303-4aff-ad2f-cfd33eb2205e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c786db9f1a474c1f84cc3d0b96886c2d)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:37.862994 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1312c28-e303-4aff-ad2f-cfd33eb2205e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:38.135687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a1312c28-e303-4aff-ad2f-cfd33eb2205e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c786db9f1a474c1f84cc3d0b96886c2d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:38.137271 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a1312c28-e303-4aff-ad2f-cfd33eb2205e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c786db9f1a474c1f84cc3d0b96886c2d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:38.137990 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a1312c28-e303-4aff-ad2f-cfd33eb2205e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c786db9f1a474c1f84cc3d0b96886c2d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:38.159838 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a1312c28-e303-4aff-ad2f-cfd33eb2205e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c786db9f1a474c1f84cc3d0b96886c2d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:38.167861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a1312c28-e303-4aff-ad2f-cfd33eb2205e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c786db9f1a474c1f84cc3d0b96886c2d'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:38.307065 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1185/2335] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:38:37 2022] DELETE /identity/v3/users/c786db9f1a474c1f84cc3d0b96886c2d => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:38.312769 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:38.315178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53c45f-8cc3-4249-b3bd-1e3c75c288b6 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:38.315989 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53c45f-8cc3-4249-b3bd-1e3c75c288b6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:38.316522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53c45f-8cc3-4249-b3bd-1e3c75c288b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:38.336491 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-4c53c45f-8cc3-4249-b3bd-1e3c75c288b6 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:38.339791 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4c53c45f-8cc3-4249-b3bd-1e3c75c288b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:38.419608 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1151/2336] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:38:38.457669 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1312c28-e303-4aff-ad2f-cfd33eb2205e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:38.460676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a1312c28-e303-4aff-ad2f-cfd33eb2205e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:38.536267 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1312c28-e303-4aff-ad2f-cfd33eb2205e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:38.549225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c4751-7251-41d9-9d2e-cd7c19e6ca0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:38.554753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c4751-7251-41d9-9d2e-cd7c19e6ca0a service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:38.555153 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c4751-7251-41d9-9d2e-cd7c19e6ca0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:38.557535 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c4751-7251-41d9-9d2e-cd7c19e6ca0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:38.576216 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c4751-7251-41d9-9d2e-cd7c19e6ca0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:38.577690 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c4751-7251-41d9-9d2e-cd7c19e6ca0a service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:38.590338 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1186/2337] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:39.051415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92369b10-6646-4548-9b36-ebb66dc4fd36 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:39.051898 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92369b10-6646-4548-9b36-ebb66dc4fd36 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:39.052014 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92369b10-6646-4548-9b36-ebb66dc4fd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:39.072058 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-92369b10-6646-4548-9b36-ebb66dc4fd36 None None] MFA Rules not processed for user `865e36ae67344c0dbca9dcccca58da42`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:39.073529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-92369b10-6646-4548-9b36-ebb66dc4fd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:39.111470 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c4751-7251-41d9-9d2e-cd7c19e6ca0a service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:39.111470 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c07c4751-7251-41d9-9d2e-cd7c19e6ca0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:39.131960 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c4751-7251-41d9-9d2e-cd7c19e6ca0a service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:39.145533 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff2569-6291-4a1b-a08f-f4a072446c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:39.146718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff2569-6291-4a1b-a08f-f4a072446c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:39.147006 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff2569-6291-4a1b-a08f-f4a072446c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:39.147321 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff2569-6291-4a1b-a08f-f4a072446c03 admin admin] PATH_INFO: `/v3/projects/5435e92f930643809f94224a79347189` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:39.148858 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff2569-6291-4a1b-a08f-f4a072446c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5435e92f930643809f94224a79347189)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:39.159057 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ff2569-6291-4a1b-a08f-f4a072446c03 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:39.166154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1152/2338] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:39.284989 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b8ff2569-6291-4a1b-a08f-f4a072446c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5435e92f930643809f94224a79347189', 'request_id': 'req-b8ff2569-6291-4a1b-a08f-f4a072446c03'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:39.291777 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b8ff2569-6291-4a1b-a08f-f4a072446c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5435e92f930643809f94224a79347189', 'request_id': 'req-b8ff2569-6291-4a1b-a08f-f4a072446c03'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:39.306050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b8ff2569-6291-4a1b-a08f-f4a072446c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5435e92f930643809f94224a79347189', 'request_id': 'req-b8ff2569-6291-4a1b-a08f-f4a072446c03'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:39.435599 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b8ff2569-6291-4a1b-a08f-f4a072446c03 admin admin] The token cache is being invalidate because project 5435e92f930643809f94224a79347189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:39.440095 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b8ff2569-6291-4a1b-a08f-f4a072446c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:39.440095 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b8ff2569-6291-4a1b-a08f-f4a072446c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:39.440095 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1187/2339] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:39 2022] DELETE /identity/v3/projects/5435e92f930643809f94224a79347189 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:39.442629 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92369b10-6646-4548-9b36-ebb66dc4fd36 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:39.456142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92369b10-6646-4548-9b36-ebb66dc4fd36 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:39.524587 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8cd19-273c-4376-80fd-0e8963915d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:39.525595 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8cd19-273c-4376-80fd-0e8963915d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:39.525970 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8cd19-273c-4376-80fd-0e8963915d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:39.526246 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8cd19-273c-4376-80fd-0e8963915d3a admin admin] PATH_INFO: `/v3/users/f874e90e126241a68c4b39740c3ecf54` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:39.527543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8cd19-273c-4376-80fd-0e8963915d3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f874e90e126241a68c4b39740c3ecf54)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:39.529550 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8cd19-273c-4376-80fd-0e8963915d3a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:39.786148 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-edf8cd19-273c-4376-80fd-0e8963915d3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f874e90e126241a68c4b39740c3ecf54'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:39.786748 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-edf8cd19-273c-4376-80fd-0e8963915d3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f874e90e126241a68c4b39740c3ecf54'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:39.787406 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-edf8cd19-273c-4376-80fd-0e8963915d3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f874e90e126241a68c4b39740c3ecf54'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:39.799894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-edf8cd19-273c-4376-80fd-0e8963915d3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f874e90e126241a68c4b39740c3ecf54'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:39.904223 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-edf8cd19-273c-4376-80fd-0e8963915d3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f874e90e126241a68c4b39740c3ecf54'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:39.925898 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1153/2340] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:38:39 2022] DELETE /identity/v3/users/f874e90e126241a68c4b39740c3ecf54 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:40.489636 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff2569-6291-4a1b-a08f-f4a072446c03 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:40.492051 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b8ff2569-6291-4a1b-a08f-f4a072446c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:40.507880 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff2569-6291-4a1b-a08f-f4a072446c03 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:40.581844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd71945-0502-4af0-9ef5-500bfcfae689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:40.582739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd71945-0502-4af0-9ef5-500bfcfae689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:40.583184 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd71945-0502-4af0-9ef5-500bfcfae689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:40.583296 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd71945-0502-4af0-9ef5-500bfcfae689 admin admin] PATH_INFO: `/v3/projects/a1e2a655f4544d00b3f2bd3479d126bb` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:40.584869 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd71945-0502-4af0-9ef5-500bfcfae689 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1e2a655f4544d00b3f2bd3479d126bb)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:40.587417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd71945-0502-4af0-9ef5-500bfcfae689 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:40.724861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1fd71945-0502-4af0-9ef5-500bfcfae689 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1e2a655f4544d00b3f2bd3479d126bb', 'request_id': 'req-1fd71945-0502-4af0-9ef5-500bfcfae689'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:40.731966 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1fd71945-0502-4af0-9ef5-500bfcfae689 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1e2a655f4544d00b3f2bd3479d126bb', 'request_id': 'req-1fd71945-0502-4af0-9ef5-500bfcfae689'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:40.740243 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1fd71945-0502-4af0-9ef5-500bfcfae689 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1e2a655f4544d00b3f2bd3479d126bb', 'request_id': 'req-1fd71945-0502-4af0-9ef5-500bfcfae689'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:40.824509 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b326fd-31ca-4574-9ff9-730df7335cb7 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:40.824976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b326fd-31ca-4574-9ff9-730df7335cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:40.825064 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b326fd-31ca-4574-9ff9-730df7335cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:40.843663 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-49b326fd-31ca-4574-9ff9-730df7335cb7 None None] MFA Rules not processed for user `d9ac86461ecd4e6baa6b11fe869e8a4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:40.844889 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-49b326fd-31ca-4574-9ff9-730df7335cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:40.849174 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1fd71945-0502-4af0-9ef5-500bfcfae689 admin admin] The token cache is being invalidate because project a1e2a655f4544d00b3f2bd3479d126bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:40.852896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1fd71945-0502-4af0-9ef5-500bfcfae689 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:40.852896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1fd71945-0502-4af0-9ef5-500bfcfae689 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:40.852896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1188/2341] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:40 2022] DELETE /identity/v3/projects/a1e2a655f4544d00b3f2bd3479d126bb => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:40.857120 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0065320-5924-440e-9aac-0e2f1005bf69 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:40.857765 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0065320-5924-440e-9aac-0e2f1005bf69 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:40.858262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0065320-5924-440e-9aac-0e2f1005bf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:40.901473 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c0065320-5924-440e-9aac-0e2f1005bf69 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:40.902813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c0065320-5924-440e-9aac-0e2f1005bf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:40.956798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1154/2342] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:38:41.038460 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:41.060751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1189/2343] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:38:41.068567 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423371e-2ec3-44e7-9edc-d0f34e29452e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:41.068920 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423371e-2ec3-44e7-9edc-d0f34e29452e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:41.069251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423371e-2ec3-44e7-9edc-d0f34e29452e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:41.088590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5423371e-2ec3-44e7-9edc-d0f34e29452e None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:41.089954 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5423371e-2ec3-44e7-9edc-d0f34e29452e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:41.099789 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1155/2344] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:41.104760 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0065320-5924-440e-9aac-0e2f1005bf69 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:41.114612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0065320-5924-440e-9aac-0e2f1005bf69 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:41.120951 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc33eb-59ee-45f2-bfa2-1217cf6efd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:41.123853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc33eb-59ee-45f2-bfa2-1217cf6efd70 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:41.123853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc33eb-59ee-45f2-bfa2-1217cf6efd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:41.123853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc33eb-59ee-45f2-bfa2-1217cf6efd70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:41.123853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc33eb-59ee-45f2-bfa2-1217cf6efd70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:38:41.123853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc33eb-59ee-45f2-bfa2-1217cf6efd70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:41.125278 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc33eb-59ee-45f2-bfa2-1217cf6efd70 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:41.141758 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1190/2345] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:38:41.145890 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423371e-2ec3-44e7-9edc-d0f34e29452e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:41.157318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423371e-2ec3-44e7-9edc-d0f34e29452e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:41.162865 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1ddd1-fa15-4d90-911b-6374abf5a885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:41.164056 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1ddd1-fa15-4d90-911b-6374abf5a885 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:41.164345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1ddd1-fa15-4d90-911b-6374abf5a885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:41.164628 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1ddd1-fa15-4d90-911b-6374abf5a885 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:41.165338 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1ddd1-fa15-4d90-911b-6374abf5a885 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:41.167728 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1ddd1-fa15-4d90-911b-6374abf5a885 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:41.271609 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1156/2346] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:38:41 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:38:41.275994 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc33eb-59ee-45f2-bfa2-1217cf6efd70 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:41.289985 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc33eb-59ee-45f2-bfa2-1217cf6efd70 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:41.358018 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98b003-b37c-42a2-9a04-f5c46fc8c701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:41.358805 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98b003-b37c-42a2-9a04-f5c46fc8c701 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:41.358921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98b003-b37c-42a2-9a04-f5c46fc8c701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:41.359289 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f98b003-b37c-42a2-9a04-f5c46fc8c701 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:41.360007 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98b003-b37c-42a2-9a04-f5c46fc8c701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:41.362049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f98b003-b37c-42a2-9a04-f5c46fc8c701 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:41.404768 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:41.490217 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1191/2347] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:38:41 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:41.494408 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1ddd1-fa15-4d90-911b-6374abf5a885 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:41.504984 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1ddd1-fa15-4d90-911b-6374abf5a885 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:41.509742 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f597d9-1740-4209-889f-40adf19aff55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:41.510650 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f597d9-1740-4209-889f-40adf19aff55 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:41.512960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f597d9-1740-4209-889f-40adf19aff55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:41.513424 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f597d9-1740-4209-889f-40adf19aff55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:41.514454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f597d9-1740-4209-889f-40adf19aff55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:41.516261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f597d9-1740-4209-889f-40adf19aff55 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:41.530357 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1157/2348] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:38:41.533963 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98b003-b37c-42a2-9a04-f5c46fc8c701 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:41.546443 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f98b003-b37c-42a2-9a04-f5c46fc8c701 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:41.551307 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc8399-6dc7-4a16-8f49-dde114a1bb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:41.551983 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc8399-6dc7-4a16-8f49-dde114a1bb81 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:41.552266 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc8399-6dc7-4a16-8f49-dde114a1bb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:41.552550 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc8399-6dc7-4a16-8f49-dde114a1bb81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:41.553261 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc8399-6dc7-4a16-8f49-dde114a1bb81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:41.555072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc8399-6dc7-4a16-8f49-dde114a1bb81 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:41.570981 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f597d9-1740-4209-889f-40adf19aff55 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:41.571635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1192/2349] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:41.581240 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f597d9-1740-4209-889f-40adf19aff55 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:41.593694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99cf9a-fc12-44ef-8937-b879cbdbc9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:41.597185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99cf9a-fc12-44ef-8937-b879cbdbc9aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:41.597185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99cf9a-fc12-44ef-8937-b879cbdbc9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:41.597185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99cf9a-fc12-44ef-8937-b879cbdbc9aa admin admin] PATH_INFO: `/v3/projects/886b418cc1b347c19d544c611a652d96/users/f9eb956e60974e55bde4b5be600fa1d5/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:41.612649 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99cf9a-fc12-44ef-8937-b879cbdbc9aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=886b418cc1b347c19d544c611a652d96, user_id=f9eb956e60974e55bde4b5be600fa1d5, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:41.615575 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99cf9a-fc12-44ef-8937-b879cbdbc9aa admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:41.752850 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1158/2350] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:41 2022] PUT /identity/v3/projects/886b418cc1b347c19d544c611a652d96/users/f9eb956e60974e55bde4b5be600fa1d5/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:41.825384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f75f5c-42cd-40bf-8902-ed8575ae8886 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:41.825983 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f75f5c-42cd-40bf-8902-ed8575ae8886 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:41.826409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f75f5c-42cd-40bf-8902-ed8575ae8886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:41.881896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-80f75f5c-42cd-40bf-8902-ed8575ae8886 None None] MFA Rules not processed for user `f9eb956e60974e55bde4b5be600fa1d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:41.884231 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-80f75f5c-42cd-40bf-8902-ed8575ae8886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:41.990865 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1193/2351] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:42.002249 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99cf9a-fc12-44ef-8937-b879cbdbc9aa admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:42.004178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5c99cf9a-fc12-44ef-8937-b879cbdbc9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:42.069022 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99cf9a-fc12-44ef-8937-b879cbdbc9aa admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:42.073550 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc7dd3-869d-4ba4-8268-6149dcf075e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:42.074388 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc7dd3-869d-4ba4-8268-6149dcf075e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:42.074675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc7dd3-869d-4ba4-8268-6149dcf075e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:42.074955 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc7dd3-869d-4ba4-8268-6149dcf075e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:42.095569 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc7dd3-869d-4ba4-8268-6149dcf075e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:42.097268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcc7dd3-869d-4ba4-8268-6149dcf075e7 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:42.107136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1159/2352] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:43.064006 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:43.539204 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:45.477402 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:46.160449 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:46.578248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f75f5c-42cd-40bf-8902-ed8575ae8886 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:46.658157 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f75f5c-42cd-40bf-8902-ed8575ae8886 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:46.662738 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0bfb4-f9e6-4bba-92c6-8b2005ff45a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:46.663622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0bfb4-f9e6-4bba-92c6-8b2005ff45a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:46.663907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0bfb4-f9e6-4bba-92c6-8b2005ff45a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:46.664721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0bfb4-f9e6-4bba-92c6-8b2005ff45a4 admin admin] PATH_INFO: `/v3/users/f9eb956e60974e55bde4b5be600fa1d5` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:46.665942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0bfb4-f9e6-4bba-92c6-8b2005ff45a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9eb956e60974e55bde4b5be600fa1d5)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:46.667860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac0bfb4-f9e6-4bba-92c6-8b2005ff45a4 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:46.980384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4ac0bfb4-f9e6-4bba-92c6-8b2005ff45a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9eb956e60974e55bde4b5be600fa1d5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:46.981047 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4ac0bfb4-f9e6-4bba-92c6-8b2005ff45a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9eb956e60974e55bde4b5be600fa1d5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:46.981649 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4ac0bfb4-f9e6-4bba-92c6-8b2005ff45a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9eb956e60974e55bde4b5be600fa1d5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:46.995203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4ac0bfb4-f9e6-4bba-92c6-8b2005ff45a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9eb956e60974e55bde4b5be600fa1d5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:47.005653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-4ac0bfb4-f9e6-4bba-92c6-8b2005ff45a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9eb956e60974e55bde4b5be600fa1d5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:47.184367 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1194/2353] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:38:46 2022] DELETE /identity/v3/users/f9eb956e60974e55bde4b5be600fa1d5 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:47.188811 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e2b64-fa87-4b7c-aba0-9615e2f311ef None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:47.189690 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e2b64-fa87-4b7c-aba0-9615e2f311ef None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:47.190043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e2b64-fa87-4b7c-aba0-9615e2f311ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:47.211085 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-531e2b64-fa87-4b7c-aba0-9615e2f311ef None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:47.213223 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-531e2b64-fa87-4b7c-aba0-9615e2f311ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:47.293774 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1160/2354] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:47.305222 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0bfb4-f9e6-4bba-92c6-8b2005ff45a4 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:47.307172 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4ac0bfb4-f9e6-4bba-92c6-8b2005ff45a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:47.403974 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac0bfb4-f9e6-4bba-92c6-8b2005ff45a4 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:47.407943 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558f358-3121-4f66-96ac-20de31958976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:47.408919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558f358-3121-4f66-96ac-20de31958976 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:47.409203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558f358-3121-4f66-96ac-20de31958976 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:47.409482 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558f358-3121-4f66-96ac-20de31958976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:47.420809 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558f358-3121-4f66-96ac-20de31958976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:47.422388 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5558f358-3121-4f66-96ac-20de31958976 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:47.433309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1195/2355] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:47.991024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:48.028403 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e2b64-fa87-4b7c-aba0-9615e2f311ef None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:48.031423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-531e2b64-fa87-4b7c-aba0-9615e2f311ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:48.049561 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e2b64-fa87-4b7c-aba0-9615e2f311ef None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:48.074830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6b0c7-f73c-41b0-888a-d88c07e7a73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:48.076075 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6b0c7-f73c-41b0-888a-d88c07e7a73e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:48.076545 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6b0c7-f73c-41b0-888a-d88c07e7a73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:48.076926 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6b0c7-f73c-41b0-888a-d88c07e7a73e admin admin] PATH_INFO: `/v3/projects/886b418cc1b347c19d544c611a652d96` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:48.079402 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6b0c7-f73c-41b0-888a-d88c07e7a73e admin admin] RBAC: Authorizing `identity:delete_project(project_id=886b418cc1b347c19d544c611a652d96)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:48.081390 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb6b0c7-f73c-41b0-888a-d88c07e7a73e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:48.232236 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5cb6b0c7-f73c-41b0-888a-d88c07e7a73e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '886b418cc1b347c19d544c611a652d96', 'request_id': 'req-5cb6b0c7-f73c-41b0-888a-d88c07e7a73e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:48.239126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5cb6b0c7-f73c-41b0-888a-d88c07e7a73e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '886b418cc1b347c19d544c611a652d96', 'request_id': 'req-5cb6b0c7-f73c-41b0-888a-d88c07e7a73e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:48.247410 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5cb6b0c7-f73c-41b0-888a-d88c07e7a73e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '886b418cc1b347c19d544c611a652d96', 'request_id': 'req-5cb6b0c7-f73c-41b0-888a-d88c07e7a73e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:48.339453 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5cb6b0c7-f73c-41b0-888a-d88c07e7a73e admin admin] The token cache is being invalidate because project 886b418cc1b347c19d544c611a652d96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:48.344773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5cb6b0c7-f73c-41b0-888a-d88c07e7a73e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:48.352777 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5cb6b0c7-f73c-41b0-888a-d88c07e7a73e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:48.354955 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1161/2356] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:48 2022] DELETE /identity/v3/projects/886b418cc1b347c19d544c611a652d96 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:48.360376 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283974e4-dd58-41cc-b9a6-75a4a26f41b9 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:48.361019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283974e4-dd58-41cc-b9a6-75a4a26f41b9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:48.361633 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283974e4-dd58-41cc-b9a6-75a4a26f41b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:48.383237 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-283974e4-dd58-41cc-b9a6-75a4a26f41b9 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:48.385330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-283974e4-dd58-41cc-b9a6-75a4a26f41b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:48.458471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1196/2357] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:38:48.466250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fdf71-46fd-4999-8f07-6f77f7d9073d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:48.469490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fdf71-46fd-4999-8f07-6f77f7d9073d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:48.469490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49fdf71-46fd-4999-8f07-6f77f7d9073d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:48.495158 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e49fdf71-46fd-4999-8f07-6f77f7d9073d None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:48.501596 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e49fdf71-46fd-4999-8f07-6f77f7d9073d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:48.507723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1162/2358] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:38:48.512279 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283974e4-dd58-41cc-b9a6-75a4a26f41b9 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:48.526408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283974e4-dd58-41cc-b9a6-75a4a26f41b9 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:48.534303 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33494492-036c-47ea-918f-843033c2424b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:48.535813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33494492-036c-47ea-918f-843033c2424b admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:48.536367 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33494492-036c-47ea-918f-843033c2424b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:48.537202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33494492-036c-47ea-918f-843033c2424b admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:48.539173 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33494492-036c-47ea-918f-843033c2424b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:38:48.539761 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33494492-036c-47ea-918f-843033c2424b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:48.542004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33494492-036c-47ea-918f-843033c2424b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:48.561861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1197/2359] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:38:48.563776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49fdf71-46fd-4999-8f07-6f77f7d9073d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:48.576347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49fdf71-46fd-4999-8f07-6f77f7d9073d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:48.583387 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e17a2-8481-402e-8269-ec0197a77a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:48.584129 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e17a2-8481-402e-8269-ec0197a77a13 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:48.587772 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e17a2-8481-402e-8269-ec0197a77a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:48.587772 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e17a2-8481-402e-8269-ec0197a77a13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:48.587772 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e17a2-8481-402e-8269-ec0197a77a13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:48.588337 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e17a2-8481-402e-8269-ec0197a77a13 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:48.622561 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33494492-036c-47ea-918f-843033c2424b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:48.624524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-33494492-036c-47ea-918f-843033c2424b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:48.639663 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33494492-036c-47ea-918f-843033c2424b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:48.644567 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81e4c3-b97b-4c13-899b-ff99a02289d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:48.645508 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81e4c3-b97b-4c13-899b-ff99a02289d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:48.645845 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81e4c3-b97b-4c13-899b-ff99a02289d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:48.646130 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81e4c3-b97b-4c13-899b-ff99a02289d5 admin admin] PATH_INFO: `/v3/users/a922fc0313624105a9fb4528e3aa6a89` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:48.647369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81e4c3-b97b-4c13-899b-ff99a02289d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a922fc0313624105a9fb4528e3aa6a89)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:48.649392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d81e4c3-b97b-4c13-899b-ff99a02289d5 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:48.715270 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1163/2360] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:38:48 2022] POST /identity/v3/projects => generated 399 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:48.719367 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e17a2-8481-402e-8269-ec0197a77a13 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:48.788209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e17a2-8481-402e-8269-ec0197a77a13 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:48.794368 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e79a3-c24c-4cad-8d1e-9f0334c8db4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:48.795068 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e79a3-c24c-4cad-8d1e-9f0334c8db4b admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:48.795563 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e79a3-c24c-4cad-8d1e-9f0334c8db4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:48.796632 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e79a3-c24c-4cad-8d1e-9f0334c8db4b admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:48.797339 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e79a3-c24c-4cad-8d1e-9f0334c8db4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:48.809214 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e79a3-c24c-4cad-8d1e-9f0334c8db4b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:48.867255 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3d81e4c3-b97b-4c13-899b-ff99a02289d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a922fc0313624105a9fb4528e3aa6a89'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:48.868449 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3d81e4c3-b97b-4c13-899b-ff99a02289d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a922fc0313624105a9fb4528e3aa6a89'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:48.869169 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3d81e4c3-b97b-4c13-899b-ff99a02289d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a922fc0313624105a9fb4528e3aa6a89'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:48.881085 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3d81e4c3-b97b-4c13-899b-ff99a02289d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a922fc0313624105a9fb4528e3aa6a89'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:48.891659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3d81e4c3-b97b-4c13-899b-ff99a02289d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a922fc0313624105a9fb4528e3aa6a89'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:48.897300 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1164/2361] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:38:48 2022] POST /identity/v3/users => generated 300 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:38:48.898310 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e79a3-c24c-4cad-8d1e-9f0334c8db4b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:48.900566 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-843e79a3-c24c-4cad-8d1e-9f0334c8db4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:48.920120 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e79a3-c24c-4cad-8d1e-9f0334c8db4b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:48.929634 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a90b8c-0ee7-4fd8-8e8c-a9a057826802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:48.931297 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a90b8c-0ee7-4fd8-8e8c-a9a057826802 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:48.931658 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a90b8c-0ee7-4fd8-8e8c-a9a057826802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:48.932010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a90b8c-0ee7-4fd8-8e8c-a9a057826802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:48.932834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a90b8c-0ee7-4fd8-8e8c-a9a057826802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:48.935042 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a90b8c-0ee7-4fd8-8e8c-a9a057826802 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:48.949781 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1165/2362] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:48.953540 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a90b8c-0ee7-4fd8-8e8c-a9a057826802 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:48.965343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a90b8c-0ee7-4fd8-8e8c-a9a057826802 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:48.971710 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038162dd-945f-4b1c-99a9-48445338b671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:48.972640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038162dd-945f-4b1c-99a9-48445338b671 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:48.973013 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038162dd-945f-4b1c-99a9-48445338b671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:48.973372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038162dd-945f-4b1c-99a9-48445338b671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:48.974232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038162dd-945f-4b1c-99a9-48445338b671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:48.976046 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038162dd-945f-4b1c-99a9-48445338b671 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:48.999421 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1166/2363] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:38:49.001832 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038162dd-945f-4b1c-99a9-48445338b671 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:49.016208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038162dd-945f-4b1c-99a9-48445338b671 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:49.022127 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf2ae0-19ef-442e-9b94-47905d6e570d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:49.023564 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf2ae0-19ef-442e-9b94-47905d6e570d admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:49.025369 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf2ae0-19ef-442e-9b94-47905d6e570d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:49.025854 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf2ae0-19ef-442e-9b94-47905d6e570d admin admin] PATH_INFO: `/v3/projects/45d3a30821d740acb11ab1060bb073f1/users/d795be30a41645c8ab90dd325b8566ee/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:49.052110 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf2ae0-19ef-442e-9b94-47905d6e570d admin admin] RBAC: Authorizing `identity:create_grant(project_id=45d3a30821d740acb11ab1060bb073f1, user_id=d795be30a41645c8ab90dd325b8566ee, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:49.052110 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf2ae0-19ef-442e-9b94-47905d6e570d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:49.635801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1198/2364] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:38:48 2022] DELETE /identity/v3/users/a922fc0313624105a9fb4528e3aa6a89 => generated 0 bytes in 1014 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:49.681624 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1167/2365] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:49 2022] PUT /identity/v3/projects/45d3a30821d740acb11ab1060bb073f1/users/d795be30a41645c8ab90dd325b8566ee/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:49.691589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c1c18-e37b-4fbb-a942-22f36e818772 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:49.692174 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c1c18-e37b-4fbb-a942-22f36e818772 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:49.692667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c1c18-e37b-4fbb-a942-22f36e818772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:49.741232 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-631c1c18-e37b-4fbb-a942-22f36e818772 None None] MFA Rules not processed for user `d795be30a41645c8ab90dd325b8566ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:49.743998 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-631c1c18-e37b-4fbb-a942-22f36e818772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:49.835761 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1199/2366] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:49 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:49.850608 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf2ae0-19ef-442e-9b94-47905d6e570d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:49.853461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cbdf2ae0-19ef-442e-9b94-47905d6e570d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:49.927329 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf2ae0-19ef-442e-9b94-47905d6e570d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:49.933280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37086074-004e-4910-a257-69f83322376c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:49.934386 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37086074-004e-4910-a257-69f83322376c service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:49.935112 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37086074-004e-4910-a257-69f83322376c service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:49.935595 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37086074-004e-4910-a257-69f83322376c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:49.948418 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37086074-004e-4910-a257-69f83322376c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:49.950460 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37086074-004e-4910-a257-69f83322376c service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:49.961016 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1168/2367] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:49 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:50.301281 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:50.342878 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c1c18-e37b-4fbb-a942-22f36e818772 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:50.344533 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-631c1c18-e37b-4fbb-a942-22f36e818772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:50.430665 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c1c18-e37b-4fbb-a942-22f36e818772 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:50.436042 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa62db3-4b97-475a-a44a-b42c578694af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:50.437447 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa62db3-4b97-475a-a44a-b42c578694af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:50.437447 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa62db3-4b97-475a-a44a-b42c578694af admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:50.437694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa62db3-4b97-475a-a44a-b42c578694af admin admin] PATH_INFO: `/v3/projects/a35e29048825447d952fe69525dbfbb9` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:50.438824 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa62db3-4b97-475a-a44a-b42c578694af admin admin] RBAC: Authorizing `identity:delete_project(project_id=a35e29048825447d952fe69525dbfbb9)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:50.440733 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa62db3-4b97-475a-a44a-b42c578694af admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:50.593285 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0aa62db3-4b97-475a-a44a-b42c578694af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a35e29048825447d952fe69525dbfbb9', 'request_id': 'req-0aa62db3-4b97-475a-a44a-b42c578694af'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:50.599812 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0aa62db3-4b97-475a-a44a-b42c578694af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a35e29048825447d952fe69525dbfbb9', 'request_id': 'req-0aa62db3-4b97-475a-a44a-b42c578694af'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:50.607870 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0aa62db3-4b97-475a-a44a-b42c578694af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a35e29048825447d952fe69525dbfbb9', 'request_id': 'req-0aa62db3-4b97-475a-a44a-b42c578694af'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:50.708522 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0aa62db3-4b97-475a-a44a-b42c578694af admin admin] The token cache is being invalidate because project a35e29048825447d952fe69525dbfbb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:50.712509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0aa62db3-4b97-475a-a44a-b42c578694af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:50.712509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0aa62db3-4b97-475a-a44a-b42c578694af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:50.717480 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1200/2368] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:50 2022] DELETE /identity/v3/projects/a35e29048825447d952fe69525dbfbb9 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:50.718435 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37086074-004e-4910-a257-69f83322376c service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:50.733117 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37086074-004e-4910-a257-69f83322376c service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:50.811600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a75ab-421b-4fc3-b998-38e13102bef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:50.813403 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a75ab-421b-4fc3-b998-38e13102bef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:50.813966 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a75ab-421b-4fc3-b998-38e13102bef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:50.814761 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a75ab-421b-4fc3-b998-38e13102bef2 admin admin] PATH_INFO: `/v3/users/fb32ee34e21a4c1c9f0493a76b2c4d89` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:50.816209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a75ab-421b-4fc3-b998-38e13102bef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb32ee34e21a4c1c9f0493a76b2c4d89)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:50.818321 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a75ab-421b-4fc3-b998-38e13102bef2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:50.909234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:51.041247 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2c2a75ab-421b-4fc3-b998-38e13102bef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb32ee34e21a4c1c9f0493a76b2c4d89'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:51.041986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2c2a75ab-421b-4fc3-b998-38e13102bef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb32ee34e21a4c1c9f0493a76b2c4d89'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:51.042654 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2c2a75ab-421b-4fc3-b998-38e13102bef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb32ee34e21a4c1c9f0493a76b2c4d89'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:51.059446 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2c2a75ab-421b-4fc3-b998-38e13102bef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb32ee34e21a4c1c9f0493a76b2c4d89'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:51.174575 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-2c2a75ab-421b-4fc3-b998-38e13102bef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb32ee34e21a4c1c9f0493a76b2c4d89'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:51.188533 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1169/2369] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:38:50 2022] DELETE /identity/v3/users/fb32ee34e21a4c1c9f0493a76b2c4d89 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:38:51.284601 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24b24e-4098-4748-b01a-65848e24d5c8 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:51.284888 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24b24e-4098-4748-b01a-65848e24d5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:51.285168 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24b24e-4098-4748-b01a-65848e24d5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:51.302707 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-ca24b24e-4098-4748-b01a-65848e24d5c8 None None] MFA Rules not processed for user `6618ecc2692c40be876654dfdc4496b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:51.304130 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ca24b24e-4098-4748-b01a-65848e24d5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:51.360171 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1201/2370] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:51.488821 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a75ab-421b-4fc3-b998-38e13102bef2 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:51.488821 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2c2a75ab-421b-4fc3-b998-38e13102bef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:51.557396 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a75ab-421b-4fc3-b998-38e13102bef2 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:51.562210 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a6300-8015-4e5c-9981-4839403954e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:51.563072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a6300-8015-4e5c-9981-4839403954e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:51.563359 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a6300-8015-4e5c-9981-4839403954e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:51.563641 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a6300-8015-4e5c-9981-4839403954e3 admin admin] PATH_INFO: `/v3/projects/fd60edba4de94440b594c47b47febb3c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:51.564824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a6300-8015-4e5c-9981-4839403954e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd60edba4de94440b594c47b47febb3c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:51.566766 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a6300-8015-4e5c-9981-4839403954e3 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:51.699284 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-155a6300-8015-4e5c-9981-4839403954e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd60edba4de94440b594c47b47febb3c', 'request_id': 'req-155a6300-8015-4e5c-9981-4839403954e3'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:51.705395 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-155a6300-8015-4e5c-9981-4839403954e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd60edba4de94440b594c47b47febb3c', 'request_id': 'req-155a6300-8015-4e5c-9981-4839403954e3'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:51.729192 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-155a6300-8015-4e5c-9981-4839403954e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd60edba4de94440b594c47b47febb3c', 'request_id': 'req-155a6300-8015-4e5c-9981-4839403954e3'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:51.861004 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-155a6300-8015-4e5c-9981-4839403954e3 admin admin] The token cache is being invalidate because project fd60edba4de94440b594c47b47febb3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:51.861592 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-155a6300-8015-4e5c-9981-4839403954e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:51.863046 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-155a6300-8015-4e5c-9981-4839403954e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:51.865647 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1170/2371] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:51 2022] DELETE /identity/v3/projects/fd60edba4de94440b594c47b47febb3c => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:51.870648 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98845ad0-e03b-4b84-8efc-479fd7aba78d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:51.871129 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98845ad0-e03b-4b84-8efc-479fd7aba78d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:51.871129 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98845ad0-e03b-4b84-8efc-479fd7aba78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:51.889886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-98845ad0-e03b-4b84-8efc-479fd7aba78d None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:51.891144 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-98845ad0-e03b-4b84-8efc-479fd7aba78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:51.972019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1202/2372] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:38:51.980977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73d013-5cec-4f74-9f4b-6ffcbf596fae None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:51.981285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73d013-5cec-4f74-9f4b-6ffcbf596fae None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:51.981555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73d013-5cec-4f74-9f4b-6ffcbf596fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:52.002038 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2b73d013-5cec-4f74-9f4b-6ffcbf596fae None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:52.004112 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2b73d013-5cec-4f74-9f4b-6ffcbf596fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:52.014907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1171/2373] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:38:52.019430 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98845ad0-e03b-4b84-8efc-479fd7aba78d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:52.031389 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98845ad0-e03b-4b84-8efc-479fd7aba78d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:52.036994 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa81e99-7e25-4c79-98a8-6f45772f50f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:52.038374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa81e99-7e25-4c79-98a8-6f45772f50f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:52.043697 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa81e99-7e25-4c79-98a8-6f45772f50f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:52.043697 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa81e99-7e25-4c79-98a8-6f45772f50f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:52.043697 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa81e99-7e25-4c79-98a8-6f45772f50f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:38:52.043697 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa81e99-7e25-4c79-98a8-6f45772f50f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:52.043697 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa81e99-7e25-4c79-98a8-6f45772f50f5 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:52.061490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1203/2374] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:38:52.063129 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73d013-5cec-4f74-9f4b-6ffcbf596fae None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:52.082119 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73d013-5cec-4f74-9f4b-6ffcbf596fae None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:52.082119 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f1eaf-fd68-4894-9217-604f078ddf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:52.082119 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f1eaf-fd68-4894-9217-604f078ddf29 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:52.082119 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f1eaf-fd68-4894-9217-604f078ddf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:52.082512 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f1eaf-fd68-4894-9217-604f078ddf29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:52.082512 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f1eaf-fd68-4894-9217-604f078ddf29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:52.083859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f1eaf-fd68-4894-9217-604f078ddf29 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:52.219748 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1172/2375] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:38:52 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:52.223293 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa81e99-7e25-4c79-98a8-6f45772f50f5 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:52.234327 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa81e99-7e25-4c79-98a8-6f45772f50f5 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:52.329158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35263ec-01c5-47b0-b7d6-21c95c2209b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:52.330021 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35263ec-01c5-47b0-b7d6-21c95c2209b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:52.335550 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35263ec-01c5-47b0-b7d6-21c95c2209b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:52.335550 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35263ec-01c5-47b0-b7d6-21c95c2209b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:52.335550 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35263ec-01c5-47b0-b7d6-21c95c2209b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:52.335550 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35263ec-01c5-47b0-b7d6-21c95c2209b5 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:52.442366 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1204/2376] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:38:52 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:52.449034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f1eaf-fd68-4894-9217-604f078ddf29 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:52.459944 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f1eaf-fd68-4894-9217-604f078ddf29 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:52.465275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4deb99-7732-4839-9cd6-e2dfdaa7fbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:52.465990 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4deb99-7732-4839-9cd6-e2dfdaa7fbdb admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:52.466796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4deb99-7732-4839-9cd6-e2dfdaa7fbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:52.466796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4deb99-7732-4839-9cd6-e2dfdaa7fbdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:52.467280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4deb99-7732-4839-9cd6-e2dfdaa7fbdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:52.468937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4deb99-7732-4839-9cd6-e2dfdaa7fbdb admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:52.485045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1173/2377] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:38:52.489188 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35263ec-01c5-47b0-b7d6-21c95c2209b5 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:52.499608 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35263ec-01c5-47b0-b7d6-21c95c2209b5 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:52.504264 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450df159-bb77-414f-aac6-a02b5cf0be3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:52.504927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450df159-bb77-414f-aac6-a02b5cf0be3b admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:52.505219 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450df159-bb77-414f-aac6-a02b5cf0be3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:52.505500 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450df159-bb77-414f-aac6-a02b5cf0be3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:52.506262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450df159-bb77-414f-aac6-a02b5cf0be3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:52.507900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450df159-bb77-414f-aac6-a02b5cf0be3b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:52.518337 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1205/2378] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:52.522680 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4deb99-7732-4839-9cd6-e2dfdaa7fbdb admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:52.543161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4deb99-7732-4839-9cd6-e2dfdaa7fbdb admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:52.566228 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c4f38-1fd3-4e7c-a1ab-bdbbaa2d0289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:52.567300 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c4f38-1fd3-4e7c-a1ab-bdbbaa2d0289 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:52.569087 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c4f38-1fd3-4e7c-a1ab-bdbbaa2d0289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:52.569530 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c4f38-1fd3-4e7c-a1ab-bdbbaa2d0289 admin admin] PATH_INFO: `/v3/projects/18731eb6618e4e4c845648870febbc72/users/42f0ccfdb7d84684945e4c9e834a5f7b/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:52.588830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c4f38-1fd3-4e7c-a1ab-bdbbaa2d0289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18731eb6618e4e4c845648870febbc72, user_id=42f0ccfdb7d84684945e4c9e834a5f7b, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:52.594501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c4f38-1fd3-4e7c-a1ab-bdbbaa2d0289 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:52.713119 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1174/2379] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:52 2022] PUT /identity/v3/projects/18731eb6618e4e4c845648870febbc72/users/42f0ccfdb7d84684945e4c9e834a5f7b/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:52.726310 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cddde-c4e6-42a6-baf5-a124d9728f3c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:52.726615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cddde-c4e6-42a6-baf5-a124d9728f3c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:52.726897 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183cddde-c4e6-42a6-baf5-a124d9728f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:52.775075 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-183cddde-c4e6-42a6-baf5-a124d9728f3c None None] MFA Rules not processed for user `42f0ccfdb7d84684945e4c9e834a5f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:52.776422 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-183cddde-c4e6-42a6-baf5-a124d9728f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:52.845503 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1206/2380] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:52.850096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c4f38-1fd3-4e7c-a1ab-bdbbaa2d0289 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:52.914817 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c4f38-1fd3-4e7c-a1ab-bdbbaa2d0289 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:52.919684 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041fcd9-0be7-4db5-a2e9-6943aef01c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:52.920360 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041fcd9-0be7-4db5-a2e9-6943aef01c77 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:52.920645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041fcd9-0be7-4db5-a2e9-6943aef01c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:52.920922 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041fcd9-0be7-4db5-a2e9-6943aef01c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:52.921619 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041fcd9-0be7-4db5-a2e9-6943aef01c77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:52.923552 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041fcd9-0be7-4db5-a2e9-6943aef01c77 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:53.026125 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1175/2381] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:38:52 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:38:53.030413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cddde-c4e6-42a6-baf5-a124d9728f3c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:53.042694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183cddde-c4e6-42a6-baf5-a124d9728f3c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:53.107418 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca3cbb-e549-4907-bd12-0877e4b395f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:53.108107 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca3cbb-e549-4907-bd12-0877e4b395f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:53.109889 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca3cbb-e549-4907-bd12-0877e4b395f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:53.110289 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca3cbb-e549-4907-bd12-0877e4b395f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:53.111095 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca3cbb-e549-4907-bd12-0877e4b395f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:53.113140 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dca3cbb-e549-4907-bd12-0877e4b395f5 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:53.218115 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:53.286472 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1207/2382] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:38:53 2022] POST /identity/v3/users => generated 298 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:38:53.290581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041fcd9-0be7-4db5-a2e9-6943aef01c77 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:53.300859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041fcd9-0be7-4db5-a2e9-6943aef01c77 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:53.306179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0263cd-d288-4733-854d-a8d886a1403e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:53.306850 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0263cd-d288-4733-854d-a8d886a1403e admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:53.307245 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0263cd-d288-4733-854d-a8d886a1403e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:53.307448 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0263cd-d288-4733-854d-a8d886a1403e admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:53.308126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0263cd-d288-4733-854d-a8d886a1403e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:53.309748 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0263cd-d288-4733-854d-a8d886a1403e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:53.330856 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1176/2383] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:53.335132 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca3cbb-e549-4907-bd12-0877e4b395f5 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:53.357651 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca3cbb-e549-4907-bd12-0877e4b395f5 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:53.363030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b03cdf-e74d-4add-89eb-1bfee8871cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:53.365771 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b03cdf-e74d-4add-89eb-1bfee8871cba admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:53.365771 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b03cdf-e74d-4add-89eb-1bfee8871cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:53.365771 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b03cdf-e74d-4add-89eb-1bfee8871cba admin admin] PATH_INFO: `/v3/projects/0dd022f8c7b8403d948e12c3572e41b7/users/316755bb4b364635bde713bece942e94/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:53.382781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b03cdf-e74d-4add-89eb-1bfee8871cba admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd022f8c7b8403d948e12c3572e41b7, user_id=316755bb4b364635bde713bece942e94, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:53.386375 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b03cdf-e74d-4add-89eb-1bfee8871cba admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:53.500455 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1208/2384] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:53 2022] PUT /identity/v3/projects/0dd022f8c7b8403d948e12c3572e41b7/users/316755bb4b364635bde713bece942e94/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:38:53.502538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0263cd-d288-4733-854d-a8d886a1403e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:53.512689 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0263cd-d288-4733-854d-a8d886a1403e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:53.570292 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f01a5-61b7-4d6d-9f42-71c6f9ab2815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:53.570970 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f01a5-61b7-4d6d-9f42-71c6f9ab2815 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:53.571256 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f01a5-61b7-4d6d-9f42-71c6f9ab2815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:53.571562 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f01a5-61b7-4d6d-9f42-71c6f9ab2815 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:53.572295 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f01a5-61b7-4d6d-9f42-71c6f9ab2815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:53.573906 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61f01a5-61b7-4d6d-9f42-71c6f9ab2815 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:53.583758 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1177/2385] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:38:53.588568 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b03cdf-e74d-4add-89eb-1bfee8871cba admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:53.599053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b03cdf-e74d-4add-89eb-1bfee8871cba admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:53.604324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18ae92-6d1e-4919-9af1-38f14dbf5d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:53.605207 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18ae92-6d1e-4919-9af1-38f14dbf5d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:53.605491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18ae92-6d1e-4919-9af1-38f14dbf5d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:53.605801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18ae92-6d1e-4919-9af1-38f14dbf5d70 admin admin] PATH_INFO: `/v3/projects/0dd022f8c7b8403d948e12c3572e41b7/users/316755bb4b364635bde713bece942e94/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:53.608623 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18ae92-6d1e-4919-9af1-38f14dbf5d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd022f8c7b8403d948e12c3572e41b7, user_id=316755bb4b364635bde713bece942e94, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:53.611320 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18ae92-6d1e-4919-9af1-38f14dbf5d70 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:53.621549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1209/2386] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:38:53 2022] PUT /identity/v3/projects/0dd022f8c7b8403d948e12c3572e41b7/users/316755bb4b364635bde713bece942e94/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:53.631949 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ee584-f8c8-4231-9206-ad23ec276475 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:53.633305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ee584-f8c8-4231-9206-ad23ec276475 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:53.633305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ee584-f8c8-4231-9206-ad23ec276475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:53.659908 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2f1ee584-f8c8-4231-9206-ad23ec276475 None None] MFA Rules not processed for user `316755bb4b364635bde713bece942e94`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:53.661370 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2f1ee584-f8c8-4231-9206-ad23ec276475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:53.728759 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1178/2387] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:38:53.739566 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18ae92-6d1e-4919-9af1-38f14dbf5d70 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:53.741260 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-2d18ae92-6d1e-4919-9af1-38f14dbf5d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:53.804055 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18ae92-6d1e-4919-9af1-38f14dbf5d70 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:53.808397 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c879fbe1-fcc1-4576-85cd-9d1b357ea2b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:53.809056 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879fbe1-fcc1-4576-85cd-9d1b357ea2b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:53.809345 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879fbe1-fcc1-4576-85cd-9d1b357ea2b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:53.809623 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c879fbe1-fcc1-4576-85cd-9d1b357ea2b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:53.865955 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879fbe1-fcc1-4576-85cd-9d1b357ea2b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:53.867465 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c879fbe1-fcc1-4576-85cd-9d1b357ea2b3 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:53.877932 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1210/2388] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:55.921265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:57.605371 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ee584-f8c8-4231-9206-ad23ec276475 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:57.606805 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2f1ee584-f8c8-4231-9206-ad23ec276475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:57.674554 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ee584-f8c8-4231-9206-ad23ec276475 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:57.680268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8b61e-d1d8-42dd-81eb-9584d73ce113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:57.681155 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8b61e-d1d8-42dd-81eb-9584d73ce113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:57.681499 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8b61e-d1d8-42dd-81eb-9584d73ce113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:57.681796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8b61e-d1d8-42dd-81eb-9584d73ce113 admin admin] PATH_INFO: `/v3/users/d795be30a41645c8ab90dd325b8566ee` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:57.683021 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8b61e-d1d8-42dd-81eb-9584d73ce113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d795be30a41645c8ab90dd325b8566ee)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:57.685670 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8b61e-d1d8-42dd-81eb-9584d73ce113 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:57.907932 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d9a8b61e-d1d8-42dd-81eb-9584d73ce113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd795be30a41645c8ab90dd325b8566ee'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:57.908679 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d9a8b61e-d1d8-42dd-81eb-9584d73ce113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd795be30a41645c8ab90dd325b8566ee'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:57.909352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d9a8b61e-d1d8-42dd-81eb-9584d73ce113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd795be30a41645c8ab90dd325b8566ee'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:57.923282 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d9a8b61e-d1d8-42dd-81eb-9584d73ce113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd795be30a41645c8ab90dd325b8566ee'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:57.995956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d9a8b61e-d1d8-42dd-81eb-9584d73ce113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd795be30a41645c8ab90dd325b8566ee'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:58.014515 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1179/2389] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:38:57 2022] DELETE /identity/v3/users/d795be30a41645c8ab90dd325b8566ee => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:38:58.016465 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925891c0-f851-4229-a711-55d3e458276d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:58.016953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925891c0-f851-4229-a711-55d3e458276d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:58.018358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925891c0-f851-4229-a711-55d3e458276d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:58.038752 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-925891c0-f851-4229-a711-55d3e458276d None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:38:58.040158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-925891c0-f851-4229-a711-55d3e458276d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:58.105980 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1211/2390] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:38:58.123237 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8b61e-d1d8-42dd-81eb-9584d73ce113 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:58.127503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d9a8b61e-d1d8-42dd-81eb-9584d73ce113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:58.222707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8b61e-d1d8-42dd-81eb-9584d73ce113 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:58.226825 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d4965-23e1-4b62-956f-a8e3017f882c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:58.227422 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d4965-23e1-4b62-956f-a8e3017f882c service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:58.227708 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d4965-23e1-4b62-956f-a8e3017f882c service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:58.227986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d4965-23e1-4b62-956f-a8e3017f882c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:58.239208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d4965-23e1-4b62-956f-a8e3017f882c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:58.240717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d4965-23e1-4b62-956f-a8e3017f882c service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:58.252718 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1180/2391] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:38:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:38:58.786197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:59.035056 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925891c0-f851-4229-a711-55d3e458276d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:38:59.037486 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-925891c0-f851-4229-a711-55d3e458276d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:38:59.061654 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925891c0-f851-4229-a711-55d3e458276d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:38:59.076206 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da89a1e-40d8-4327-8901-8666adfa1ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:38:59.077612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da89a1e-40d8-4327-8901-8666adfa1ffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:38:59.078116 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da89a1e-40d8-4327-8901-8666adfa1ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:38:59.078561 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da89a1e-40d8-4327-8901-8666adfa1ffb admin admin] PATH_INFO: `/v3/projects/45d3a30821d740acb11ab1060bb073f1` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:38:59.081433 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da89a1e-40d8-4327-8901-8666adfa1ffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=45d3a30821d740acb11ab1060bb073f1)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:38:59.085735 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da89a1e-40d8-4327-8901-8666adfa1ffb admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:38:59.150405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:38:59.234781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8da89a1e-40d8-4327-8901-8666adfa1ffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45d3a30821d740acb11ab1060bb073f1', 'request_id': 'req-8da89a1e-40d8-4327-8901-8666adfa1ffb'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:59.240446 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8da89a1e-40d8-4327-8901-8666adfa1ffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45d3a30821d740acb11ab1060bb073f1', 'request_id': 'req-8da89a1e-40d8-4327-8901-8666adfa1ffb'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:59.251956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8da89a1e-40d8-4327-8901-8666adfa1ffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45d3a30821d740acb11ab1060bb073f1', 'request_id': 'req-8da89a1e-40d8-4327-8901-8666adfa1ffb'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:59.424319 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8da89a1e-40d8-4327-8901-8666adfa1ffb admin admin] The token cache is being invalidate because project 45d3a30821d740acb11ab1060bb073f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:38:59.424618 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8da89a1e-40d8-4327-8901-8666adfa1ffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:59.425314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8da89a1e-40d8-4327-8901-8666adfa1ffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:38:59.426928 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1212/2392] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:38:59 2022] DELETE /identity/v3/projects/45d3a30821d740acb11ab1060bb073f1 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:39:00.676077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:01.162518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:01.923365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d4965-23e1-4b62-956f-a8e3017f882c service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:01.924822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-455d4965-23e1-4b62-956f-a8e3017f882c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:01.981973 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d4965-23e1-4b62-956f-a8e3017f882c service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:02.048575 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bbd015-e14d-4acd-99db-d05abd4531fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:02.048575 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbd015-e14d-4acd-99db-d05abd4531fa service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:02.048575 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbd015-e14d-4acd-99db-d05abd4531fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:02.048575 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bbd015-e14d-4acd-99db-d05abd4531fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:02.051846 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b1bbd015-e14d-4acd-99db-d05abd4531fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:02.119882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bbd015-e14d-4acd-99db-d05abd4531fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:02.121375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bbd015-e14d-4acd-99db-d05abd4531fa service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:02.132272 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1181/2393] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:39:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:39:02.519238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:03.759737 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:04.134353 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:05.153744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:05.336568 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da89a1e-40d8-4327-8901-8666adfa1ffb admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:05.338047 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8da89a1e-40d8-4327-8901-8666adfa1ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:05.404980 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da89a1e-40d8-4327-8901-8666adfa1ffb admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:05.409514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666939d-8406-4d1f-90f7-f647271c418e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:05.410433 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666939d-8406-4d1f-90f7-f647271c418e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:05.410722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666939d-8406-4d1f-90f7-f647271c418e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:05.411008 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e666939d-8406-4d1f-90f7-f647271c418e admin admin] PATH_INFO: `/v3/users/fde47e056b9448dea79d5f3f5761eef4` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:05.412203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666939d-8406-4d1f-90f7-f647271c418e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde47e056b9448dea79d5f3f5761eef4)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:05.414217 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e666939d-8406-4d1f-90f7-f647271c418e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:05.653819 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e666939d-8406-4d1f-90f7-f647271c418e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde47e056b9448dea79d5f3f5761eef4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:05.654485 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e666939d-8406-4d1f-90f7-f647271c418e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde47e056b9448dea79d5f3f5761eef4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:05.655421 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e666939d-8406-4d1f-90f7-f647271c418e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde47e056b9448dea79d5f3f5761eef4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:05.667340 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e666939d-8406-4d1f-90f7-f647271c418e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde47e056b9448dea79d5f3f5761eef4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:05.675224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e666939d-8406-4d1f-90f7-f647271c418e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde47e056b9448dea79d5f3f5761eef4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:05.752088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:05.759272 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1213/2394] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:39:05 2022] DELETE /identity/v3/users/fde47e056b9448dea79d5f3f5761eef4 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:39:05.764059 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292daf5d-ad6e-4830-8565-2b3f3c17465a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:05.764357 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292daf5d-ad6e-4830-8565-2b3f3c17465a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:05.764643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292daf5d-ad6e-4830-8565-2b3f3c17465a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:05.788746 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-292daf5d-ad6e-4830-8565-2b3f3c17465a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:05.790033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-292daf5d-ad6e-4830-8565-2b3f3c17465a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:05.849681 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1182/2395] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:39:05.864555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666939d-8406-4d1f-90f7-f647271c418e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:05.866043 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e666939d-8406-4d1f-90f7-f647271c418e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:05.923898 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e666939d-8406-4d1f-90f7-f647271c418e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:05.927475 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1bd06-6b9d-4194-b0f7-71bf5566b6b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:05.928131 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1bd06-6b9d-4194-b0f7-71bf5566b6b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:05.928420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1bd06-6b9d-4194-b0f7-71bf5566b6b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:05.928704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1bd06-6b9d-4194-b0f7-71bf5566b6b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:05.938029 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1bd06-6b9d-4194-b0f7-71bf5566b6b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:05.939469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1bd06-6b9d-4194-b0f7-71bf5566b6b4 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:05.949633 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1214/2396] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:39:06.476163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292daf5d-ad6e-4830-8565-2b3f3c17465a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:06.480161 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-292daf5d-ad6e-4830-8565-2b3f3c17465a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:06.491618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292daf5d-ad6e-4830-8565-2b3f3c17465a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:06.496302 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1c27ba-ae9a-44f6-a055-68360d39bbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:06.497194 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c27ba-ae9a-44f6-a055-68360d39bbc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:06.497477 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c27ba-ae9a-44f6-a055-68360d39bbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:06.498507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1c27ba-ae9a-44f6-a055-68360d39bbc8 admin admin] PATH_INFO: `/v3/projects/96892b21c83f4cbe92764b8569538504` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:06.500571 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c27ba-ae9a-44f6-a055-68360d39bbc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96892b21c83f4cbe92764b8569538504)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:06.503110 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1c27ba-ae9a-44f6-a055-68360d39bbc8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:06.629326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1e1c27ba-ae9a-44f6-a055-68360d39bbc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96892b21c83f4cbe92764b8569538504', 'request_id': 'req-1e1c27ba-ae9a-44f6-a055-68360d39bbc8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:06.635438 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1e1c27ba-ae9a-44f6-a055-68360d39bbc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96892b21c83f4cbe92764b8569538504', 'request_id': 'req-1e1c27ba-ae9a-44f6-a055-68360d39bbc8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:06.641588 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1e1c27ba-ae9a-44f6-a055-68360d39bbc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96892b21c83f4cbe92764b8569538504', 'request_id': 'req-1e1c27ba-ae9a-44f6-a055-68360d39bbc8'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:06.719295 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1e1c27ba-ae9a-44f6-a055-68360d39bbc8 admin admin] The token cache is being invalidate because project 96892b21c83f4cbe92764b8569538504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:39:06.719493 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1e1c27ba-ae9a-44f6-a055-68360d39bbc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:06.720124 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1e1c27ba-ae9a-44f6-a055-68360d39bbc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:06.721822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1183/2397] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:39:06 2022] DELETE /identity/v3/projects/96892b21c83f4cbe92764b8569538504 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:39:07.555574 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:08.270306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:09.579705 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1bd06-6b9d-4194-b0f7-71bf5566b6b4 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:09.581528 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-40c1bd06-6b9d-4194-b0f7-71bf5566b6b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:09.595455 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1bd06-6b9d-4194-b0f7-71bf5566b6b4 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:09.651307 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cad037-a1cb-4e41-b016-6ed593e2896b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:09.652209 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cad037-a1cb-4e41-b016-6ed593e2896b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:09.652491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cad037-a1cb-4e41-b016-6ed593e2896b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:09.652767 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cad037-a1cb-4e41-b016-6ed593e2896b admin admin] PATH_INFO: `/v3/users/42f0ccfdb7d84684945e4c9e834a5f7b` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:09.654608 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cad037-a1cb-4e41-b016-6ed593e2896b admin admin] RBAC: Authorizing `identity:delete_user(user_id=42f0ccfdb7d84684945e4c9e834a5f7b)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:09.656792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cad037-a1cb-4e41-b016-6ed593e2896b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:09.896707 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-11cad037-a1cb-4e41-b016-6ed593e2896b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42f0ccfdb7d84684945e4c9e834a5f7b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:09.897409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-11cad037-a1cb-4e41-b016-6ed593e2896b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42f0ccfdb7d84684945e4c9e834a5f7b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:09.898130 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-11cad037-a1cb-4e41-b016-6ed593e2896b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42f0ccfdb7d84684945e4c9e834a5f7b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:09.911365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-11cad037-a1cb-4e41-b016-6ed593e2896b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42f0ccfdb7d84684945e4c9e834a5f7b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:09.918167 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-11cad037-a1cb-4e41-b016-6ed593e2896b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42f0ccfdb7d84684945e4c9e834a5f7b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:09.992165 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1215/2398] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:39:09 2022] DELETE /identity/v3/users/42f0ccfdb7d84684945e4c9e834a5f7b => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:39:09.996833 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b816c02-b12d-4283-b09d-f4374c6895b4 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:10.001353 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b816c02-b12d-4283-b09d-f4374c6895b4 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:10.001353 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b816c02-b12d-4283-b09d-f4374c6895b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:10.016522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-4b816c02-b12d-4283-b09d-f4374c6895b4 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:10.017634 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4b816c02-b12d-4283-b09d-f4374c6895b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:10.079853 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1184/2399] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:39:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:39:10.089783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cad037-a1cb-4e41-b016-6ed593e2896b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:10.091690 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-11cad037-a1cb-4e41-b016-6ed593e2896b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:10.153348 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cad037-a1cb-4e41-b016-6ed593e2896b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:10.158531 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be8d37-8cbd-4487-a527-0ee06b208325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:10.159225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be8d37-8cbd-4487-a527-0ee06b208325 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:10.159506 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be8d37-8cbd-4487-a527-0ee06b208325 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:10.159778 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be8d37-8cbd-4487-a527-0ee06b208325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:10.170192 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be8d37-8cbd-4487-a527-0ee06b208325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:10.171632 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be8d37-8cbd-4487-a527-0ee06b208325 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:10.181019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1216/2400] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:39:10.663238 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b816c02-b12d-4283-b09d-f4374c6895b4 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:10.664773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-4b816c02-b12d-4283-b09d-f4374c6895b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:10.686232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b816c02-b12d-4283-b09d-f4374c6895b4 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:10.691292 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aded97-1791-4a5c-b6e2-5d50288f6785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:10.692816 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aded97-1791-4a5c-b6e2-5d50288f6785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:10.693048 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aded97-1791-4a5c-b6e2-5d50288f6785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:10.693385 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aded97-1791-4a5c-b6e2-5d50288f6785 admin admin] PATH_INFO: `/v3/projects/18731eb6618e4e4c845648870febbc72` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:10.694808 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aded97-1791-4a5c-b6e2-5d50288f6785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18731eb6618e4e4c845648870febbc72)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:10.699663 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aded97-1791-4a5c-b6e2-5d50288f6785 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:10.786617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:10.845253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e1aded97-1791-4a5c-b6e2-5d50288f6785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18731eb6618e4e4c845648870febbc72', 'request_id': 'req-e1aded97-1791-4a5c-b6e2-5d50288f6785'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:10.850963 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e1aded97-1791-4a5c-b6e2-5d50288f6785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18731eb6618e4e4c845648870febbc72', 'request_id': 'req-e1aded97-1791-4a5c-b6e2-5d50288f6785'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:10.857363 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e1aded97-1791-4a5c-b6e2-5d50288f6785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18731eb6618e4e4c845648870febbc72', 'request_id': 'req-e1aded97-1791-4a5c-b6e2-5d50288f6785'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:10.974042 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e1aded97-1791-4a5c-b6e2-5d50288f6785 admin admin] The token cache is being invalidate because project 18731eb6618e4e4c845648870febbc72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:39:10.974361 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e1aded97-1791-4a5c-b6e2-5d50288f6785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:10.974974 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e1aded97-1791-4a5c-b6e2-5d50288f6785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:10.976630 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1185/2401] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:39:10 2022] DELETE /identity/v3/projects/18731eb6618e4e4c845648870febbc72 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:39:10.980648 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be8d37-8cbd-4487-a527-0ee06b208325 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:10.990613 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be8d37-8cbd-4487-a527-0ee06b208325 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:11.064581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308e6b18-0b3b-4aa2-bec1-9d0e005f01ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:11.066033 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e6b18-0b3b-4aa2-bec1-9d0e005f01ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:11.066466 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e6b18-0b3b-4aa2-bec1-9d0e005f01ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:11.066895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e6b18-0b3b-4aa2-bec1-9d0e005f01ec admin admin] PATH_INFO: `/v3/users/316755bb4b364635bde713bece942e94` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:11.069595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e6b18-0b3b-4aa2-bec1-9d0e005f01ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=316755bb4b364635bde713bece942e94)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:11.078853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308e6b18-0b3b-4aa2-bec1-9d0e005f01ec admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:11.355833 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:11.374781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-308e6b18-0b3b-4aa2-bec1-9d0e005f01ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '316755bb4b364635bde713bece942e94'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:11.376052 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-308e6b18-0b3b-4aa2-bec1-9d0e005f01ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '316755bb4b364635bde713bece942e94'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:11.376695 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-308e6b18-0b3b-4aa2-bec1-9d0e005f01ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '316755bb4b364635bde713bece942e94'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:11.393061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-308e6b18-0b3b-4aa2-bec1-9d0e005f01ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '316755bb4b364635bde713bece942e94'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:11.400265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-308e6b18-0b3b-4aa2-bec1-9d0e005f01ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '316755bb4b364635bde713bece942e94'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:11.495170 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1217/2402] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:39:10 2022] DELETE /identity/v3/users/316755bb4b364635bde713bece942e94 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:39:11.954084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aded97-1791-4a5c-b6e2-5d50288f6785 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:11.955530 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e1aded97-1791-4a5c-b6e2-5d50288f6785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:11.968693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aded97-1791-4a5c-b6e2-5d50288f6785 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:12.032575 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8be19-e88c-49df-b320-b1db515cf0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:12.033488 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8be19-e88c-49df-b320-b1db515cf0f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:12.033931 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8be19-e88c-49df-b320-b1db515cf0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:12.034219 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8be19-e88c-49df-b320-b1db515cf0f9 admin admin] PATH_INFO: `/v3/projects/0dd022f8c7b8403d948e12c3572e41b7` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:12.035418 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8be19-e88c-49df-b320-b1db515cf0f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dd022f8c7b8403d948e12c3572e41b7)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:12.037400 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8be19-e88c-49df-b320-b1db515cf0f9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:12.184516 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3ff8be19-e88c-49df-b320-b1db515cf0f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dd022f8c7b8403d948e12c3572e41b7', 'request_id': 'req-3ff8be19-e88c-49df-b320-b1db515cf0f9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:12.190730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3ff8be19-e88c-49df-b320-b1db515cf0f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dd022f8c7b8403d948e12c3572e41b7', 'request_id': 'req-3ff8be19-e88c-49df-b320-b1db515cf0f9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:12.200356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3ff8be19-e88c-49df-b320-b1db515cf0f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dd022f8c7b8403d948e12c3572e41b7', 'request_id': 'req-3ff8be19-e88c-49df-b320-b1db515cf0f9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:12.279455 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3ff8be19-e88c-49df-b320-b1db515cf0f9 admin admin] The token cache is being invalidate because project 0dd022f8c7b8403d948e12c3572e41b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:39:12.279754 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3ff8be19-e88c-49df-b320-b1db515cf0f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:12.281306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3ff8be19-e88c-49df-b320-b1db515cf0f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:12.287819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1186/2403] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:39:11 2022] DELETE /identity/v3/projects/0dd022f8c7b8403d948e12c3572e41b7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:39:12.291133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5084474-48d3-47b8-869c-c50b8b57c7bd None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:12.291133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5084474-48d3-47b8-869c-c50b8b57c7bd None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:12.291133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5084474-48d3-47b8-869c-c50b8b57c7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:12.316959 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a5084474-48d3-47b8-869c-c50b8b57c7bd None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:12.318368 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a5084474-48d3-47b8-869c-c50b8b57c7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:12.412855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1218/2404] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:39:12.415458 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1788818-534b-4b48-b4a4-07fa59b0219d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:12.415969 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1788818-534b-4b48-b4a4-07fa59b0219d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:12.416312 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1788818-534b-4b48-b4a4-07fa59b0219d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:12.441285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-a1788818-534b-4b48-b4a4-07fa59b0219d None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:12.442739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a1788818-534b-4b48-b4a4-07fa59b0219d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:12.451918 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1187/2405] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:39:12.456674 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5084474-48d3-47b8-869c-c50b8b57c7bd None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:12.469139 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5084474-48d3-47b8-869c-c50b8b57c7bd None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:12.475288 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad32d3-586f-43e9-a7aa-dfde3500196f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:12.476073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad32d3-586f-43e9-a7aa-dfde3500196f admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:12.476479 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad32d3-586f-43e9-a7aa-dfde3500196f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:12.477547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad32d3-586f-43e9-a7aa-dfde3500196f admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:12.478580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad32d3-586f-43e9-a7aa-dfde3500196f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:39:12.479066 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad32d3-586f-43e9-a7aa-dfde3500196f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:12.480946 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad32d3-586f-43e9-a7aa-dfde3500196f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:12.504825 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1219/2406] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:39:12.511624 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1788818-534b-4b48-b4a4-07fa59b0219d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:12.523996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1788818-534b-4b48-b4a4-07fa59b0219d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:12.529305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d5e52-ad76-4a70-992d-d850ed982075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:12.530072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d5e52-ad76-4a70-992d-d850ed982075 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:12.530383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d5e52-ad76-4a70-992d-d850ed982075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:12.530668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8d5e52-ad76-4a70-992d-d850ed982075 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:12.531638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d5e52-ad76-4a70-992d-d850ed982075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:12.533621 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8d5e52-ad76-4a70-992d-d850ed982075 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:12.539421 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7610d5f-d889-4a2d-9e75-8ef3d0765875 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:12.539714 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7610d5f-d889-4a2d-9e75-8ef3d0765875 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:12.540928 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7610d5f-d889-4a2d-9e75-8ef3d0765875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:12.568156 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-f7610d5f-d889-4a2d-9e75-8ef3d0765875 None None] MFA Rules not processed for user `01113a3f8cbf46b09fb5fcf4315a219b`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:12.569595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f7610d5f-d889-4a2d-9e75-8ef3d0765875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:12.644076 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1220/2407] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jul 18 02:39:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:39:12.671280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1188/2408] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:39:12 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:39:12.678697 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7610d5f-d889-4a2d-9e75-8ef3d0765875 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:12.703689 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7610d5f-d889-4a2d-9e75-8ef3d0765875 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:12.706466 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d5e52-ad76-4a70-992d-d850ed982075 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:12.709118 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7f8d5e52-ad76-4a70-992d-d850ed982075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:12.797424 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8d5e52-ad76-4a70-992d-d850ed982075 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:12.803236 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29e708-7627-475f-83c0-80b8dd29d8e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4e51f478874d99a7fc4ee2dea77caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:12.803918 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29e708-7627-475f-83c0-80b8dd29d8e7 service swift] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:12.804193 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29e708-7627-475f-83c0-80b8dd29d8e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:12.804475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29e708-7627-475f-83c0-80b8dd29d8e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:12.815628 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa6a0f-551e-4a9a-a18d-2ec526fa4983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:12.816332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa6a0f-551e-4a9a-a18d-2ec526fa4983 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:12.816614 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa6a0f-551e-4a9a-a18d-2ec526fa4983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:12.816896 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaa6a0f-551e-4a9a-a18d-2ec526fa4983 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:12.817614 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa6a0f-551e-4a9a-a18d-2ec526fa4983 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:12.819604 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaa6a0f-551e-4a9a-a18d-2ec526fa4983 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:12.878908 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29e708-7627-475f-83c0-80b8dd29d8e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:12.880519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29e708-7627-475f-83c0-80b8dd29d8e7 service swift] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:12.889231 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1189/2409] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jul 18 02:39:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 02:39:12.947903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1221/2410] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:39:12 2022] POST /identity/v3/users => generated 288 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:39:12.948729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29e708-7627-475f-83c0-80b8dd29d8e7 service swift] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:12.963014 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29e708-7627-475f-83c0-80b8dd29d8e7 service swift] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:12.979674 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f485ec8-24db-4583-8ef4-6bab4a4b65e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:12.980684 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f485ec8-24db-4583-8ef4-6bab4a4b65e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:12.981127 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f485ec8-24db-4583-8ef4-6bab4a4b65e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:12.981628 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f485ec8-24db-4583-8ef4-6bab4a4b65e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:12.982889 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f485ec8-24db-4583-8ef4-6bab4a4b65e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:12.984676 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f485ec8-24db-4583-8ef4-6bab4a4b65e0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:12.996376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1190/2411] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:39:13.001079 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa6a0f-551e-4a9a-a18d-2ec526fa4983 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:13.012289 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaa6a0f-551e-4a9a-a18d-2ec526fa4983 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:13.022249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1463a-aff2-487f-9268-8fd22584dd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:13.022948 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1463a-aff2-487f-9268-8fd22584dd32 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:13.023239 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1463a-aff2-487f-9268-8fd22584dd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:13.023517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1463a-aff2-487f-9268-8fd22584dd32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:13.024267 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1463a-aff2-487f-9268-8fd22584dd32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:13.025961 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1463a-aff2-487f-9268-8fd22584dd32 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:13.039344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1222/2412] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:39:13.043441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f485ec8-24db-4583-8ef4-6bab4a4b65e0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:13.058872 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f485ec8-24db-4583-8ef4-6bab4a4b65e0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:13.066003 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf1c18-6576-46fa-b1ac-d85c9972955e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:13.069239 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf1c18-6576-46fa-b1ac-d85c9972955e admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:13.069239 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf1c18-6576-46fa-b1ac-d85c9972955e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:13.069239 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cf1c18-6576-46fa-b1ac-d85c9972955e admin admin] PATH_INFO: `/v3/projects/9a539caae89644f4a599a9c0e007c0fc/users/56f8c8aa73a2484e980c4c4a2f271b0f/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:13.088826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf1c18-6576-46fa-b1ac-d85c9972955e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a539caae89644f4a599a9c0e007c0fc, user_id=56f8c8aa73a2484e980c4c4a2f271b0f, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:13.093525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cf1c18-6576-46fa-b1ac-d85c9972955e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:13.220030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1191/2413] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:39:13 2022] PUT /identity/v3/projects/9a539caae89644f4a599a9c0e007c0fc/users/56f8c8aa73a2484e980c4c4a2f271b0f/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:39:13.234010 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ccf95-5f87-4faa-ab65-6f51d9e6ffda None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:13.234450 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ccf95-5f87-4faa-ab65-6f51d9e6ffda None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:13.234779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ccf95-5f87-4faa-ab65-6f51d9e6ffda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:13.283111 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-e85ccf95-5f87-4faa-ab65-6f51d9e6ffda None None] MFA Rules not processed for user `56f8c8aa73a2484e980c4c4a2f271b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:13.284472 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e85ccf95-5f87-4faa-ab65-6f51d9e6ffda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:13.399475 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1223/2414] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:39:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:39:13.411768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf1c18-6576-46fa-b1ac-d85c9972955e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:13.414048 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-80cf1c18-6576-46fa-b1ac-d85c9972955e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:13.427175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:13.487662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cf1c18-6576-46fa-b1ac-d85c9972955e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:13.491934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc4f89-a84f-4a44-a75d-454d67102c34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:13.492629 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc4f89-a84f-4a44-a75d-454d67102c34 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:13.492919 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc4f89-a84f-4a44-a75d-454d67102c34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:13.493203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc4f89-a84f-4a44-a75d-454d67102c34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:13.504023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc4f89-a84f-4a44-a75d-454d67102c34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:13.505680 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acc4f89-a84f-4a44-a75d-454d67102c34 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:13.518138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1192/2415] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:39:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:39:13.944718 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:14.827123 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:14.949886 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:15.656068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:17.059266 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:17.844961 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:18.221316 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ccf95-5f87-4faa-ab65-6f51d9e6ffda None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:18.286362 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ccf95-5f87-4faa-ab65-6f51d9e6ffda None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:18.290918 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bf87e-e639-44fe-b328-7332476f81a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:18.291804 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bf87e-e639-44fe-b328-7332476f81a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:18.292091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bf87e-e639-44fe-b328-7332476f81a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:18.292374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039bf87e-e639-44fe-b328-7332476f81a9 admin admin] PATH_INFO: `/v3/users/56f8c8aa73a2484e980c4c4a2f271b0f` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:18.293636 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039bf87e-e639-44fe-b328-7332476f81a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56f8c8aa73a2484e980c4c4a2f271b0f)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:18.296236 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039bf87e-e639-44fe-b328-7332476f81a9 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:18.322284 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:18.490829 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-039bf87e-e639-44fe-b328-7332476f81a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56f8c8aa73a2484e980c4c4a2f271b0f'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:18.490829 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-039bf87e-e639-44fe-b328-7332476f81a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56f8c8aa73a2484e980c4c4a2f271b0f'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:18.490829 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-039bf87e-e639-44fe-b328-7332476f81a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56f8c8aa73a2484e980c4c4a2f271b0f'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:18.504126 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-039bf87e-e639-44fe-b328-7332476f81a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56f8c8aa73a2484e980c4c4a2f271b0f'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:18.512440 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-039bf87e-e639-44fe-b328-7332476f81a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56f8c8aa73a2484e980c4c4a2f271b0f'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:18.704619 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1224/2416] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:39:18 2022] DELETE /identity/v3/users/56f8c8aa73a2484e980c4c4a2f271b0f => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:39:18.707356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ba0e0-e708-46c9-9cfd-b642104f34d7 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:18.707653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ba0e0-e708-46c9-9cfd-b642104f34d7 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:18.707938 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ba0e0-e708-46c9-9cfd-b642104f34d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:18.728856 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-560ba0e0-e708-46c9-9cfd-b642104f34d7 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:18.730377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-560ba0e0-e708-46c9-9cfd-b642104f34d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:18.804886 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1193/2417] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:39:18.815733 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bf87e-e639-44fe-b328-7332476f81a9 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:18.818308 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-039bf87e-e639-44fe-b328-7332476f81a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:18.889189 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039bf87e-e639-44fe-b328-7332476f81a9 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:18.895719 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a57a7-7cc2-4a03-a7c7-b6372e779f2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:18.896405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a57a7-7cc2-4a03-a7c7-b6372e779f2d service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:18.896696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a57a7-7cc2-4a03-a7c7-b6372e779f2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:18.896979 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a57a7-7cc2-4a03-a7c7-b6372e779f2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:18.908416 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a57a7-7cc2-4a03-a7c7-b6372e779f2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:18.909784 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a57a7-7cc2-4a03-a7c7-b6372e779f2d service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:18.920171 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1225/2418] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:39:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:39:18.951145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:19.183077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:19.393256 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ba0e0-e708-46c9-9cfd-b642104f34d7 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:19.395582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-560ba0e0-e708-46c9-9cfd-b642104f34d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:19.420348 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ba0e0-e708-46c9-9cfd-b642104f34d7 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:19.425771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a0bd5-1662-4982-86e8-e56e1a094aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:19.426858 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a0bd5-1662-4982-86e8-e56e1a094aa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:19.427516 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a0bd5-1662-4982-86e8-e56e1a094aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:19.427661 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a0bd5-1662-4982-86e8-e56e1a094aa3 admin admin] PATH_INFO: `/v3/projects/9a539caae89644f4a599a9c0e007c0fc` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:19.428898 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a0bd5-1662-4982-86e8-e56e1a094aa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a539caae89644f4a599a9c0e007c0fc)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:19.430902 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a0bd5-1662-4982-86e8-e56e1a094aa3 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:19.555884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e16a0bd5-1662-4982-86e8-e56e1a094aa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a539caae89644f4a599a9c0e007c0fc', 'request_id': 'req-e16a0bd5-1662-4982-86e8-e56e1a094aa3'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:19.562159 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e16a0bd5-1662-4982-86e8-e56e1a094aa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a539caae89644f4a599a9c0e007c0fc', 'request_id': 'req-e16a0bd5-1662-4982-86e8-e56e1a094aa3'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:19.569076 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e16a0bd5-1662-4982-86e8-e56e1a094aa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a539caae89644f4a599a9c0e007c0fc', 'request_id': 'req-e16a0bd5-1662-4982-86e8-e56e1a094aa3'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:19.642379 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e16a0bd5-1662-4982-86e8-e56e1a094aa3 admin admin] The token cache is being invalidate because project 9a539caae89644f4a599a9c0e007c0fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:39:19.642839 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e16a0bd5-1662-4982-86e8-e56e1a094aa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:19.643586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e16a0bd5-1662-4982-86e8-e56e1a094aa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:19.645336 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1194/2419] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:39:19 2022] DELETE /identity/v3/projects/9a539caae89644f4a599a9c0e007c0fc => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:39:19.650331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f3278-72f6-47d8-a261-19ea1e4949c9 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:19.651069 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f3278-72f6-47d8-a261-19ea1e4949c9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:19.651575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f3278-72f6-47d8-a261-19ea1e4949c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:19.674862 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b61f3278-72f6-47d8-a261-19ea1e4949c9 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:19.676435 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b61f3278-72f6-47d8-a261-19ea1e4949c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:19.749680 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1226/2420] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:39:19.759075 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350024c-7ee5-4b60-a496-af5885c84bde None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:19.759365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350024c-7ee5-4b60-a496-af5885c84bde None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:19.759832 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350024c-7ee5-4b60-a496-af5885c84bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:19.780726 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6350024c-7ee5-4b60-a496-af5885c84bde None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:19.784489 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6350024c-7ee5-4b60-a496-af5885c84bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:19.790957 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1195/2421] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:39:19.795369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f3278-72f6-47d8-a261-19ea1e4949c9 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:19.805450 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f3278-72f6-47d8-a261-19ea1e4949c9 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:19.810939 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237e189-6017-4e64-8fd6-fdd28bca12a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:19.812135 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237e189-6017-4e64-8fd6-fdd28bca12a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:19.812420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237e189-6017-4e64-8fd6-fdd28bca12a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:19.812729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237e189-6017-4e64-8fd6-fdd28bca12a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:19.813520 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9237e189-6017-4e64-8fd6-fdd28bca12a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:39:19.814038 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9237e189-6017-4e64-8fd6-fdd28bca12a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:19.815641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9237e189-6017-4e64-8fd6-fdd28bca12a7 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:19.834037 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1227/2422] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:39:19.839411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350024c-7ee5-4b60-a496-af5885c84bde None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:19.848843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350024c-7ee5-4b60-a496-af5885c84bde None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:19.853807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5dc7a-33d2-4679-b84e-ab3189876313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:19.854470 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5dc7a-33d2-4679-b84e-ab3189876313 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:19.854755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5dc7a-33d2-4679-b84e-ab3189876313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:19.855033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5dc7a-33d2-4679-b84e-ab3189876313 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:19.855764 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5dc7a-33d2-4679-b84e-ab3189876313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:19.857686 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5dc7a-33d2-4679-b84e-ab3189876313 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:19.967222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1196/2423] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:39:19 2022] POST /identity/v3/projects => generated 375 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:39:19.971711 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237e189-6017-4e64-8fd6-fdd28bca12a7 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:19.982331 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237e189-6017-4e64-8fd6-fdd28bca12a7 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:20.048874 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b390ed-82c0-40f9-93ec-78b3c50c6b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:20.049656 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b390ed-82c0-40f9-93ec-78b3c50c6b56 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:20.050314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b390ed-82c0-40f9-93ec-78b3c50c6b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:20.050698 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b390ed-82c0-40f9-93ec-78b3c50c6b56 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:20.051729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b390ed-82c0-40f9-93ec-78b3c50c6b56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:20.053985 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b390ed-82c0-40f9-93ec-78b3c50c6b56 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:20.189753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1228/2424] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:39:19 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:39:20.193799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5dc7a-33d2-4679-b84e-ab3189876313 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:20.205029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5dc7a-33d2-4679-b84e-ab3189876313 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:20.210958 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615f2c2-2172-4768-aa15-5771fa2fa80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:20.211722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615f2c2-2172-4768-aa15-5771fa2fa80d admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:20.212082 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615f2c2-2172-4768-aa15-5771fa2fa80d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:20.212433 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615f2c2-2172-4768-aa15-5771fa2fa80d admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:20.213167 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615f2c2-2172-4768-aa15-5771fa2fa80d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:20.214897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2615f2c2-2172-4768-aa15-5771fa2fa80d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:20.227313 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1197/2425] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:39:20.233869 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b390ed-82c0-40f9-93ec-78b3c50c6b56 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:20.242831 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b390ed-82c0-40f9-93ec-78b3c50c6b56 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:20.247890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4636b2e6-697e-49ef-b899-934787e2d8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:20.248582 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636b2e6-697e-49ef-b899-934787e2d8fe admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:20.249448 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636b2e6-697e-49ef-b899-934787e2d8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:20.249819 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4636b2e6-697e-49ef-b899-934787e2d8fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:20.250555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636b2e6-697e-49ef-b899-934787e2d8fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:20.252276 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4636b2e6-697e-49ef-b899-934787e2d8fe admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:20.264425 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1229/2426] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:39:20.268943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615f2c2-2172-4768-aa15-5771fa2fa80d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:20.278902 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615f2c2-2172-4768-aa15-5771fa2fa80d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:20.284374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0caee1-a62a-401c-ac59-ae19d4725b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:20.285265 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0caee1-a62a-401c-ac59-ae19d4725b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:20.285538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0caee1-a62a-401c-ac59-ae19d4725b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:20.285844 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0caee1-a62a-401c-ac59-ae19d4725b4b admin admin] PATH_INFO: `/v3/projects/96c51139aed94ef8aed4054a8e5b2b7a/users/a720de5be662441fb2e8a90abdaa33cd/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:20.303728 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0caee1-a62a-401c-ac59-ae19d4725b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c51139aed94ef8aed4054a8e5b2b7a, user_id=a720de5be662441fb2e8a90abdaa33cd, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:20.306426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0caee1-a62a-401c-ac59-ae19d4725b4b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:20.377272 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1198/2427] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:39:20 2022] PUT /identity/v3/projects/96c51139aed94ef8aed4054a8e5b2b7a/users/a720de5be662441fb2e8a90abdaa33cd/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:39:20.452089 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd13f3-8dca-428b-a2ce-ec87be7867e2 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:20.455419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd13f3-8dca-428b-a2ce-ec87be7867e2 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:20.455419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd13f3-8dca-428b-a2ce-ec87be7867e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:20.484099 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b2cd13f3-8dca-428b-a2ce-ec87be7867e2 None None] MFA Rules not processed for user `a720de5be662441fb2e8a90abdaa33cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:20.484099 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b2cd13f3-8dca-428b-a2ce-ec87be7867e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:20.507276 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:20.566756 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1230/2428] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:39:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:39:20.575912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0caee1-a62a-401c-ac59-ae19d4725b4b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:20.578546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3e0caee1-a62a-401c-ac59-ae19d4725b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:20.639427 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0caee1-a62a-401c-ac59-ae19d4725b4b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:20.643123 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd073bd-0071-4d86-8735-26dc740ec38e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:20.643902 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd073bd-0071-4d86-8735-26dc740ec38e service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:20.644182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd073bd-0071-4d86-8735-26dc740ec38e service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:20.644454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd073bd-0071-4d86-8735-26dc740ec38e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:20.651817 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:20.654152 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd073bd-0071-4d86-8735-26dc740ec38e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:20.656202 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd073bd-0071-4d86-8735-26dc740ec38e service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:20.665503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1199/2429] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:39:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:39:21.665800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:21.908491 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:22.393963 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:23.063538 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:23.406426 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430afc4-c85c-43d2-8ff4-26d7c7bc02a6 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:23.406748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430afc4-c85c-43d2-8ff4-26d7c7bc02a6 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:23.407038 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430afc4-c85c-43d2-8ff4-26d7c7bc02a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:23.426521 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-5430afc4-c85c-43d2-8ff4-26d7c7bc02a6 None None] MFA Rules not processed for user `a720de5be662441fb2e8a90abdaa33cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:23.428279 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5430afc4-c85c-43d2-8ff4-26d7c7bc02a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:23.437913 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1231/2430] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:39:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:39:23.694778 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:24.074867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:25.494779 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:25.940909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:27.661540 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:27.870417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:28.453502 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:28.630457 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:28.893305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:29.756015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:29.889757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:30.796251 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:31.012528 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:31.343714 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:31.404411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9a05c-2f7b-4990-ad7b-adabd2497e52 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:31.404792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9a05c-2f7b-4990-ad7b-adabd2497e52 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:31.405178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c9a05c-2f7b-4990-ad7b-adabd2497e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:31.425203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-62c9a05c-2f7b-4990-ad7b-adabd2497e52 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:31.426505 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-62c9a05c-2f7b-4990-ad7b-adabd2497e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:31.502699 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1200/2431] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Jul 18 02:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:39:31.533203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430afc4-c85c-43d2-8ff4-26d7c7bc02a6 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:31.535047 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5430afc4-c85c-43d2-8ff4-26d7c7bc02a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:31.618232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:31.621479 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430afc4-c85c-43d2-8ff4-26d7c7bc02a6 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:31.628102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee56bfb-3206-4b07-93de-3458866872ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:31.629098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee56bfb-3206-4b07-93de-3458866872ce service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:31.629098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee56bfb-3206-4b07-93de-3458866872ce service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:31.629554 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee56bfb-3206-4b07-93de-3458866872ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:31.638902 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee56bfb-3206-4b07-93de-3458866872ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:31.640969 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee56bfb-3206-4b07-93de-3458866872ce service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:31.652686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1232/2432] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:39:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:39:31.804837 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:31.961870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:31.979360 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:32.378677 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=81,keystone:INSERT=3,keystone:DELETE=16 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:32.452583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:33.484586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:33.509738 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:34.247952 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:34.284809 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:35.804889 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:35.856455 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:36.516139 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:36.739805 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a5d20-8740-40b0-8a37-3eb27426431d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:36.740094 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a5d20-8740-40b0-8a37-3eb27426431d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:36.740375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a5d20-8740-40b0-8a37-3eb27426431d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:36.759467 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-af8a5d20-8740-40b0-8a37-3eb27426431d None None] MFA Rules not processed for user `01113a3f8cbf46b09fb5fcf4315a219b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:36.760763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-af8a5d20-8740-40b0-8a37-3eb27426431d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:36.763131 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54422da1-b2ea-4abf-8b73-fd84c09f43ed None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:36.763624 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54422da1-b2ea-4abf-8b73-fd84c09f43ed None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:36.764030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54422da1-b2ea-4abf-8b73-fd84c09f43ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:36.784583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-54422da1-b2ea-4abf-8b73-fd84c09f43ed None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:36.786839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-54422da1-b2ea-4abf-8b73-fd84c09f43ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:36.798170 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1233/2433] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Jul 18 02:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:39:36.818582 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54422da1-b2ea-4abf-8b73-fd84c09f43ed None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:36.825617 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1201/2434] 10.222.0.64 () {58 vars in 967 bytes} [Mon Jul 18 02:39:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:39:36.840564 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54422da1-b2ea-4abf-8b73-fd84c09f43ed None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:36.843819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a5d20-8740-40b0-8a37-3eb27426431d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:36.846420 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-af8a5d20-8740-40b0-8a37-3eb27426431d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:36.850784 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7f628-eb1d-4625-8bd0-17ddb4c67342 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:36.851539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7f628-eb1d-4625-8bd0-17ddb4c67342 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:36.851879 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7f628-eb1d-4625-8bd0-17ddb4c67342 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:36.852230 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7f628-eb1d-4625-8bd0-17ddb4c67342 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:36.870982 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7f628-eb1d-4625-8bd0-17ddb4c67342 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:36.873030 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7f628-eb1d-4625-8bd0-17ddb4c67342 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:36.886004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1234/2435] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:39:36.935645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a5d20-8740-40b0-8a37-3eb27426431d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:36.947608 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6d452-988c-4f26-9efe-c9042b407d0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4e51f478874d99a7fc4ee2dea77caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:36.947943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6d452-988c-4f26-9efe-c9042b407d0e service swift] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:36.948202 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6d452-988c-4f26-9efe-c9042b407d0e service swift] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:36.948479 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6d452-988c-4f26-9efe-c9042b407d0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:36.958990 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6d452-988c-4f26-9efe-c9042b407d0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:36.961492 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6d452-988c-4f26-9efe-c9042b407d0e service swift] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:36.977181 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1202/2436] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jul 18 02:39:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 02:39:37.436433 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:37.470753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:37.722043 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:37.750542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:37.813163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:37.845930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:37.956961 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:37.985013 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:38.268279 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:38.522249 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:38.740249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:38.890701 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:39.050751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:39.269349 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:39.356873 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:39.602431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:39.685460 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:39.719534 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:39.931553 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:40.002430 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:40.054197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:40.316680 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:40.397477 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7f628-eb1d-4625-8bd0-17ddb4c67342 service nova] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:40.398944 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-18d7f628-eb1d-4625-8bd0-17ddb4c67342 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:40.412790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7f628-eb1d-4625-8bd0-17ddb4c67342 service nova] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:40.415374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:40.423950 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476a3f4-3bc2-492d-86ac-f786d428d36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:40.423950 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476a3f4-3bc2-492d-86ac-f786d428d36b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:40.423950 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476a3f4-3bc2-492d-86ac-f786d428d36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:40.423950 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476a3f4-3bc2-492d-86ac-f786d428d36b admin admin] PATH_INFO: `/v3/users/d9ac86461ecd4e6baa6b11fe869e8a4b` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:40.424334 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476a3f4-3bc2-492d-86ac-f786d428d36b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ac86461ecd4e6baa6b11fe869e8a4b)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:40.425964 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7476a3f4-3bc2-492d-86ac-f786d428d36b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:40.625192 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-7476a3f4-3bc2-492d-86ac-f786d428d36b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ac86461ecd4e6baa6b11fe869e8a4b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:40.625977 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-7476a3f4-3bc2-492d-86ac-f786d428d36b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ac86461ecd4e6baa6b11fe869e8a4b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:40.626662 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-7476a3f4-3bc2-492d-86ac-f786d428d36b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ac86461ecd4e6baa6b11fe869e8a4b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:40.639591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-7476a3f4-3bc2-492d-86ac-f786d428d36b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ac86461ecd4e6baa6b11fe869e8a4b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:40.647629 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-7476a3f4-3bc2-492d-86ac-f786d428d36b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ac86461ecd4e6baa6b11fe869e8a4b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:40.747510 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1235/2437] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:39:40 2022] DELETE /identity/v3/users/d9ac86461ecd4e6baa6b11fe869e8a4b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:39:40.955200 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:40.984491 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6d452-988c-4f26-9efe-c9042b407d0e service swift] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:40.998058 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6d452-988c-4f26-9efe-c9042b407d0e service swift] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:41.048804 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:41.060582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2972a7a-38a0-4d23-8829-64786228df6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:41.061460 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2972a7a-38a0-4d23-8829-64786228df6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:41.061777 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2972a7a-38a0-4d23-8829-64786228df6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:41.062056 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2972a7a-38a0-4d23-8829-64786228df6c admin admin] PATH_INFO: `/v3/projects/947bf78e0d9e4a9797485fefd117afb3` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:41.063249 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2972a7a-38a0-4d23-8829-64786228df6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=947bf78e0d9e4a9797485fefd117afb3)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:41.065286 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2972a7a-38a0-4d23-8829-64786228df6c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:41.222935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b2972a7a-38a0-4d23-8829-64786228df6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947bf78e0d9e4a9797485fefd117afb3', 'request_id': 'req-b2972a7a-38a0-4d23-8829-64786228df6c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:41.228609 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b2972a7a-38a0-4d23-8829-64786228df6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947bf78e0d9e4a9797485fefd117afb3', 'request_id': 'req-b2972a7a-38a0-4d23-8829-64786228df6c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:41.234690 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b2972a7a-38a0-4d23-8829-64786228df6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947bf78e0d9e4a9797485fefd117afb3', 'request_id': 'req-b2972a7a-38a0-4d23-8829-64786228df6c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:41.376156 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b2972a7a-38a0-4d23-8829-64786228df6c admin admin] The token cache is being invalidate because project 947bf78e0d9e4a9797485fefd117afb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:39:41.376813 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b2972a7a-38a0-4d23-8829-64786228df6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:41.377132 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b2972a7a-38a0-4d23-8829-64786228df6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:41.378751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1203/2438] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:39:40 2022] DELETE /identity/v3/projects/947bf78e0d9e4a9797485fefd117afb3 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:39:41.383713 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461808cb-3c3d-401e-94fa-f5248d2c618b None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:41.384029 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461808cb-3c3d-401e-94fa-f5248d2c618b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:41.391365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461808cb-3c3d-401e-94fa-f5248d2c618b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:41.393008 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368bea6-452d-4578-a239-3a96c087e0d6 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:41.393299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368bea6-452d-4578-a239-3a96c087e0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:41.393586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368bea6-452d-4578-a239-3a96c087e0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:41.402191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-461808cb-3c3d-401e-94fa-f5248d2c618b None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:41.403400 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-461808cb-3c3d-401e-94fa-f5248d2c618b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:41.412315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-9368bea6-452d-4578-a239-3a96c087e0d6 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:41.414682 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9368bea6-452d-4578-a239-3a96c087e0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:41.464972 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1236/2439] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:39:41.473192 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1204/2440] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Jul 18 02:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:39:41.473425 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb70da-082a-4443-85b9-e210116ab4e9 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:41.473592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb70da-082a-4443-85b9-e210116ab4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:41.473919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb70da-082a-4443-85b9-e210116ab4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:41.493733 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-06fb70da-082a-4443-85b9-e210116ab4e9 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:41.494312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-06fb70da-082a-4443-85b9-e210116ab4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:41.497091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368bea6-452d-4578-a239-3a96c087e0d6 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:41.498478 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9368bea6-452d-4578-a239-3a96c087e0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:41.502759 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1237/2441] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:39:41.508280 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb70da-082a-4443-85b9-e210116ab4e9 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:41.517417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fb70da-082a-4443-85b9-e210116ab4e9 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:41.522282 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354583e-5831-4806-955f-9ee74729b632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:41.522940 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354583e-5831-4806-955f-9ee74729b632 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:41.523227 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354583e-5831-4806-955f-9ee74729b632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:41.523509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354583e-5831-4806-955f-9ee74729b632 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:41.524356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354583e-5831-4806-955f-9ee74729b632 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:39:41.524664 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354583e-5831-4806-955f-9ee74729b632 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:41.526298 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354583e-5831-4806-955f-9ee74729b632 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:41.539543 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1238/2442] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 02:39:41.543828 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354583e-5831-4806-955f-9ee74729b632 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:41.554563 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354583e-5831-4806-955f-9ee74729b632 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:41.559401 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112203e-272e-4005-b6b3-b20d2576f8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:41.560059 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112203e-272e-4005-b6b3-b20d2576f8f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:41.560372 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112203e-272e-4005-b6b3-b20d2576f8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:41.560656 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112203e-272e-4005-b6b3-b20d2576f8f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:41.561348 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112203e-272e-4005-b6b3-b20d2576f8f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:41.563332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112203e-272e-4005-b6b3-b20d2576f8f3 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:41.571971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368bea6-452d-4578-a239-3a96c087e0d6 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:41.577548 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:41.593256 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d01823-7cbc-4ed1-8474-3503d636be4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:41.593256 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d01823-7cbc-4ed1-8474-3503d636be4c service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:41.593256 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d01823-7cbc-4ed1-8474-3503d636be4c service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:41.593256 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d01823-7cbc-4ed1-8474-3503d636be4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:41.593687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d01823-7cbc-4ed1-8474-3503d636be4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:41.593687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d01823-7cbc-4ed1-8474-3503d636be4c service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:41.600947 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1205/2443] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:39:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:39:41.611425 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:41.675786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1239/2444] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:39:41 2022] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:39:41.681947 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d01823-7cbc-4ed1-8474-3503d636be4c service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:41.693584 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d01823-7cbc-4ed1-8474-3503d636be4c service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:41.775153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0635037-9f2f-4bfe-9131-08131b256fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:41.775831 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0635037-9f2f-4bfe-9131-08131b256fe4 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:41.776160 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0635037-9f2f-4bfe-9131-08131b256fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:41.777172 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0635037-9f2f-4bfe-9131-08131b256fe4 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:41.777295 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0635037-9f2f-4bfe-9131-08131b256fe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:41.779179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0635037-9f2f-4bfe-9131-08131b256fe4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:41.803101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:41.885924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1206/2445] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:39:41 2022] POST /identity/v3/users => generated 285 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:39:41.887768 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112203e-272e-4005-b6b3-b20d2576f8f3 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:41.900304 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112203e-272e-4005-b6b3-b20d2576f8f3 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:41.905077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896c2e6-9390-4063-9c1d-69a2be23de3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:41.906117 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896c2e6-9390-4063-9c1d-69a2be23de3d admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:41.906589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896c2e6-9390-4063-9c1d-69a2be23de3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:41.906937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b896c2e6-9390-4063-9c1d-69a2be23de3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:41.907952 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896c2e6-9390-4063-9c1d-69a2be23de3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:41.909522 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b896c2e6-9390-4063-9c1d-69a2be23de3d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:41.921643 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1240/2446] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:39:41.925662 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0635037-9f2f-4bfe-9131-08131b256fe4 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:41.941333 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0635037-9f2f-4bfe-9131-08131b256fe4 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:41.947428 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14318e21-a77c-4524-8b42-870141adddee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:41.948140 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14318e21-a77c-4524-8b42-870141adddee admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:41.948432 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14318e21-a77c-4524-8b42-870141adddee admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:41.948712 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14318e21-a77c-4524-8b42-870141adddee admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:41.949446 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14318e21-a77c-4524-8b42-870141adddee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:41.951078 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14318e21-a77c-4524-8b42-870141adddee admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:41.962015 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1207/2447] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:39:41.965992 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896c2e6-9390-4063-9c1d-69a2be23de3d admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:41.974424 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:41.978206 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b896c2e6-9390-4063-9c1d-69a2be23de3d admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:41.982780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d38d2-6a55-41c9-a7ab-53fc4908e29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:41.983747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d38d2-6a55-41c9-a7ab-53fc4908e29c admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:41.984050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d38d2-6a55-41c9-a7ab-53fc4908e29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:41.984333 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d38d2-6a55-41c9-a7ab-53fc4908e29c admin admin] PATH_INFO: `/v3/projects/35fc7ce781ca47b3b9d8a4688d0f622c/users/751119913ab74e518d6f0e583cb9c105/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:41.999687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d38d2-6a55-41c9-a7ab-53fc4908e29c admin admin] RBAC: Authorizing `identity:create_grant(project_id=35fc7ce781ca47b3b9d8a4688d0f622c, user_id=751119913ab74e518d6f0e583cb9c105, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:42.002437 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d38d2-6a55-41c9-a7ab-53fc4908e29c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:42.051963 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:42.091772 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1241/2448] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:39:41 2022] PUT /identity/v3/projects/35fc7ce781ca47b3b9d8a4688d0f622c/users/751119913ab74e518d6f0e583cb9c105/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:39:42.102568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30e094-6921-45ab-a7f2-94677ed4b44a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:42.102864 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30e094-6921-45ab-a7f2-94677ed4b44a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:42.103151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30e094-6921-45ab-a7f2-94677ed4b44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:42.129832 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1e30e094-6921-45ab-a7f2-94677ed4b44a None None] MFA Rules not processed for user `751119913ab74e518d6f0e583cb9c105`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:42.131090 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1e30e094-6921-45ab-a7f2-94677ed4b44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:42.196058 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1208/2449] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:39:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:39:42.209871 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d38d2-6a55-41c9-a7ab-53fc4908e29c admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:42.211716 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-245d38d2-6a55-41c9-a7ab-53fc4908e29c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:42.219818 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:42.272342 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d38d2-6a55-41c9-a7ab-53fc4908e29c admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:42.275963 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa62a48-822b-49e7-b02e-96d92f70da93 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8948dc6a55344eaa85e2a6092215ec6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:42.276618 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa62a48-822b-49e7-b02e-96d92f70da93 service glance] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:42.276905 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa62a48-822b-49e7-b02e-96d92f70da93 service glance] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:42.277184 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa62a48-822b-49e7-b02e-96d92f70da93 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:42.285818 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa62a48-822b-49e7-b02e-96d92f70da93 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:42.287520 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa62a48-822b-49e7-b02e-96d92f70da93 service glance] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:42.296650 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1242/2450] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:39:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:39:42.349385 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:42.383194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:42.468928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:42.617359 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:42.843849 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:43.128580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:43.403046 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:43.528173 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:43.729859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:43.837327 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:43.871493 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:43.972566 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:43.989642 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:44.157099 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:44.214931 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:44.349555 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:44.423442 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:44.632002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:44.808845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:44.929009 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:45.034855 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:45.108922 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:45.166293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:45.400759 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:45.423310 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:45.567286 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:45.632086 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:46.054636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:46.097720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:46.814895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:46.974723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:47.430343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f08c8-3262-4a21-b93d-6136b8dcaf73 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:47.430972 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f08c8-3262-4a21-b93d-6136b8dcaf73 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:47.430972 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f08c8-3262-4a21-b93d-6136b8dcaf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:47.449463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-d83f08c8-3262-4a21-b93d-6136b8dcaf73 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:47.450736 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d83f08c8-3262-4a21-b93d-6136b8dcaf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:47.513087 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1209/2451] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Jul 18 02:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:39:47.538205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa62a48-822b-49e7-b02e-96d92f70da93 service glance] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:47.540659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cfa62a48-822b-49e7-b02e-96d92f70da93 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:47.546418 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:47.547955 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:47.619483 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa62a48-822b-49e7-b02e-96d92f70da93 service glance] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:47.625095 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a1891-52d8-4904-adf0-26b813786a24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:47.625801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a1891-52d8-4904-adf0-26b813786a24 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:47.626093 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a1891-52d8-4904-adf0-26b813786a24 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:47.626374 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a1891-52d8-4904-adf0-26b813786a24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:47.635973 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a1891-52d8-4904-adf0-26b813786a24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:47.637722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a1891-52d8-4904-adf0-26b813786a24 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:47.649879 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1243/2452] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:39:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:39:47.760483 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:47.858010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:47.937977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f08c8-3262-4a21-b93d-6136b8dcaf73 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:47.939342 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d83f08c8-3262-4a21-b93d-6136b8dcaf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:48.011886 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f08c8-3262-4a21-b93d-6136b8dcaf73 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:48.016905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c0439-ab20-499f-b4f4-cfb669e21fe0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '213ba948a3f34c39bce3f6db093479eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:48.017560 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c0439-ab20-499f-b4f4-cfb669e21fe0 service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:48.017898 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c0439-ab20-499f-b4f4-cfb669e21fe0 service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:48.018180 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c0439-ab20-499f-b4f4-cfb669e21fe0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:48.019956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-629c0439-ab20-499f-b4f4-cfb669e21fe0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:48.032694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c0439-ab20-499f-b4f4-cfb669e21fe0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:48.034352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c0439-ab20-499f-b4f4-cfb669e21fe0 service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:48.044739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1210/2453] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:39:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:39:49.826594 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31bb22-b83e-419b-885d-e55e892b0439 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:49.830009 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31bb22-b83e-419b-885d-e55e892b0439 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:49.830009 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31bb22-b83e-419b-885d-e55e892b0439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:49.844264 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-eb31bb22-b83e-419b-885d-e55e892b0439 None None] MFA Rules not processed for user `01113a3f8cbf46b09fb5fcf4315a219b`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:49.845484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-eb31bb22-b83e-419b-885d-e55e892b0439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:49.900643 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1244/2454] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jul 18 02:39:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:39:49.918418 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c0439-ab20-499f-b4f4-cfb669e21fe0 service placement] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:49.919830 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-629c0439-ab20-499f-b4f4-cfb669e21fe0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:49.935267 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:49.991412 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c0439-ab20-499f-b4f4-cfb669e21fe0 service placement] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:49.996775 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf600a0b-fd0d-4dd9-b534-fc293b0644f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4e51f478874d99a7fc4ee2dea77caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:49.997627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf600a0b-fd0d-4dd9-b534-fc293b0644f1 service swift] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:49.998194 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf600a0b-fd0d-4dd9-b534-fc293b0644f1 service swift] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:49.998909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf600a0b-fd0d-4dd9-b534-fc293b0644f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:50.008138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf600a0b-fd0d-4dd9-b534-fc293b0644f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:50.009759 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf600a0b-fd0d-4dd9-b534-fc293b0644f1 service swift] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:50.018398 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1211/2455] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jul 18 02:39:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 02:39:51.137616 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5ae84-7352-425c-b7ea-26b1fe39df93 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:51.137616 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5ae84-7352-425c-b7ea-26b1fe39df93 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:51.137616 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5ae84-7352-425c-b7ea-26b1fe39df93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:51.158179 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c1a5ae84-7352-425c-b7ea-26b1fe39df93 None None] MFA Rules not processed for user `01113a3f8cbf46b09fb5fcf4315a219b`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:51.160081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c1a5ae84-7352-425c-b7ea-26b1fe39df93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:51.167625 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1245/2456] 10.222.0.64 () {58 vars in 967 bytes} [Mon Jul 18 02:39:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:39:51.180246 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf600a0b-fd0d-4dd9-b534-fc293b0644f1 service swift] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:51.191129 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf600a0b-fd0d-4dd9-b534-fc293b0644f1 service swift] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:51.196758 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240be8c-92fb-4fc1-b685-3f2e2b8ec5b0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4e51f478874d99a7fc4ee2dea77caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:51.197420 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240be8c-92fb-4fc1-b685-3f2e2b8ec5b0 service swift] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:51.197725 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240be8c-92fb-4fc1-b685-3f2e2b8ec5b0 service swift] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:51.201885 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240be8c-92fb-4fc1-b685-3f2e2b8ec5b0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:51.206474 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240be8c-92fb-4fc1-b685-3f2e2b8ec5b0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:51.208094 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e240be8c-92fb-4fc1-b685-3f2e2b8ec5b0 service swift] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:51.225116 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1212/2457] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jul 18 02:39:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 02:39:51.749547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a6097-39e6-4eca-b68b-900747df44bc None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:51.749878 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a6097-39e6-4eca-b68b-900747df44bc None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:51.750230 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a6097-39e6-4eca-b68b-900747df44bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:51.769443 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0e1a6097-39e6-4eca-b68b-900747df44bc None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:51.770694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0e1a6097-39e6-4eca-b68b-900747df44bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:51.778789 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1246/2458] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Jul 18 02:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:39:51.808029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240be8c-92fb-4fc1-b685-3f2e2b8ec5b0 service swift] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:51.820954 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240be8c-92fb-4fc1-b685-3f2e2b8ec5b0 service swift] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:51.826457 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcf8d9-bfc9-4faa-8552-129e798f9384 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:51.827095 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcf8d9-bfc9-4faa-8552-129e798f9384 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:51.827382 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcf8d9-bfc9-4faa-8552-129e798f9384 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:51.827705 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcf8d9-bfc9-4faa-8552-129e798f9384 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:51.835879 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fcf8d9-bfc9-4faa-8552-129e798f9384 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:51.837438 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fcf8d9-bfc9-4faa-8552-129e798f9384 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:51.847772 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1213/2459] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:39:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:39:51.903049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a10c0-b9ef-4ec8-a79d-25c81f87f4ec None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:51.903340 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a10c0-b9ef-4ec8-a79d-25c81f87f4ec None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:51.903648 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a10c0-b9ef-4ec8-a79d-25c81f87f4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:51.923159 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-8d9a10c0-b9ef-4ec8-a79d-25c81f87f4ec None None] MFA Rules not processed for user `01113a3f8cbf46b09fb5fcf4315a219b`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:51.924425 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8d9a10c0-b9ef-4ec8-a79d-25c81f87f4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:51.932057 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1247/2460] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jul 18 02:39:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:39:51.944466 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcf8d9-bfc9-4faa-8552-129e798f9384 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:51.955975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcf8d9-bfc9-4faa-8552-129e798f9384 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:51.961799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701fd19-66a1-46b8-9cda-1065802cdf81 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4e51f478874d99a7fc4ee2dea77caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:51.962550 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701fd19-66a1-46b8-9cda-1065802cdf81 service swift] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:51.962835 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701fd19-66a1-46b8-9cda-1065802cdf81 service swift] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:51.963208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701fd19-66a1-46b8-9cda-1065802cdf81 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:51.974230 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701fd19-66a1-46b8-9cda-1065802cdf81 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:51.975833 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f701fd19-66a1-46b8-9cda-1065802cdf81 service swift] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:51.984402 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1214/2461] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jul 18 02:39:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 02:39:52.810164 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5436ed2-106c-4334-afa9-9794d92dc13d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:52.810637 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5436ed2-106c-4334-afa9-9794d92dc13d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:52.810838 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5436ed2-106c-4334-afa9-9794d92dc13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:52.830207 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-e5436ed2-106c-4334-afa9-9794d92dc13d None None] MFA Rules not processed for user `01113a3f8cbf46b09fb5fcf4315a219b`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:52.831543 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e5436ed2-106c-4334-afa9-9794d92dc13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:52.841068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1248/2462] 10.222.0.64 () {58 vars in 967 bytes} [Mon Jul 18 02:39:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:39:52.853305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701fd19-66a1-46b8-9cda-1065802cdf81 service swift] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:52.864647 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701fd19-66a1-46b8-9cda-1065802cdf81 service swift] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:52.870243 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033f1ef-6715-4b04-9f3a-1c32a1df23db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4e51f478874d99a7fc4ee2dea77caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:52.870935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033f1ef-6715-4b04-9f3a-1c32a1df23db service swift] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:52.871222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033f1ef-6715-4b04-9f3a-1c32a1df23db service swift] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:52.871502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033f1ef-6715-4b04-9f3a-1c32a1df23db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:52.880503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033f1ef-6715-4b04-9f3a-1c32a1df23db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:52.882670 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033f1ef-6715-4b04-9f3a-1c32a1df23db service swift] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:52.893234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1215/2463] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jul 18 02:39:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 02:39:55.553146 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5436ed2-106c-4334-afa9-9794d92dc13d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:55.554736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e5436ed2-106c-4334-afa9-9794d92dc13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:55.569392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5436ed2-106c-4334-afa9-9794d92dc13d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:55.574197 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d06b08-8da1-4efd-82d5-f40da7de6d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:55.575072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d06b08-8da1-4efd-82d5-f40da7de6d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:55.575362 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d06b08-8da1-4efd-82d5-f40da7de6d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:55.575643 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d06b08-8da1-4efd-82d5-f40da7de6d76 admin admin] PATH_INFO: `/v3/users/a720de5be662441fb2e8a90abdaa33cd` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:55.576909 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d06b08-8da1-4efd-82d5-f40da7de6d76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a720de5be662441fb2e8a90abdaa33cd)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:55.578851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d06b08-8da1-4efd-82d5-f40da7de6d76 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:55.797842 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a4d06b08-8da1-4efd-82d5-f40da7de6d76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a720de5be662441fb2e8a90abdaa33cd'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:55.798581 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a4d06b08-8da1-4efd-82d5-f40da7de6d76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a720de5be662441fb2e8a90abdaa33cd'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:55.799262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a4d06b08-8da1-4efd-82d5-f40da7de6d76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a720de5be662441fb2e8a90abdaa33cd'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:55.830383 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:55.832026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a4d06b08-8da1-4efd-82d5-f40da7de6d76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a720de5be662441fb2e8a90abdaa33cd'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:55.840103 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a4d06b08-8da1-4efd-82d5-f40da7de6d76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a720de5be662441fb2e8a90abdaa33cd'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:55.967418 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1249/2464] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:39:55 2022] DELETE /identity/v3/users/a720de5be662441fb2e8a90abdaa33cd => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:39:55.971935 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779afe71-fab2-4c3f-ad2c-ec170b75704e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:55.972382 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779afe71-fab2-4c3f-ad2c-ec170b75704e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:55.972503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779afe71-fab2-4c3f-ad2c-ec170b75704e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:55.989571 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-779afe71-fab2-4c3f-ad2c-ec170b75704e None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:55.991339 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-779afe71-fab2-4c3f-ad2c-ec170b75704e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:56.054262 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1216/2465] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:39:56.063942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d06b08-8da1-4efd-82d5-f40da7de6d76 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:56.065416 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a4d06b08-8da1-4efd-82d5-f40da7de6d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:56.126165 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d06b08-8da1-4efd-82d5-f40da7de6d76 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:56.129971 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59648382-c846-44bf-97c0-e4c12c55704b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:56.132404 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59648382-c846-44bf-97c0-e4c12c55704b service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:56.132404 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59648382-c846-44bf-97c0-e4c12c55704b service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:56.132404 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59648382-c846-44bf-97c0-e4c12c55704b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:56.148675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59648382-c846-44bf-97c0-e4c12c55704b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:56.150190 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59648382-c846-44bf-97c0-e4c12c55704b service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:56.160540 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1250/2466] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:39:56.394307 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779afe71-fab2-4c3f-ad2c-ec170b75704e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:56.395826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-779afe71-fab2-4c3f-ad2c-ec170b75704e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:56.408490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779afe71-fab2-4c3f-ad2c-ec170b75704e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:56.413279 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4123e89-d1ad-4e51-844a-7a5f107e69e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:56.414458 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4123e89-d1ad-4e51-844a-7a5f107e69e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:56.414746 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4123e89-d1ad-4e51-844a-7a5f107e69e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:56.415018 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4123e89-d1ad-4e51-844a-7a5f107e69e0 admin admin] PATH_INFO: `/v3/projects/96c51139aed94ef8aed4054a8e5b2b7a` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:56.416251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4123e89-d1ad-4e51-844a-7a5f107e69e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96c51139aed94ef8aed4054a8e5b2b7a)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:56.418204 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4123e89-d1ad-4e51-844a-7a5f107e69e0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:56.534390 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:39:56.537162 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e4123e89-d1ad-4e51-844a-7a5f107e69e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96c51139aed94ef8aed4054a8e5b2b7a', 'request_id': 'req-e4123e89-d1ad-4e51-844a-7a5f107e69e0'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:56.542951 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e4123e89-d1ad-4e51-844a-7a5f107e69e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96c51139aed94ef8aed4054a8e5b2b7a', 'request_id': 'req-e4123e89-d1ad-4e51-844a-7a5f107e69e0'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:56.549141 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e4123e89-d1ad-4e51-844a-7a5f107e69e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96c51139aed94ef8aed4054a8e5b2b7a', 'request_id': 'req-e4123e89-d1ad-4e51-844a-7a5f107e69e0'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:56.672461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e4123e89-d1ad-4e51-844a-7a5f107e69e0 admin admin] The token cache is being invalidate because project 96c51139aed94ef8aed4054a8e5b2b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:39:56.672756 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e4123e89-d1ad-4e51-844a-7a5f107e69e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:56.673424 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e4123e89-d1ad-4e51-844a-7a5f107e69e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:39:56.675118 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1217/2467] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:39:56 2022] DELETE /identity/v3/projects/96c51139aed94ef8aed4054a8e5b2b7a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:39:58.099093 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617db65b-e277-48bc-920d-7966ec81edc4 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:58.099093 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617db65b-e277-48bc-920d-7966ec81edc4 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:58.099591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617db65b-e277-48bc-920d-7966ec81edc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:58.121264 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-617db65b-e277-48bc-920d-7966ec81edc4 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:58.122679 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-617db65b-e277-48bc-920d-7966ec81edc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:58.203117 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1251/2468] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Jul 18 02:39:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:39:58.240065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4123e89-d1ad-4e51-844a-7a5f107e69e0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:58.242777 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e4123e89-d1ad-4e51-844a-7a5f107e69e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:58.335668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4123e89-d1ad-4e51-844a-7a5f107e69e0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:58.345582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0d07d-e0af-4e6e-9187-d637cffa3623 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:58.346273 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0d07d-e0af-4e6e-9187-d637cffa3623 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:58.346560 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0d07d-e0af-4e6e-9187-d637cffa3623 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:58.346838 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d0d07d-e0af-4e6e-9187-d637cffa3623 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:58.358189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0d07d-e0af-4e6e-9187-d637cffa3623 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:58.359788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d0d07d-e0af-4e6e-9187-d637cffa3623 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:58.370099 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1218/2469] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:39:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:39:58.551187 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ee5ad-781a-469a-bba6-39d1744abe21 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:58.551532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ee5ad-781a-469a-bba6-39d1744abe21 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:58.551825 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644ee5ad-781a-469a-bba6-39d1744abe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:58.571592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-644ee5ad-781a-469a-bba6-39d1744abe21 None None] MFA Rules not processed for user `01113a3f8cbf46b09fb5fcf4315a219b`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:39:58.572819 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-644ee5ad-781a-469a-bba6-39d1744abe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:58.634232 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1252/2470] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jul 18 02:39:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:39:58.646616 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0d07d-e0af-4e6e-9187-d637cffa3623 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:39:58.648752 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-01d0d07d-e0af-4e6e-9187-d637cffa3623 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:39:58.720651 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d0d07d-e0af-4e6e-9187-d637cffa3623 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:39:58.725910 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af203e2-b4b1-4b7f-9cd1-48ac4d45f80e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4e51f478874d99a7fc4ee2dea77caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:39:58.726564 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af203e2-b4b1-4b7f-9cd1-48ac4d45f80e service swift] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:39:58.726847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af203e2-b4b1-4b7f-9cd1-48ac4d45f80e service swift] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:39:58.727123 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af203e2-b4b1-4b7f-9cd1-48ac4d45f80e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:39:58.735900 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af203e2-b4b1-4b7f-9cd1-48ac4d45f80e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:39:58.737529 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af203e2-b4b1-4b7f-9cd1-48ac4d45f80e service swift] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:39:58.746067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1219/2471] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jul 18 02:39:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 02:40:08.626128 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=85,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:08.743073 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:DELETE=4,keystone:SELECT=73,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:14.459796 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ee5ad-781a-469a-bba6-39d1744abe21 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:14.461272 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-644ee5ad-781a-469a-bba6-39d1744abe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:14.475760 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644ee5ad-781a-469a-bba6-39d1744abe21 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:14.480559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40667409-6155-48fa-b192-47625eb4692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:14.481558 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40667409-6155-48fa-b192-47625eb4692c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:14.481895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40667409-6155-48fa-b192-47625eb4692c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:14.482176 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40667409-6155-48fa-b192-47625eb4692c admin admin] PATH_INFO: `/v3/users/751119913ab74e518d6f0e583cb9c105` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:14.483387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40667409-6155-48fa-b192-47625eb4692c admin admin] RBAC: Authorizing `identity:delete_user(user_id=751119913ab74e518d6f0e583cb9c105)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:14.485320 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40667409-6155-48fa-b192-47625eb4692c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:14.683237 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-40667409-6155-48fa-b192-47625eb4692c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '751119913ab74e518d6f0e583cb9c105'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:40:14.686181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-40667409-6155-48fa-b192-47625eb4692c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '751119913ab74e518d6f0e583cb9c105'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:40:14.686181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-40667409-6155-48fa-b192-47625eb4692c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '751119913ab74e518d6f0e583cb9c105'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:40:14.700437 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-40667409-6155-48fa-b192-47625eb4692c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '751119913ab74e518d6f0e583cb9c105'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:40:14.709580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-40667409-6155-48fa-b192-47625eb4692c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '751119913ab74e518d6f0e583cb9c105'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:40:14.837839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1253/2472] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:40:14 2022] DELETE /identity/v3/users/751119913ab74e518d6f0e583cb9c105 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:40:14.839744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285df51-58e8-4a55-8a8a-c20cde3b20fb None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:14.840767 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285df51-58e8-4a55-8a8a-c20cde3b20fb None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:14.841225 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5285df51-58e8-4a55-8a8a-c20cde3b20fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:14.865448 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5285df51-58e8-4a55-8a8a-c20cde3b20fb None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:40:14.868781 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5285df51-58e8-4a55-8a8a-c20cde3b20fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:14.977468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1220/2473] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:40:14.993252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40667409-6155-48fa-b192-47625eb4692c admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:14.993252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-40667409-6155-48fa-b192-47625eb4692c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:15.140316 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40667409-6155-48fa-b192-47625eb4692c admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:15.149675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669a4b3-fcb7-43e5-a8ef-1c1f77de6858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:15.150544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669a4b3-fcb7-43e5-a8ef-1c1f77de6858 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:15.150662 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669a4b3-fcb7-43e5-a8ef-1c1f77de6858 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:15.151069 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669a4b3-fcb7-43e5-a8ef-1c1f77de6858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:15.163677 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669a4b3-fcb7-43e5-a8ef-1c1f77de6858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:15.166113 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669a4b3-fcb7-43e5-a8ef-1c1f77de6858 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:15.190300 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1254/2474] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:40:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:40:15.883088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285df51-58e8-4a55-8a8a-c20cde3b20fb None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:15.884278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5285df51-58e8-4a55-8a8a-c20cde3b20fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:15.902193 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5285df51-58e8-4a55-8a8a-c20cde3b20fb None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:15.907139 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36663793-70e7-42c9-9ef0-d9e8b2a00246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:15.908259 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36663793-70e7-42c9-9ef0-d9e8b2a00246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:15.908551 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36663793-70e7-42c9-9ef0-d9e8b2a00246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:15.908835 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36663793-70e7-42c9-9ef0-d9e8b2a00246 admin admin] PATH_INFO: `/v3/projects/35fc7ce781ca47b3b9d8a4688d0f622c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:15.910094 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36663793-70e7-42c9-9ef0-d9e8b2a00246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35fc7ce781ca47b3b9d8a4688d0f622c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:15.912005 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36663793-70e7-42c9-9ef0-d9e8b2a00246 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:16.025889 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36663793-70e7-42c9-9ef0-d9e8b2a00246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35fc7ce781ca47b3b9d8a4688d0f622c', 'request_id': 'req-36663793-70e7-42c9-9ef0-d9e8b2a00246'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:40:16.031516 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36663793-70e7-42c9-9ef0-d9e8b2a00246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35fc7ce781ca47b3b9d8a4688d0f622c', 'request_id': 'req-36663793-70e7-42c9-9ef0-d9e8b2a00246'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:40:16.037895 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36663793-70e7-42c9-9ef0-d9e8b2a00246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35fc7ce781ca47b3b9d8a4688d0f622c', 'request_id': 'req-36663793-70e7-42c9-9ef0-d9e8b2a00246'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:40:16.150446 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36663793-70e7-42c9-9ef0-d9e8b2a00246 admin admin] The token cache is being invalidate because project 35fc7ce781ca47b3b9d8a4688d0f622c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:40:16.150736 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36663793-70e7-42c9-9ef0-d9e8b2a00246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:40:16.151403 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-36663793-70e7-42c9-9ef0-d9e8b2a00246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:40:16.153186 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1221/2475] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:40:15 2022] DELETE /identity/v3/projects/35fc7ce781ca47b3b9d8a4688d0f622c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:40:16.160711 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84321a06-b840-442b-90a0-e53cbb9181a1 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:16.165250 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84321a06-b840-442b-90a0-e53cbb9181a1 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:16.165250 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84321a06-b840-442b-90a0-e53cbb9181a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:16.184098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-84321a06-b840-442b-90a0-e53cbb9181a1 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:40:16.185861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-84321a06-b840-442b-90a0-e53cbb9181a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:16.263664 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1255/2476] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:40:16.265534 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814026d1-177c-417f-95b9-adcf9f6d86f2 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:16.265870 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814026d1-177c-417f-95b9-adcf9f6d86f2 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:16.266154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814026d1-177c-417f-95b9-adcf9f6d86f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:16.288710 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-814026d1-177c-417f-95b9-adcf9f6d86f2 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:40:16.290566 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-814026d1-177c-417f-95b9-adcf9f6d86f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:16.298857 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1222/2477] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:40:16.303076 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84321a06-b840-442b-90a0-e53cbb9181a1 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:16.312799 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84321a06-b840-442b-90a0-e53cbb9181a1 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:16.317317 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1a180-cf05-4abc-95dc-8d7da798be56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:16.317990 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1a180-cf05-4abc-95dc-8d7da798be56 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:16.318277 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1a180-cf05-4abc-95dc-8d7da798be56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:16.318561 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1a180-cf05-4abc-95dc-8d7da798be56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:16.319281 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1a180-cf05-4abc-95dc-8d7da798be56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:40:16.319591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1a180-cf05-4abc-95dc-8d7da798be56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:16.321204 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1a180-cf05-4abc-95dc-8d7da798be56 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:16.332534 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1256/2478] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:40:16.337313 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814026d1-177c-417f-95b9-adcf9f6d86f2 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:16.346550 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814026d1-177c-417f-95b9-adcf9f6d86f2 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:16.351541 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209b713-8c10-4af5-ac88-cbedb35ebdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:16.352780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209b713-8c10-4af5-ac88-cbedb35ebdd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:16.353166 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209b713-8c10-4af5-ac88-cbedb35ebdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:16.353446 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209b713-8c10-4af5-ac88-cbedb35ebdd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:16.354173 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209b713-8c10-4af5-ac88-cbedb35ebdd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:16.356304 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7209b713-8c10-4af5-ac88-cbedb35ebdd7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:16.501021 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1223/2479] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:40:16 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:40:16.505860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1a180-cf05-4abc-95dc-8d7da798be56 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:16.512170 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:16.517570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1a180-cf05-4abc-95dc-8d7da798be56 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:16.572549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d78837-1826-4391-8966-885cf2ae6d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:16.573214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d78837-1826-4391-8966-885cf2ae6d38 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:16.573497 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d78837-1826-4391-8966-885cf2ae6d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:16.573836 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d78837-1826-4391-8966-885cf2ae6d38 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:16.574559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d78837-1826-4391-8966-885cf2ae6d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:16.576498 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d78837-1826-4391-8966-885cf2ae6d38 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:16.693409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1257/2480] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:40:16 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:40:16.700035 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209b713-8c10-4af5-ac88-cbedb35ebdd7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:16.711695 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209b713-8c10-4af5-ac88-cbedb35ebdd7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:16.716320 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3abd8d-aea2-4404-80c9-86b6b256d86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:16.716983 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3abd8d-aea2-4404-80c9-86b6b256d86b admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:16.717266 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3abd8d-aea2-4404-80c9-86b6b256d86b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:16.717540 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3abd8d-aea2-4404-80c9-86b6b256d86b admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:16.718296 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3abd8d-aea2-4404-80c9-86b6b256d86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:16.720086 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3abd8d-aea2-4404-80c9-86b6b256d86b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:16.733143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1224/2481] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:40:16.737107 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d78837-1826-4391-8966-885cf2ae6d38 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:16.747960 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d78837-1826-4391-8966-885cf2ae6d38 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:16.752868 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f10ddc-9813-4d7c-8a8f-ccf191a382aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:16.754483 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f10ddc-9813-4d7c-8a8f-ccf191a382aa admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:16.754483 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f10ddc-9813-4d7c-8a8f-ccf191a382aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:16.754483 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f10ddc-9813-4d7c-8a8f-ccf191a382aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:16.755334 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f10ddc-9813-4d7c-8a8f-ccf191a382aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:16.757016 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f10ddc-9813-4d7c-8a8f-ccf191a382aa admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:16.767408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1258/2482] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:40:16.771485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3abd8d-aea2-4404-80c9-86b6b256d86b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:16.783152 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3abd8d-aea2-4404-80c9-86b6b256d86b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:16.790632 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e3565-7e87-4379-a2e8-ed361132d9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:16.791555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e3565-7e87-4379-a2e8-ed361132d9dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:16.792090 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e3565-7e87-4379-a2e8-ed361132d9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:16.792369 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40e3565-7e87-4379-a2e8-ed361132d9dc admin admin] PATH_INFO: `/v3/projects/5f6d8a92f16942888f4181943e4306e8/users/0fc8220c7c97498ba73ba56645056fdb/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:16.811043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e3565-7e87-4379-a2e8-ed361132d9dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f6d8a92f16942888f4181943e4306e8, user_id=0fc8220c7c97498ba73ba56645056fdb, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:16.813920 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40e3565-7e87-4379-a2e8-ed361132d9dc admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:16.878734 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1225/2483] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:40:16 2022] PUT /identity/v3/projects/5f6d8a92f16942888f4181943e4306e8/users/0fc8220c7c97498ba73ba56645056fdb/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:40:16.884853 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948a23e-b9f7-4298-a324-961fa2a426df None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:16.885150 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948a23e-b9f7-4298-a324-961fa2a426df None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:16.885432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948a23e-b9f7-4298-a324-961fa2a426df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:16.903942 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c948a23e-b9f7-4298-a324-961fa2a426df None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:40:16.904408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c948a23e-b9f7-4298-a324-961fa2a426df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:16.967721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1259/2484] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:40:16.978747 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e3565-7e87-4379-a2e8-ed361132d9dc admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:16.980732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d40e3565-7e87-4379-a2e8-ed361132d9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:17.004696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:17.042468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40e3565-7e87-4379-a2e8-ed361132d9dc admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:17.046202 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71546ee-4d01-4668-bffb-b6572cd25ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:17.046885 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71546ee-4d01-4668-bffb-b6572cd25ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:17.047129 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71546ee-4d01-4668-bffb-b6572cd25ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:17.047411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71546ee-4d01-4668-bffb-b6572cd25ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:17.060017 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71546ee-4d01-4668-bffb-b6572cd25ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:17.061475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71546ee-4d01-4668-bffb-b6572cd25ad9 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:17.074421 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1226/2485] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:40:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:40:19.620403 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987a1b2-cb70-45d7-bd0e-669ca9d14799 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:19.620403 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987a1b2-cb70-45d7-bd0e-669ca9d14799 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:19.620403 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987a1b2-cb70-45d7-bd0e-669ca9d14799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:19.660038 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-b987a1b2-cb70-45d7-bd0e-669ca9d14799 None None] MFA Rules not processed for user `865e36ae67344c0dbca9dcccca58da42`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:40:19.663229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b987a1b2-cb70-45d7-bd0e-669ca9d14799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:19.770252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1260/2486] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:40:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:40:20.322194 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc8942-32d2-4a16-b098-dd3249e17906 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:20.323694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc8942-32d2-4a16-b098-dd3249e17906 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:20.324148 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cc8942-32d2-4a16-b098-dd3249e17906 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:20.328285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1227/2487] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jul 18 02:40:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:40:20.334116 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e16c18-21fb-4944-bedc-77873c66b0b4 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:20.334686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e16c18-21fb-4944-bedc-77873c66b0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:20.335122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e16c18-21fb-4944-bedc-77873c66b0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:20.367722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-14e16c18-21fb-4944-bedc-77873c66b0b4 None None] MFA Rules not processed for user `6f51aae36f0b42868567840fa957ffe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:40:20.370322 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-14e16c18-21fb-4944-bedc-77873c66b0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:20.410642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:20.482384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1261/2488] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jul 18 02:40:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:40:20.497795 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc8942-32d2-4a16-b098-dd3249e17906 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:20.499580 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-10cc8942-32d2-4a16-b098-dd3249e17906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:20.590571 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cc8942-32d2-4a16-b098-dd3249e17906 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:20.592999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750b39b-47ae-4549-93e1-585d37b1c276 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8948dc6a55344eaa85e2a6092215ec6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:20.593646 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750b39b-47ae-4549-93e1-585d37b1c276 service glance] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:20.593954 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750b39b-47ae-4549-93e1-585d37b1c276 service glance] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:20.594229 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750b39b-47ae-4549-93e1-585d37b1c276 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:20.611846 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750b39b-47ae-4549-93e1-585d37b1c276 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:20.613643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750b39b-47ae-4549-93e1-585d37b1c276 service glance] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:20.626690 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1228/2489] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:40:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:40:20.894153 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edad8a0-ad4d-45d7-8512-558e8b74f2f1 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:20.894684 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edad8a0-ad4d-45d7-8512-558e8b74f2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:20.894919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edad8a0-ad4d-45d7-8512-558e8b74f2f1 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:20.897283 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1262/2490] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jul 18 02:40:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:40:20.906959 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a53ba2-cb95-4878-8ff8-f608d82f00ae None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:20.907591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a53ba2-cb95-4878-8ff8-f608d82f00ae None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:20.908072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a53ba2-cb95-4878-8ff8-f608d82f00ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:20.943808 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-76a53ba2-cb95-4878-8ff8-f608d82f00ae None None] MFA Rules not processed for user `fa9e6d3fe3e740e6aedab33d727ec478`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:40:20.945268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-76a53ba2-cb95-4878-8ff8-f608d82f00ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:20.954897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1229/2491] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jul 18 02:40:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:40:20.973097 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edad8a0-ad4d-45d7-8512-558e8b74f2f1 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:20.985495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edad8a0-ad4d-45d7-8512-558e8b74f2f1 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:20.999738 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9aa09-9c49-41cf-843a-e7d50201c817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:21.000434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9aa09-9c49-41cf-843a-e7d50201c817 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:21.000774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9aa09-9c49-41cf-843a-e7d50201c817 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:21.001387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9aa09-9c49-41cf-843a-e7d50201c817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:21.014986 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9aa09-9c49-41cf-843a-e7d50201c817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:21.017892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9aa09-9c49-41cf-843a-e7d50201c817 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:21.037657 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1263/2492] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:40:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:40:21.194292 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894c675-e54e-43f6-ba78-c01e9b86df17 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:21.194588 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894c675-e54e-43f6-ba78-c01e9b86df17 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:21.194924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894c675-e54e-43f6-ba78-c01e9b86df17 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:21.196667 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1230/2493] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jul 18 02:40:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:40:21.202926 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595624ae-21f4-48cd-80a3-f7b8fd85dd07 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:21.203297 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595624ae-21f4-48cd-80a3-f7b8fd85dd07 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:21.203606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595624ae-21f4-48cd-80a3-f7b8fd85dd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:21.236551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-595624ae-21f4-48cd-80a3-f7b8fd85dd07 None None] MFA Rules not processed for user `6f51aae36f0b42868567840fa957ffe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:40:21.237947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-595624ae-21f4-48cd-80a3-f7b8fd85dd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:21.249337 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1264/2494] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jul 18 02:40:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:40:21.260779 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894c675-e54e-43f6-ba78-c01e9b86df17 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:21.273144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894c675-e54e-43f6-ba78-c01e9b86df17 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:21.277576 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b227b1-6f84-4110-ba98-6b39d4bbeb9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:21.278427 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b227b1-6f84-4110-ba98-6b39d4bbeb9f service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:21.283630 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b227b1-6f84-4110-ba98-6b39d4bbeb9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:21.283630 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b227b1-6f84-4110-ba98-6b39d4bbeb9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:21.291417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b227b1-6f84-4110-ba98-6b39d4bbeb9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:21.293410 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b227b1-6f84-4110-ba98-6b39d4bbeb9f service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:21.334605 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1231/2495] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:40:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:40:25.045604 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e47fdb-39c3-4758-ae3e-05c811c9cbd8 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:25.046603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e47fdb-39c3-4758-ae3e-05c811c9cbd8 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:25.047102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e47fdb-39c3-4758-ae3e-05c811c9cbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:25.081562 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a8e47fdb-39c3-4758-ae3e-05c811c9cbd8 None None] MFA Rules not processed for user `0fc8220c7c97498ba73ba56645056fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:40:25.082755 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a8e47fdb-39c3-4758-ae3e-05c811c9cbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:25.161869 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1265/2496] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:40:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:40:25.166408 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b227b1-6f84-4110-ba98-6b39d4bbeb9f service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:25.183273 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b227b1-6f84-4110-ba98-6b39d4bbeb9f service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:25.190291 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c882187-e7ec-400c-93bd-e3e4251f8d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:25.191492 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c882187-e7ec-400c-93bd-e3e4251f8d47 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:25.201499 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c882187-e7ec-400c-93bd-e3e4251f8d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:25.201499 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c882187-e7ec-400c-93bd-e3e4251f8d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:25.201499 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c882187-e7ec-400c-93bd-e3e4251f8d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:25.201499 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c882187-e7ec-400c-93bd-e3e4251f8d47 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:25.205516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a06ae-f571-4e31-8b03-c3dbb35e4ad1 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:25.205516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a06ae-f571-4e31-8b03-c3dbb35e4ad1 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:25.205516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a06ae-f571-4e31-8b03-c3dbb35e4ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:25.229917 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a15a06ae-f571-4e31-8b03-c3dbb35e4ad1 None None] MFA Rules not processed for user `1f09a9a483934c88a06be690f02fba4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:40:25.232138 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a15a06ae-f571-4e31-8b03-c3dbb35e4ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:25.318975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1232/2497] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:40:25 2022] POST /identity/v3/projects => generated 383 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:40:25.323396 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c882187-e7ec-400c-93bd-e3e4251f8d47 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:25.324617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1266/2498] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:40:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:40:25.420551 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c882187-e7ec-400c-93bd-e3e4251f8d47 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:25.426847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa21e61-161b-4f71-8b1a-887c3b0bd8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:25.428021 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa21e61-161b-4f71-8b1a-887c3b0bd8e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:25.428472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa21e61-161b-4f71-8b1a-887c3b0bd8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:25.428890 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa21e61-161b-4f71-8b1a-887c3b0bd8e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:25.430217 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa21e61-161b-4f71-8b1a-887c3b0bd8e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:25.433206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa21e61-161b-4f71-8b1a-887c3b0bd8e0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:25.546266 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1233/2499] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:40:25 2022] POST /identity/v3/users => generated 298 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:40:25.550567 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a06ae-f571-4e31-8b03-c3dbb35e4ad1 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:25.567851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a06ae-f571-4e31-8b03-c3dbb35e4ad1 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:25.581261 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc17e00-ae14-46dc-930b-f5dba66a25e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:25.585938 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc17e00-ae14-46dc-930b-f5dba66a25e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:25.586308 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc17e00-ae14-46dc-930b-f5dba66a25e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:25.586666 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc17e00-ae14-46dc-930b-f5dba66a25e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:25.587932 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc17e00-ae14-46dc-930b-f5dba66a25e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:25.591122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc17e00-ae14-46dc-930b-f5dba66a25e8 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:25.636480 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1267/2500] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:40:25.640751 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa21e61-161b-4f71-8b1a-887c3b0bd8e0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:25.654978 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa21e61-161b-4f71-8b1a-887c3b0bd8e0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:25.686130 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4ae5b-3396-4cae-9822-cc8152175d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:25.687257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4ae5b-3396-4cae-9822-cc8152175d96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:25.692972 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4ae5b-3396-4cae-9822-cc8152175d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:25.695269 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4ae5b-3396-4cae-9822-cc8152175d96 admin admin] PATH_INFO: `/v3/projects/4eccf371af5b4612a07061a1d9bba658/users/77716f2cdeac4472ae4a2a9343633a3c/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:25.726775 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:25.741553 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4ae5b-3396-4cae-9822-cc8152175d96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eccf371af5b4612a07061a1d9bba658, user_id=77716f2cdeac4472ae4a2a9343633a3c, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:25.747478 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4ae5b-3396-4cae-9822-cc8152175d96 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:25.871005 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1234/2501] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:40:25 2022] PUT /identity/v3/projects/4eccf371af5b4612a07061a1d9bba658/users/77716f2cdeac4472ae4a2a9343633a3c/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:40:25.874643 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc17e00-ae14-46dc-930b-f5dba66a25e8 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:25.898463 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc17e00-ae14-46dc-930b-f5dba66a25e8 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:25.941958 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:26.008445 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348e748-f174-4e26-8fb9-4216a99e45fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:26.009143 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348e748-f174-4e26-8fb9-4216a99e45fa admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:26.009472 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348e748-f174-4e26-8fb9-4216a99e45fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:26.009792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348e748-f174-4e26-8fb9-4216a99e45fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:26.010530 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348e748-f174-4e26-8fb9-4216a99e45fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:26.012797 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a348e748-f174-4e26-8fb9-4216a99e45fa admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:26.031165 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1268/2502] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:40:26.035392 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4ae5b-3396-4cae-9822-cc8152175d96 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:26.049950 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4ae5b-3396-4cae-9822-cc8152175d96 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:26.057789 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7e88f-30a7-41bc-8ea6-8459c9de99af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:26.057789 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7e88f-30a7-41bc-8ea6-8459c9de99af admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:26.057789 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7e88f-30a7-41bc-8ea6-8459c9de99af admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:26.057789 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7e88f-30a7-41bc-8ea6-8459c9de99af admin admin] PATH_INFO: `/v3/projects/4eccf371af5b4612a07061a1d9bba658/users/77716f2cdeac4472ae4a2a9343633a3c/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:26.060540 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7e88f-30a7-41bc-8ea6-8459c9de99af admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eccf371af5b4612a07061a1d9bba658, user_id=77716f2cdeac4472ae4a2a9343633a3c, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:26.063785 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7e88f-30a7-41bc-8ea6-8459c9de99af admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:26.083053 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1235/2503] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:40:26 2022] PUT /identity/v3/projects/4eccf371af5b4612a07061a1d9bba658/users/77716f2cdeac4472ae4a2a9343633a3c/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:40:26.638391 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22330866-5cf9-4b43-8233-6f423fd4009e None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:26.643822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22330866-5cf9-4b43-8233-6f423fd4009e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:26.643822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22330866-5cf9-4b43-8233-6f423fd4009e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:26.677108 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-22330866-5cf9-4b43-8233-6f423fd4009e None None] MFA Rules not processed for user `01113a3f8cbf46b09fb5fcf4315a219b`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:40:26.678912 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-22330866-5cf9-4b43-8233-6f423fd4009e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:26.780552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1269/2504] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jul 18 02:40:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:40:26.803503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7e88f-30a7-41bc-8ea6-8459c9de99af admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:26.805379 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-66e7e88f-30a7-41bc-8ea6-8459c9de99af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:26.964571 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7e88f-30a7-41bc-8ea6-8459c9de99af admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:26.991906 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2cf52-7424-4179-be50-ce3bd8687401 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4e51f478874d99a7fc4ee2dea77caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:26.992725 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2cf52-7424-4179-be50-ce3bd8687401 service swift] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:26.993477 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2cf52-7424-4179-be50-ce3bd8687401 service swift] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:26.993477 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2cf52-7424-4179-be50-ce3bd8687401 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:27.022280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2cf52-7424-4179-be50-ce3bd8687401 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:27.024577 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2cf52-7424-4179-be50-ce3bd8687401 service swift] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:27.042126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1236/2505] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jul 18 02:40:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 02:40:35.040821 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08596cc-d208-4dc8-b0fe-a0158dd91843 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:35.042081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08596cc-d208-4dc8-b0fe-a0158dd91843 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:35.042081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08596cc-d208-4dc8-b0fe-a0158dd91843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:35.078069 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-d08596cc-d208-4dc8-b0fe-a0158dd91843 None None] MFA Rules not processed for user `77716f2cdeac4472ae4a2a9343633a3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:40:35.079677 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d08596cc-d208-4dc8-b0fe-a0158dd91843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:35.221166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1270/2506] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:40:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:40:35.236050 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2cf52-7424-4179-be50-ce3bd8687401 service swift] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:35.325055 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2cf52-7424-4179-be50-ce3bd8687401 service swift] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:35.329065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297293a-4dc1-49fe-aff2-1809630c0b81 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8948dc6a55344eaa85e2a6092215ec6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:35.330158 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297293a-4dc1-49fe-aff2-1809630c0b81 service glance] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:35.330465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297293a-4dc1-49fe-aff2-1809630c0b81 service glance] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:35.330746 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297293a-4dc1-49fe-aff2-1809630c0b81 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:35.420970 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297293a-4dc1-49fe-aff2-1809630c0b81 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:35.422471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297293a-4dc1-49fe-aff2-1809630c0b81 service glance] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:35.434141 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1237/2507] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:40:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:40:35.765955 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c45fd-634d-4b0c-9b1a-bfd7999505dd None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:35.766602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c45fd-634d-4b0c-9b1a-bfd7999505dd None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:35.767240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93c45fd-634d-4b0c-9b1a-bfd7999505dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:35.799812 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-e93c45fd-634d-4b0c-9b1a-bfd7999505dd None None] MFA Rules not processed for user `01113a3f8cbf46b09fb5fcf4315a219b`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:40:35.802235 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e93c45fd-634d-4b0c-9b1a-bfd7999505dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:35.820576 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1271/2508] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jul 18 02:40:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:40:35.846765 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297293a-4dc1-49fe-aff2-1809630c0b81 service glance] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:35.871729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297293a-4dc1-49fe-aff2-1809630c0b81 service glance] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:35.878252 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697d7e3f-a417-4eb1-aaec-19fec42d27e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4e51f478874d99a7fc4ee2dea77caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:35.879127 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d7e3f-a417-4eb1-aaec-19fec42d27e8 service swift] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:35.879542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d7e3f-a417-4eb1-aaec-19fec42d27e8 service swift] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:35.879938 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d7e3f-a417-4eb1-aaec-19fec42d27e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:35.891069 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d7e3f-a417-4eb1-aaec-19fec42d27e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:35.893003 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697d7e3f-a417-4eb1-aaec-19fec42d27e8 service swift] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:35.903732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1238/2509] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jul 18 02:40:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 02:40:40.832021 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb53d7b-6cf8-4f19-9203-a7503065a338 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:40.832646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb53d7b-6cf8-4f19-9203-a7503065a338 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:40.832646 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb53d7b-6cf8-4f19-9203-a7503065a338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:40.850970 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-4bb53d7b-6cf8-4f19-9203-a7503065a338 None None] MFA Rules not processed for user `6618ecc2692c40be876654dfdc4496b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:40:40.852497 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4bb53d7b-6cf8-4f19-9203-a7503065a338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:40.941032 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:40.988293 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1272/2510] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:40:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:40:45.899005 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:40:49.380810 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e5598-0e8a-4009-99fa-44e83b734f8a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:49.381490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e5598-0e8a-4009-99fa-44e83b734f8a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:49.381490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e5598-0e8a-4009-99fa-44e83b734f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:49.403182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5c6e5598-0e8a-4009-99fa-44e83b734f8a None None] MFA Rules not processed for user `01113a3f8cbf46b09fb5fcf4315a219b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:40:49.403849 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5c6e5598-0e8a-4009-99fa-44e83b734f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:49.420125 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1239/2511] 10.222.0.64 () {58 vars in 967 bytes} [Mon Jul 18 02:40:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:40:49.428196 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb53d7b-6cf8-4f19-9203-a7503065a338 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:49.442189 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb53d7b-6cf8-4f19-9203-a7503065a338 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:49.448540 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5e402-57d8-4cd5-a4ad-d45ff1f8737f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4e51f478874d99a7fc4ee2dea77caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:49.449816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5e402-57d8-4cd5-a4ad-d45ff1f8737f service swift] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:49.449816 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5e402-57d8-4cd5-a4ad-d45ff1f8737f service swift] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:49.450114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5e402-57d8-4cd5-a4ad-d45ff1f8737f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:49.459544 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5e402-57d8-4cd5-a4ad-d45ff1f8737f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:49.461159 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc5e402-57d8-4cd5-a4ad-d45ff1f8737f service swift] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:49.470794 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1273/2512] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jul 18 02:40:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 02:40:50.621381 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ebb92-673d-4668-b0ac-66f06a70e798 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:50.621905 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ebb92-673d-4668-b0ac-66f06a70e798 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:50.622005 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ebb92-673d-4668-b0ac-66f06a70e798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:50.644155 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-e63ebb92-673d-4668-b0ac-66f06a70e798 None None] MFA Rules not processed for user `0fc8220c7c97498ba73ba56645056fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:40:50.644155 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e63ebb92-673d-4668-b0ac-66f06a70e798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:50.649440 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1240/2513] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:40:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:40:54.217399 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98bf6f-7f9a-4567-a9ea-2a1ee5d664e3 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:54.218324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98bf6f-7f9a-4567-a9ea-2a1ee5d664e3 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:54.218612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d98bf6f-7f9a-4567-a9ea-2a1ee5d664e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:54.239839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0d98bf6f-7f9a-4567-a9ea-2a1ee5d664e3 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:40:54.241073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0d98bf6f-7f9a-4567-a9ea-2a1ee5d664e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:54.303507 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1274/2514] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Jul 18 02:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:40:54.324715 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ebb92-673d-4668-b0ac-66f06a70e798 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:54.326231 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e63ebb92-673d-4668-b0ac-66f06a70e798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:54.408326 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ebb92-673d-4668-b0ac-66f06a70e798 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:54.413947 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fdc92-31ee-4625-998f-5749414bf7a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:54.417500 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fdc92-31ee-4625-998f-5749414bf7a7 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:54.417500 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fdc92-31ee-4625-998f-5749414bf7a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:54.417500 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545fdc92-31ee-4625-998f-5749414bf7a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:54.424944 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fdc92-31ee-4625-998f-5749414bf7a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:54.426590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545fdc92-31ee-4625-998f-5749414bf7a7 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:54.436803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1241/2515] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:40:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:40:54.647837 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2338d44-f879-44cd-bd3f-66354b950281 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:54.648134 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2338d44-f879-44cd-bd3f-66354b950281 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:54.648417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2338d44-f879-44cd-bd3f-66354b950281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:54.678592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-d2338d44-f879-44cd-bd3f-66354b950281 None None] MFA Rules not processed for user `01113a3f8cbf46b09fb5fcf4315a219b`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:40:54.679834 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-d2338d44-f879-44cd-bd3f-66354b950281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:40:54.692238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1275/2516] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jul 18 02:40:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:40:54.711352 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fdc92-31ee-4625-998f-5749414bf7a7 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:40:54.724396 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545fdc92-31ee-4625-998f-5749414bf7a7 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:40:54.730141 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9abbd-a54a-4191-bd51-b57fb9675c22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4e51f478874d99a7fc4ee2dea77caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:40:54.730814 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9abbd-a54a-4191-bd51-b57fb9675c22 service swift] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:40:54.731101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9abbd-a54a-4191-bd51-b57fb9675c22 service swift] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:40:54.731498 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d9abbd-a54a-4191-bd51-b57fb9675c22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:40:54.739917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9abbd-a54a-4191-bd51-b57fb9675c22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:40:54.741498 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d9abbd-a54a-4191-bd51-b57fb9675c22 service swift] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:40:54.749979 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1242/2517] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jul 18 02:40:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 02:41:04.662583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=42 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:04.747160 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=46 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:10.062710 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee62812-5f19-4f9c-9829-d28f2b7cd54f None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:41:10.063408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee62812-5f19-4f9c-9829-d28f2b7cd54f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:41:10.063408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee62812-5f19-4f9c-9829-d28f2b7cd54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:41:10.083424 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0ee62812-5f19-4f9c-9829-d28f2b7cd54f None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:41:10.085282 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0ee62812-5f19-4f9c-9829-d28f2b7cd54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:41:10.095756 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1276/2518] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Jul 18 02:41:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:41:10.117559 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9abbd-a54a-4191-bd51-b57fb9675c22 service swift] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:41:10.119363 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-26d9abbd-a54a-4191-bd51-b57fb9675c22 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:41:10.147799 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d9abbd-a54a-4191-bd51-b57fb9675c22 service swift] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:41:10.156916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109e660-9612-4d8d-a08e-628411586ca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:41:10.156916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109e660-9612-4d8d-a08e-628411586ca0 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:41:10.156916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109e660-9612-4d8d-a08e-628411586ca0 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:41:10.156916 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109e660-9612-4d8d-a08e-628411586ca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:41:10.169984 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109e660-9612-4d8d-a08e-628411586ca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:41:10.171591 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109e660-9612-4d8d-a08e-628411586ca0 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:41:10.181776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1243/2519] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:41:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:41:13.937554 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385cdf1-613a-4f7f-90c0-93d2c494f09a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:41:13.938100 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385cdf1-613a-4f7f-90c0-93d2c494f09a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:41:13.938199 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c385cdf1-613a-4f7f-90c0-93d2c494f09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:41:13.956187 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-c385cdf1-613a-4f7f-90c0-93d2c494f09a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:41:13.957372 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c385cdf1-613a-4f7f-90c0-93d2c494f09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:41:13.965106 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1277/2520] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Jul 18 02:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:41:13.999420 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109e660-9612-4d8d-a08e-628411586ca0 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:41:14.011219 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109e660-9612-4d8d-a08e-628411586ca0 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:41:14.017556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7c0e7-d2e7-4c29-8994-6608d166ad9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:41:14.018228 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7c0e7-d2e7-4c29-8994-6608d166ad9e service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:41:14.018509 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7c0e7-d2e7-4c29-8994-6608d166ad9e service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:41:14.018780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7c0e7-d2e7-4c29-8994-6608d166ad9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:41:14.027174 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7c0e7-d2e7-4c29-8994-6608d166ad9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:41:14.028739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7c0e7-d2e7-4c29-8994-6608d166ad9e service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:41:14.038407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1244/2521] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:41:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:41:19.209604 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2a9ba-6a1e-4f1a-8291-ed23ba3958d1 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:41:19.210166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2a9ba-6a1e-4f1a-8291-ed23ba3958d1 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:41:19.210277 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2a9ba-6a1e-4f1a-8291-ed23ba3958d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:41:19.227753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-f2d2a9ba-6a1e-4f1a-8291-ed23ba3958d1 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:41:19.228961 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f2d2a9ba-6a1e-4f1a-8291-ed23ba3958d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:41:19.237364 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1278/2522] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Jul 18 02:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:41:19.259865 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7c0e7-d2e7-4c29-8994-6608d166ad9e service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:41:19.271157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7c0e7-d2e7-4c29-8994-6608d166ad9e service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:41:19.276663 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fb8be-64ae-4ffd-9ef3-8a2f7e5192ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:41:19.277319 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fb8be-64ae-4ffd-9ef3-8a2f7e5192ba service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:41:19.277607 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fb8be-64ae-4ffd-9ef3-8a2f7e5192ba service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:41:19.277926 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7fb8be-64ae-4ffd-9ef3-8a2f7e5192ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:41:19.286280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7fb8be-64ae-4ffd-9ef3-8a2f7e5192ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:41:19.287856 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7fb8be-64ae-4ffd-9ef3-8a2f7e5192ba service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:41:19.298075 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1245/2523] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:41:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:41:23.486437 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b04c58-416e-4d90-8eb0-aee6cb1c2955 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:41:23.487000 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b04c58-416e-4d90-8eb0-aee6cb1c2955 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:41:23.487000 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b04c58-416e-4d90-8eb0-aee6cb1c2955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:41:23.505664 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-14b04c58-416e-4d90-8eb0-aee6cb1c2955 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:41:23.507005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-14b04c58-416e-4d90-8eb0-aee6cb1c2955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:41:23.515756 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1279/2524] 10.222.0.75 () {58 vars in 1016 bytes} [Mon Jul 18 02:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:41:23.542969 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fb8be-64ae-4ffd-9ef3-8a2f7e5192ba service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:41:23.554348 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7fb8be-64ae-4ffd-9ef3-8a2f7e5192ba service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:41:23.559959 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58417390-6d8f-466d-aeec-be1dcd1a04b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:41:23.560735 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58417390-6d8f-466d-aeec-be1dcd1a04b4 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:41:23.561506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58417390-6d8f-466d-aeec-be1dcd1a04b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:41:23.561836 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58417390-6d8f-466d-aeec-be1dcd1a04b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:41:23.570380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58417390-6d8f-466d-aeec-be1dcd1a04b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:41:23.571953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58417390-6d8f-466d-aeec-be1dcd1a04b4 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:41:23.582589 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1246/2525] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:41:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:41:24.875124 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b04c58-416e-4d90-8eb0-aee6cb1c2955 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:41:24.876519 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-14b04c58-416e-4d90-8eb0-aee6cb1c2955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:41:24.932101 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b04c58-416e-4d90-8eb0-aee6cb1c2955 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:41:24.935735 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c35217-af52-4bea-9e38-7d3606f0a646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:41:24.936411 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c35217-af52-4bea-9e38-7d3606f0a646 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:41:24.936695 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c35217-af52-4bea-9e38-7d3606f0a646 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:41:24.936973 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c35217-af52-4bea-9e38-7d3606f0a646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:41:24.947592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c35217-af52-4bea-9e38-7d3606f0a646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:41:24.949080 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c35217-af52-4bea-9e38-7d3606f0a646 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:41:24.960582 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1280/2526] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:41:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:41:33.577248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=24 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:34.956373 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=38 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:41:43.452419 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58417390-6d8f-466d-aeec-be1dcd1a04b4 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:41:43.461907 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58417390-6d8f-466d-aeec-be1dcd1a04b4 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:41:43.465681 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39546af4-85bc-478d-8da5-fbc4b5afb7b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:41:43.466660 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39546af4-85bc-478d-8da5-fbc4b5afb7b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:41:43.467022 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39546af4-85bc-478d-8da5-fbc4b5afb7b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:41:43.467370 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39546af4-85bc-478d-8da5-fbc4b5afb7b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:41:43.469313 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-39546af4-85bc-478d-8da5-fbc4b5afb7b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:41:43.483705 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39546af4-85bc-478d-8da5-fbc4b5afb7b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:41:43.485138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39546af4-85bc-478d-8da5-fbc4b5afb7b0 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:41:43.497570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1247/2527] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:41:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:41:43.564109 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c35217-af52-4bea-9e38-7d3606f0a646 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:41:43.572917 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c35217-af52-4bea-9e38-7d3606f0a646 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:41:43.576638 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8268a5b-4ab8-40d9-9bd8-0f78cb344aac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:41:43.577285 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8268a5b-4ab8-40d9-9bd8-0f78cb344aac service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:41:43.577574 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8268a5b-4ab8-40d9-9bd8-0f78cb344aac service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:41:43.578179 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8268a5b-4ab8-40d9-9bd8-0f78cb344aac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:41:43.580021 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b8268a5b-4ab8-40d9-9bd8-0f78cb344aac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:41:43.594892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8268a5b-4ab8-40d9-9bd8-0f78cb344aac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:41:43.596314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8268a5b-4ab8-40d9-9bd8-0f78cb344aac service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:41:43.608597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1281/2528] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:41:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:41:50.077901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744f1e3-b149-4dc9-8b3a-1eded1cb070c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:41:50.077901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744f1e3-b149-4dc9-8b3a-1eded1cb070c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:41:50.077901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744f1e3-b149-4dc9-8b3a-1eded1cb070c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:41:50.094001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1744f1e3-b149-4dc9-8b3a-1eded1cb070c None None] MFA Rules not processed for user `2109160a00894044a5d07516ab1aed2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:41:50.095210 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1744f1e3-b149-4dc9-8b3a-1eded1cb070c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:41:50.158291 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1248/2529] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:41:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:41:53.603483 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=6 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:00.151601 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=31 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:01.600868 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8268a5b-4ab8-40d9-9bd8-0f78cb344aac service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:42:01.602395 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b8268a5b-4ab8-40d9-9bd8-0f78cb344aac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:01.658926 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8268a5b-4ab8-40d9-9bd8-0f78cb344aac service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:42:01.663084 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa6e2e-6039-4b1f-9997-d3c4e74487aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:42:01.664459 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa6e2e-6039-4b1f-9997-d3c4e74487aa service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:01.664744 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa6e2e-6039-4b1f-9997-d3c4e74487aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:01.665251 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaa6e2e-6039-4b1f-9997-d3c4e74487aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:01.667419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-aaaa6e2e-6039-4b1f-9997-d3c4e74487aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:01.730413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa6e2e-6039-4b1f-9997-d3c4e74487aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:42:01.731884 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaa6e2e-6039-4b1f-9997-d3c4e74487aa service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:42:01.741929 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1282/2530] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:42:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:42:02.497204 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744f1e3-b149-4dc9-8b3a-1eded1cb070c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:42:02.511808 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744f1e3-b149-4dc9-8b3a-1eded1cb070c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:42:02.521693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9fd2e-970a-4b1f-9c9e-be5795a87f27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:42:02.522530 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9fd2e-970a-4b1f-9c9e-be5795a87f27 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:02.522826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9fd2e-970a-4b1f-9c9e-be5795a87f27 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:02.523105 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b9fd2e-970a-4b1f-9c9e-be5795a87f27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:02.524911 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c7b9fd2e-970a-4b1f-9c9e-be5795a87f27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:02.536222 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9fd2e-970a-4b1f-9c9e-be5795a87f27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:42:02.538347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b9fd2e-970a-4b1f-9c9e-be5795a87f27 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:42:02.547722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1249/2531] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:42:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:42:02.589663 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa6e2e-6039-4b1f-9997-d3c4e74487aa service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:42:02.599636 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaa6e2e-6039-4b1f-9997-d3c4e74487aa service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:42:02.609840 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5539a9-6bcf-4c78-a666-2d7fae49c849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:42:02.609840 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5539a9-6bcf-4c78-a666-2d7fae49c849 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:02.609840 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5539a9-6bcf-4c78-a666-2d7fae49c849 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:02.609840 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5539a9-6bcf-4c78-a666-2d7fae49c849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:02.610689 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1f5539a9-6bcf-4c78-a666-2d7fae49c849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:02.618965 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5539a9-6bcf-4c78-a666-2d7fae49c849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:42:02.620445 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5539a9-6bcf-4c78-a666-2d7fae49c849 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:42:02.630834 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1283/2532] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:42:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:42:07.151372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9fd2e-970a-4b1f-9c9e-be5795a87f27 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:42:07.153066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c7b9fd2e-970a-4b1f-9c9e-be5795a87f27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:07.236676 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b9fd2e-970a-4b1f-9c9e-be5795a87f27 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:42:07.242871 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464c337-058c-4be9-8fdb-0438191b4674 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '213ba948a3f34c39bce3f6db093479eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:42:07.245201 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464c337-058c-4be9-8fdb-0438191b4674 service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:07.245575 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464c337-058c-4be9-8fdb-0438191b4674 service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:07.245964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464c337-058c-4be9-8fdb-0438191b4674 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:07.247861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8464c337-058c-4be9-8fdb-0438191b4674 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:07.260478 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464c337-058c-4be9-8fdb-0438191b4674 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:42:07.266481 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8464c337-058c-4be9-8fdb-0438191b4674 service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:42:07.272635 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1250/2533] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:42:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:42:07.305061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5539a9-6bcf-4c78-a666-2d7fae49c849 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:42:07.307076 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1f5539a9-6bcf-4c78-a666-2d7fae49c849 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:07.319962 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5539a9-6bcf-4c78-a666-2d7fae49c849 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:42:07.325784 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c7c8e-79ea-4748-8ae0-edd20aff475d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:42:07.326780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c7c8e-79ea-4748-8ae0-edd20aff475d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:07.327149 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c7c8e-79ea-4748-8ae0-edd20aff475d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:07.327503 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c7c8e-79ea-4748-8ae0-edd20aff475d admin admin] PATH_INFO: `/v3/users/6618ecc2692c40be876654dfdc4496b5` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:07.328868 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c7c8e-79ea-4748-8ae0-edd20aff475d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6618ecc2692c40be876654dfdc4496b5)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:42:07.331156 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c7c8e-79ea-4748-8ae0-edd20aff475d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:42:07.541839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-469c7c8e-79ea-4748-8ae0-edd20aff475d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6618ecc2692c40be876654dfdc4496b5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:42:07.542725 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-469c7c8e-79ea-4748-8ae0-edd20aff475d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6618ecc2692c40be876654dfdc4496b5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:42:07.543394 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-469c7c8e-79ea-4748-8ae0-edd20aff475d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6618ecc2692c40be876654dfdc4496b5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:42:07.555517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-469c7c8e-79ea-4748-8ae0-edd20aff475d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6618ecc2692c40be876654dfdc4496b5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:42:07.563682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-469c7c8e-79ea-4748-8ae0-edd20aff475d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6618ecc2692c40be876654dfdc4496b5'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:42:07.659823 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1284/2534] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:42:07 2022] DELETE /identity/v3/users/6618ecc2692c40be876654dfdc4496b5 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:42:08.024246 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464c337-058c-4be9-8fdb-0438191b4674 service placement] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:42:08.037096 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464c337-058c-4be9-8fdb-0438191b4674 service placement] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:42:08.101860 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a6e51-736a-4316-9d00-67cb63865a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:42:08.102736 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a6e51-736a-4316-9d00-67cb63865a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:08.103023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a6e51-736a-4316-9d00-67cb63865a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:08.103300 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a6e51-736a-4316-9d00-67cb63865a98 admin admin] PATH_INFO: `/v3/projects/824120d47e204b5bbbd4fe0024a15f03` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:08.104495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a6e51-736a-4316-9d00-67cb63865a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=824120d47e204b5bbbd4fe0024a15f03)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:42:08.106469 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a6e51-736a-4316-9d00-67cb63865a98 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:42:08.134032 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c7c8e-79ea-4748-8ae0-edd20aff475d admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:42:08.138141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-469c7c8e-79ea-4748-8ae0-edd20aff475d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:08.163889 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:08.226697 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c7c8e-79ea-4748-8ae0-edd20aff475d admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:42:08.232525 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984ba0e-0b8d-4fe8-9e71-f51d634394f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '213ba948a3f34c39bce3f6db093479eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:42:08.233353 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984ba0e-0b8d-4fe8-9e71-f51d634394f8 service placement] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:08.233647 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984ba0e-0b8d-4fe8-9e71-f51d634394f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:08.233967 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4984ba0e-0b8d-4fe8-9e71-f51d634394f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:08.235806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4984ba0e-0b8d-4fe8-9e71-f51d634394f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:08.248489 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984ba0e-0b8d-4fe8-9e71-f51d634394f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:42:08.250288 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4984ba0e-0b8d-4fe8-9e71-f51d634394f8 service placement] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:42:08.261694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1285/2535] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:42:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:42:08.267519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1f1a6e51-736a-4316-9d00-67cb63865a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '824120d47e204b5bbbd4fe0024a15f03', 'request_id': 'req-1f1a6e51-736a-4316-9d00-67cb63865a98'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:42:08.275944 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1f1a6e51-736a-4316-9d00-67cb63865a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '824120d47e204b5bbbd4fe0024a15f03', 'request_id': 'req-1f1a6e51-736a-4316-9d00-67cb63865a98'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:42:08.282814 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1f1a6e51-736a-4316-9d00-67cb63865a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '824120d47e204b5bbbd4fe0024a15f03', 'request_id': 'req-1f1a6e51-736a-4316-9d00-67cb63865a98'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:42:08.353236 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984ba0e-0b8d-4fe8-9e71-f51d634394f8 service placement] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:42:08.354814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4984ba0e-0b8d-4fe8-9e71-f51d634394f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:08.372978 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4984ba0e-0b8d-4fe8-9e71-f51d634394f8 service placement] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:42:08.437195 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1f1a6e51-736a-4316-9d00-67cb63865a98 admin admin] The token cache is being invalidate because project 824120d47e204b5bbbd4fe0024a15f03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:42:08.437490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1f1a6e51-736a-4316-9d00-67cb63865a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:42:08.438974 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1f1a6e51-736a-4316-9d00-67cb63865a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:42:08.441776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1251/2536] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:42:08 2022] DELETE /identity/v3/projects/824120d47e204b5bbbd4fe0024a15f03 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:42:08.450871 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0862586-2240-4a06-8a41-91a621e6e2c5 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:08.451169 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0862586-2240-4a06-8a41-91a621e6e2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:08.451455 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0862586-2240-4a06-8a41-91a621e6e2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:08.469276 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:08.480160 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f0862586-2240-4a06-8a41-91a621e6e2c5 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:42:08.485967 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05f2f5-e6d9-4155-962a-174bb8cab090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:42:08.485967 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05f2f5-e6d9-4155-962a-174bb8cab090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:08.485967 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05f2f5-e6d9-4155-962a-174bb8cab090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:08.485967 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a05f2f5-e6d9-4155-962a-174bb8cab090 admin admin] PATH_INFO: `/v3/users/865e36ae67344c0dbca9dcccca58da42` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:08.486627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f0862586-2240-4a06-8a41-91a621e6e2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:08.486742 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05f2f5-e6d9-4155-962a-174bb8cab090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=865e36ae67344c0dbca9dcccca58da42)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:42:08.488604 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a05f2f5-e6d9-4155-962a-174bb8cab090 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:42:08.503406 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1252/2537] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:42:08.521984 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5fbdc-293b-4aab-a010-9dfdbf0274c1 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:08.522567 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5fbdc-293b-4aab-a010-9dfdbf0274c1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:08.523012 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5fbdc-293b-4aab-a010-9dfdbf0274c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:08.556257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1dd5fbdc-293b-4aab-a010-9dfdbf0274c1 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:42:08.556257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1dd5fbdc-293b-4aab-a010-9dfdbf0274c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:08.564518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1253/2538] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:42:08.565369 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5fbdc-293b-4aab-a010-9dfdbf0274c1 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:42:08.566710 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1dd5fbdc-293b-4aab-a010-9dfdbf0274c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:08.648366 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5fbdc-293b-4aab-a010-9dfdbf0274c1 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:42:08.652203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdd5aa-db07-4459-b8dc-f8654a413f71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:42:08.652934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdd5aa-db07-4459-b8dc-f8654a413f71 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:08.653320 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdd5aa-db07-4459-b8dc-f8654a413f71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:08.653677 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdd5aa-db07-4459-b8dc-f8654a413f71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:08.656438 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f0fdd5aa-db07-4459-b8dc-f8654a413f71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:08.671458 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fdd5aa-db07-4459-b8dc-f8654a413f71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:42:08.676901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fdd5aa-db07-4459-b8dc-f8654a413f71 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:42:08.683700 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1254/2539] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:42:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:42:08.684917 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdd5aa-db07-4459-b8dc-f8654a413f71 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:42:08.701731 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fdd5aa-db07-4459-b8dc-f8654a413f71 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:42:08.707434 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766bb78-e008-4f6c-8185-672e6bd6a2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:42:08.709196 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766bb78-e008-4f6c-8185-672e6bd6a2da admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:08.709729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766bb78-e008-4f6c-8185-672e6bd6a2da admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:08.711073 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0766bb78-e008-4f6c-8185-672e6bd6a2da admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:08.711073 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766bb78-e008-4f6c-8185-672e6bd6a2da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:42:08.711655 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766bb78-e008-4f6c-8185-672e6bd6a2da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:42:08.713987 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0766bb78-e008-4f6c-8185-672e6bd6a2da admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:42:08.730403 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1255/2540] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:42:08.736474 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766bb78-e008-4f6c-8185-672e6bd6a2da admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:42:08.754179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0766bb78-e008-4f6c-8185-672e6bd6a2da admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:42:08.762717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26daa8-7a4f-4540-9d15-f08e60005838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:42:08.764470 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26daa8-7a4f-4540-9d15-f08e60005838 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:08.765212 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26daa8-7a4f-4540-9d15-f08e60005838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:08.766393 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26daa8-7a4f-4540-9d15-f08e60005838 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:08.768821 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26daa8-7a4f-4540-9d15-f08e60005838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:42:08.771260 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff26daa8-7a4f-4540-9d15-f08e60005838 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:42:08.802021 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0a05f2f5-e6d9-4155-962a-174bb8cab090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '865e36ae67344c0dbca9dcccca58da42'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:42:08.804119 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0a05f2f5-e6d9-4155-962a-174bb8cab090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '865e36ae67344c0dbca9dcccca58da42'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:42:08.805756 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0a05f2f5-e6d9-4155-962a-174bb8cab090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '865e36ae67344c0dbca9dcccca58da42'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:42:08.827538 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0a05f2f5-e6d9-4155-962a-174bb8cab090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '865e36ae67344c0dbca9dcccca58da42'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:42:08.836639 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0a05f2f5-e6d9-4155-962a-174bb8cab090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '865e36ae67344c0dbca9dcccca58da42'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:42:08.894492 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1256/2541] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:42:08 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:42:08.898283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26daa8-7a4f-4540-9d15-f08e60005838 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:42:08.900086 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ff26daa8-7a4f-4540-9d15-f08e60005838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:08.926808 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1286/2542] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:42:08 2022] DELETE /identity/v3/users/865e36ae67344c0dbca9dcccca58da42 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:42:08.998028 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26daa8-7a4f-4540-9d15-f08e60005838 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:42:09.101035 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9507ee-8380-43e6-b181-e5ea7606af00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:42:09.103081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9507ee-8380-43e6-b181-e5ea7606af00 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:09.103542 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9507ee-8380-43e6-b181-e5ea7606af00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:09.117316 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9507ee-8380-43e6-b181-e5ea7606af00 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:09.119376 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9507ee-8380-43e6-b181-e5ea7606af00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:42:09.122281 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9507ee-8380-43e6-b181-e5ea7606af00 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:42:09.240628 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:09.249746 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1257/2543] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:42:08 2022] POST /identity/v3/users => generated 288 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:42:09.254235 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05f2f5-e6d9-4155-962a-174bb8cab090 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:42:09.274749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a05f2f5-e6d9-4155-962a-174bb8cab090 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:42:09.279877 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62551c81-a71e-4375-892d-5fc10353a1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:42:09.280924 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62551c81-a71e-4375-892d-5fc10353a1fe admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:09.280924 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62551c81-a71e-4375-892d-5fc10353a1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:09.281194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62551c81-a71e-4375-892d-5fc10353a1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:09.282247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62551c81-a71e-4375-892d-5fc10353a1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:42:09.283974 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62551c81-a71e-4375-892d-5fc10353a1fe admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:42:09.295472 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1287/2544] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:42:09.299850 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9507ee-8380-43e6-b181-e5ea7606af00 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:42:09.311118 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9507ee-8380-43e6-b181-e5ea7606af00 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:42:09.318264 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e4959-e5df-47a2-9990-7d02c78c0d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:42:09.318264 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e4959-e5df-47a2-9990-7d02c78c0d44 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:09.318573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e4959-e5df-47a2-9990-7d02c78c0d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:09.319501 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e4959-e5df-47a2-9990-7d02c78c0d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:09.320169 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e4959-e5df-47a2-9990-7d02c78c0d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:42:09.322021 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e4959-e5df-47a2-9990-7d02c78c0d44 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:42:09.337235 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1258/2545] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:42:09.342080 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62551c81-a71e-4375-892d-5fc10353a1fe admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:42:09.361324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62551c81-a71e-4375-892d-5fc10353a1fe admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:42:09.367849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d21fcd-1951-47b2-b691-8b8461bf0c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:42:09.369128 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d21fcd-1951-47b2-b691-8b8461bf0c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:09.369670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d21fcd-1951-47b2-b691-8b8461bf0c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:09.370194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d21fcd-1951-47b2-b691-8b8461bf0c3b admin admin] PATH_INFO: `/v3/projects/46a8fce9b274470e9e376dd855254739/users/ec9f325ac8e746fbb201640419c27548/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:09.381757 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:09.398830 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d21fcd-1951-47b2-b691-8b8461bf0c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=46a8fce9b274470e9e376dd855254739, user_id=ec9f325ac8e746fbb201640419c27548, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:42:09.406557 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d21fcd-1951-47b2-b691-8b8461bf0c3b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:42:09.526912 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1288/2546] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:42:09 2022] PUT /identity/v3/projects/46a8fce9b274470e9e376dd855254739/users/ec9f325ac8e746fbb201640419c27548/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:42:09.532229 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926515fb-65a4-466c-b3d3-4a7ea43be161 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:09.532551 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926515fb-65a4-466c-b3d3-4a7ea43be161 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:09.532834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926515fb-65a4-466c-b3d3-4a7ea43be161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:09.552088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-926515fb-65a4-466c-b3d3-4a7ea43be161 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:42:09.553357 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-926515fb-65a4-466c-b3d3-4a7ea43be161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:09.564126 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d21fcd-1951-47b2-b691-8b8461bf0c3b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:42:09.567387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-76d21fcd-1951-47b2-b691-8b8461bf0c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:09.658413 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1259/2547] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:42:09.665078 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d21fcd-1951-47b2-b691-8b8461bf0c3b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:42:09.669424 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926515fb-65a4-466c-b3d3-4a7ea43be161 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:42:09.670979 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-926515fb-65a4-466c-b3d3-4a7ea43be161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:09.671352 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2344165-acf9-4138-b875-66f865c0d222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:42:09.676798 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2344165-acf9-4138-b875-66f865c0d222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:09.676798 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2344165-acf9-4138-b875-66f865c0d222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:09.676798 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2344165-acf9-4138-b875-66f865c0d222 admin admin] PATH_INFO: `/v3/projects/c9edf51a28c042b4a6f868003a008e03` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:09.676798 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2344165-acf9-4138-b875-66f865c0d222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9edf51a28c042b4a6f868003a008e03)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:42:09.676798 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2344165-acf9-4138-b875-66f865c0d222 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:42:09.736433 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926515fb-65a4-466c-b3d3-4a7ea43be161 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:42:09.740762 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa466b-1a02-4577-9249-0d9e75476a86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:42:09.745570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa466b-1a02-4577-9249-0d9e75476a86 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:09.745570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa466b-1a02-4577-9249-0d9e75476a86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:09.745570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa466b-1a02-4577-9249-0d9e75476a86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:09.756031 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa466b-1a02-4577-9249-0d9e75476a86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:42:09.757889 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa466b-1a02-4577-9249-0d9e75476a86 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:42:09.770267 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1260/2548] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:42:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:42:09.820643 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f2344165-acf9-4138-b875-66f865c0d222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9edf51a28c042b4a6f868003a008e03', 'request_id': 'req-f2344165-acf9-4138-b875-66f865c0d222'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:42:09.827466 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f2344165-acf9-4138-b875-66f865c0d222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9edf51a28c042b4a6f868003a008e03', 'request_id': 'req-f2344165-acf9-4138-b875-66f865c0d222'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:42:09.834989 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f2344165-acf9-4138-b875-66f865c0d222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9edf51a28c042b4a6f868003a008e03', 'request_id': 'req-f2344165-acf9-4138-b875-66f865c0d222'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:42:09.903559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f2344165-acf9-4138-b875-66f865c0d222 admin admin] The token cache is being invalidate because project c9edf51a28c042b4a6f868003a008e03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:42:09.904001 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f2344165-acf9-4138-b875-66f865c0d222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:42:09.905256 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f2344165-acf9-4138-b875-66f865c0d222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:42:09.907483 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1289/2549] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:42:09 2022] DELETE /identity/v3/projects/c9edf51a28c042b4a6f868003a008e03 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:42:16.373153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591283a-f35b-414f-ae78-3c2ccf427836 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:16.373552 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591283a-f35b-414f-ae78-3c2ccf427836 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:16.373732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7591283a-f35b-414f-ae78-3c2ccf427836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:16.393768 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7591283a-f35b-414f-ae78-3c2ccf427836 None None] MFA Rules not processed for user `1f09a9a483934c88a06be690f02fba4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:42:16.395210 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7591283a-f35b-414f-ae78-3c2ccf427836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:16.453859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1261/2550] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:42:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:42:16.825215 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2344165-acf9-4138-b875-66f865c0d222 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:42:16.826741 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f2344165-acf9-4138-b875-66f865c0d222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:16.869300 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31ce1d-4e2d-45d6-802a-e4db8e123f77 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:16.869592 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31ce1d-4e2d-45d6-802a-e4db8e123f77 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:16.869932 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31ce1d-4e2d-45d6-802a-e4db8e123f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:16.905482 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2344165-acf9-4138-b875-66f865c0d222 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:42:16.905970 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6e31ce1d-4e2d-45d6-802a-e4db8e123f77 None None] MFA Rules not processed for user `ec9f325ac8e746fbb201640419c27548`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:42:16.907496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6e31ce1d-4e2d-45d6-802a-e4db8e123f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:16.910090 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79d3a3-9667-40e2-941c-7800ebe08156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:42:16.911066 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79d3a3-9667-40e2-941c-7800ebe08156 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:16.911772 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79d3a3-9667-40e2-941c-7800ebe08156 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:16.912793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79d3a3-9667-40e2-941c-7800ebe08156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:16.915492 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-dd79d3a3-9667-40e2-941c-7800ebe08156 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:16.930678 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79d3a3-9667-40e2-941c-7800ebe08156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:42:16.932183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79d3a3-9667-40e2-941c-7800ebe08156 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:42:16.935886 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:16.940993 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1290/2551] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:42:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:42:16.998334 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1262/2552] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:42:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:42:17.012951 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79d3a3-9667-40e2-941c-7800ebe08156 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:42:17.014516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-dd79d3a3-9667-40e2-941c-7800ebe08156 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:17.038060 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:17.099097 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79d3a3-9667-40e2-941c-7800ebe08156 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:42:17.105895 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19d1e3-e660-4432-bb8e-32cd5c1bdc13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:42:17.106566 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19d1e3-e660-4432-bb8e-32cd5c1bdc13 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:17.106848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19d1e3-e660-4432-bb8e-32cd5c1bdc13 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:17.107123 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19d1e3-e660-4432-bb8e-32cd5c1bdc13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:17.117979 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19d1e3-e660-4432-bb8e-32cd5c1bdc13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:42:17.119598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19d1e3-e660-4432-bb8e-32cd5c1bdc13 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:42:17.134050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1291/2553] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:42:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:42:17.363946 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31ce1d-4e2d-45d6-802a-e4db8e123f77 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:42:17.367169 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6e31ce1d-4e2d-45d6-802a-e4db8e123f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:17.453465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e31ce1d-4e2d-45d6-802a-e4db8e123f77 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:42:17.459087 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69aff7-56ad-4478-b321-8734c89d7ac9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '213ba948a3f34c39bce3f6db093479eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:42:17.459807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69aff7-56ad-4478-b321-8734c89d7ac9 service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:17.460156 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69aff7-56ad-4478-b321-8734c89d7ac9 service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:17.460621 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba69aff7-56ad-4478-b321-8734c89d7ac9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:17.462672 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ba69aff7-56ad-4478-b321-8734c89d7ac9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:17.476131 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69aff7-56ad-4478-b321-8734c89d7ac9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:42:17.478354 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba69aff7-56ad-4478-b321-8734c89d7ac9 service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:42:17.489520 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1263/2554] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:42:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:42:20.175227 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddcf6b-89ee-4ef9-b4a0-56b54f76953b None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:20.175721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddcf6b-89ee-4ef9-b4a0-56b54f76953b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:20.175831 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddcf6b-89ee-4ef9-b4a0-56b54f76953b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:20.196237 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a2ddcf6b-89ee-4ef9-b4a0-56b54f76953b None None] MFA Rules not processed for user `ec9f325ac8e746fbb201640419c27548`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:42:20.198263 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a2ddcf6b-89ee-4ef9-b4a0-56b54f76953b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:20.205962 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1292/2555] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:42:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:42:27.484966 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=48 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:27.723814 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69aff7-56ad-4478-b321-8734c89d7ac9 service placement] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:42:27.726218 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ba69aff7-56ad-4478-b321-8734c89d7ac9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:27.742126 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba69aff7-56ad-4478-b321-8734c89d7ac9 service placement] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:42:27.747709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b5147-54e6-4164-856e-c21dbf8fb286 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:42:27.748460 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b5147-54e6-4164-856e-c21dbf8fb286 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:27.749265 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b5147-54e6-4164-856e-c21dbf8fb286 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:27.749265 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b5147-54e6-4164-856e-c21dbf8fb286 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:27.751014 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2e8b5147-54e6-4164-856e-c21dbf8fb286 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:27.763547 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b5147-54e6-4164-856e-c21dbf8fb286 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:42:27.765168 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b5147-54e6-4164-856e-c21dbf8fb286 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:42:27.776878 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1264/2556] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:42:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:42:30.189910 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=28 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:32.930050 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddcf6b-89ee-4ef9-b4a0-56b54f76953b None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:42:32.943835 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddcf6b-89ee-4ef9-b4a0-56b54f76953b None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:42:32.949591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13f62d-66bb-4f9f-8808-68b204d40296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:42:32.953809 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13f62d-66bb-4f9f-8808-68b204d40296 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:42:32.953809 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13f62d-66bb-4f9f-8808-68b204d40296 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:42:32.953809 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e13f62d-66bb-4f9f-8808-68b204d40296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:42:32.953809 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9e13f62d-66bb-4f9f-8808-68b204d40296 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:42:32.965948 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13f62d-66bb-4f9f-8808-68b204d40296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:42:32.967517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e13f62d-66bb-4f9f-8808-68b204d40296 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:42:32.978772 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1293/2557] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:42:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:42:37.771605 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=6 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:42:42.973681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=6 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:07.548436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b5147-54e6-4164-856e-c21dbf8fb286 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:07.569277 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b5147-54e6-4164-856e-c21dbf8fb286 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:07.578082 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aecb41-3320-48b0-81e7-b36dc3abd6ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:07.579111 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aecb41-3320-48b0-81e7-b36dc3abd6ee service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:07.579640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aecb41-3320-48b0-81e7-b36dc3abd6ee service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:07.580714 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aecb41-3320-48b0-81e7-b36dc3abd6ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:07.583291 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-85aecb41-3320-48b0-81e7-b36dc3abd6ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:07.601612 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aecb41-3320-48b0-81e7-b36dc3abd6ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:07.603855 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85aecb41-3320-48b0-81e7-b36dc3abd6ee service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:07.621019 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1265/2558] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:43:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:43:11.453899 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13f62d-66bb-4f9f-8808-68b204d40296 service nova] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:11.467711 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e13f62d-66bb-4f9f-8808-68b204d40296 service nova] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:11.473562 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7e6bb-5cf9-44db-b2c9-c8f6c25fe6e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:11.474258 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7e6bb-5cf9-44db-b2c9-c8f6c25fe6e3 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:11.474551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7e6bb-5cf9-44db-b2c9-c8f6c25fe6e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:11.474836 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b7e6bb-5cf9-44db-b2c9-c8f6c25fe6e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:11.476631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-72b7e6bb-5cf9-44db-b2c9-c8f6c25fe6e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:11.536569 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7e6bb-5cf9-44db-b2c9-c8f6c25fe6e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:11.538209 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b7e6bb-5cf9-44db-b2c9-c8f6c25fe6e3 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:11.547281 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1294/2559] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:43:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:43:13.067824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec5628-4e06-4aaf-b56f-5bf2f56995af None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:13.068339 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec5628-4e06-4aaf-b56f-5bf2f56995af None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:13.068442 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec5628-4e06-4aaf-b56f-5bf2f56995af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:13.087926 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-38ec5628-4e06-4aaf-b56f-5bf2f56995af None None] MFA Rules not processed for user `01113a3f8cbf46b09fb5fcf4315a219b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:43:13.089993 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-38ec5628-4e06-4aaf-b56f-5bf2f56995af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:13.146531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1266/2560] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jul 18 02:43:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:43:13.188061 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7e6bb-5cf9-44db-b2c9-c8f6c25fe6e3 service nova] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:13.189606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-72b7e6bb-5cf9-44db-b2c9-c8f6c25fe6e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:13.268376 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b7e6bb-5cf9-44db-b2c9-c8f6c25fe6e3 service nova] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:13.273578 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4abe1-0162-47c0-b929-9edf0d5a8258 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4e51f478874d99a7fc4ee2dea77caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:13.274270 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4abe1-0162-47c0-b929-9edf0d5a8258 service swift] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:13.275197 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4abe1-0162-47c0-b929-9edf0d5a8258 service swift] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:13.275501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4abe1-0162-47c0-b929-9edf0d5a8258 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:13.284074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4abe1-0162-47c0-b929-9edf0d5a8258 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:13.285689 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4abe1-0162-47c0-b929-9edf0d5a8258 service swift] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:13.294135 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1295/2561] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jul 18 02:43:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 02:43:18.194373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e99d3-1370-4918-b442-497372363447 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:18.194928 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e99d3-1370-4918-b442-497372363447 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:18.195087 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705e99d3-1370-4918-b442-497372363447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:18.216660 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-705e99d3-1370-4918-b442-497372363447 None None] MFA Rules not processed for user `01113a3f8cbf46b09fb5fcf4315a219b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:43:18.230046 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-705e99d3-1370-4918-b442-497372363447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:18.230046 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1267/2562] 10.222.0.64 () {58 vars in 967 bytes} [Mon Jul 18 02:43:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:43:18.258543 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4abe1-0162-47c0-b929-9edf0d5a8258 service swift] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:18.275238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4abe1-0162-47c0-b929-9edf0d5a8258 service swift] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:18.281551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaad433-bbc9-453c-a379-b927a14aed3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4e51f478874d99a7fc4ee2dea77caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:18.286108 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaad433-bbc9-453c-a379-b927a14aed3c service swift] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:18.286108 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaad433-bbc9-453c-a379-b927a14aed3c service swift] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:18.286108 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaad433-bbc9-453c-a379-b927a14aed3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:18.294876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaad433-bbc9-453c-a379-b927a14aed3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:18.297163 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaad433-bbc9-453c-a379-b927a14aed3c service swift] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:18.309001 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1296/2563] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jul 18 02:43:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 02:43:28.210551 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=34 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:28.303806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=66 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:30.522017 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e99d3-1370-4918-b442-497372363447 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:30.524574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-705e99d3-1370-4918-b442-497372363447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:30.599527 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705e99d3-1370-4918-b442-497372363447 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:30.604715 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b2b79-5fed-4146-9937-be52149b5f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:30.605612 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b2b79-5fed-4146-9937-be52149b5f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:30.605987 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b2b79-5fed-4146-9937-be52149b5f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:30.606267 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b2b79-5fed-4146-9937-be52149b5f5c admin admin] PATH_INFO: `/v3/users/0fc8220c7c97498ba73ba56645056fdb` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:30.607612 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b2b79-5fed-4146-9937-be52149b5f5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fc8220c7c97498ba73ba56645056fdb)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:30.609546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b2b79-5fed-4146-9937-be52149b5f5c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:30.893968 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0f0b2b79-5fed-4146-9937-be52149b5f5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fc8220c7c97498ba73ba56645056fdb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:30.894805 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0f0b2b79-5fed-4146-9937-be52149b5f5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fc8220c7c97498ba73ba56645056fdb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:30.895482 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0f0b2b79-5fed-4146-9937-be52149b5f5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fc8220c7c97498ba73ba56645056fdb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:30.925886 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0f0b2b79-5fed-4146-9937-be52149b5f5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fc8220c7c97498ba73ba56645056fdb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:30.997416 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0f0b2b79-5fed-4146-9937-be52149b5f5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fc8220c7c97498ba73ba56645056fdb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:31.011763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1268/2564] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:43:30 2022] DELETE /identity/v3/users/0fc8220c7c97498ba73ba56645056fdb => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:43:31.335743 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaad433-bbc9-453c-a379-b927a14aed3c service swift] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:31.348952 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaad433-bbc9-453c-a379-b927a14aed3c service swift] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:31.417075 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c259a-3b0a-4af8-8009-11b4097b3fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:31.417981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c259a-3b0a-4af8-8009-11b4097b3fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:31.418293 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c259a-3b0a-4af8-8009-11b4097b3fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:31.418658 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c259a-3b0a-4af8-8009-11b4097b3fb4 admin admin] PATH_INFO: `/v3/projects/5f6d8a92f16942888f4181943e4306e8` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:31.420107 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c259a-3b0a-4af8-8009-11b4097b3fb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f6d8a92f16942888f4181943e4306e8)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:31.422008 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c259a-3b0a-4af8-8009-11b4097b3fb4 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:31.564489 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e52c259a-3b0a-4af8-8009-11b4097b3fb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f6d8a92f16942888f4181943e4306e8', 'request_id': 'req-e52c259a-3b0a-4af8-8009-11b4097b3fb4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:31.570242 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e52c259a-3b0a-4af8-8009-11b4097b3fb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f6d8a92f16942888f4181943e4306e8', 'request_id': 'req-e52c259a-3b0a-4af8-8009-11b4097b3fb4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:31.577328 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e52c259a-3b0a-4af8-8009-11b4097b3fb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f6d8a92f16942888f4181943e4306e8', 'request_id': 'req-e52c259a-3b0a-4af8-8009-11b4097b3fb4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:31.671494 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e52c259a-3b0a-4af8-8009-11b4097b3fb4 admin admin] The token cache is being invalidate because project 5f6d8a92f16942888f4181943e4306e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:43:31.671999 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e52c259a-3b0a-4af8-8009-11b4097b3fb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:31.672832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e52c259a-3b0a-4af8-8009-11b4097b3fb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:31.675743 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1297/2565] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:43:31 2022] DELETE /identity/v3/projects/5f6d8a92f16942888f4181943e4306e8 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:43:31.679745 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b2b79-5fed-4146-9937-be52149b5f5c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:31.681212 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0f0b2b79-5fed-4146-9937-be52149b5f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:31.696355 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b2b79-5fed-4146-9937-be52149b5f5c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:31.754515 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ea2137-8b57-48db-a5c7-9f71bb90d4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:31.755395 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea2137-8b57-48db-a5c7-9f71bb90d4aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:31.755675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea2137-8b57-48db-a5c7-9f71bb90d4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:31.755952 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ea2137-8b57-48db-a5c7-9f71bb90d4aa admin admin] PATH_INFO: `/v3/users/77716f2cdeac4472ae4a2a9343633a3c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:31.757155 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea2137-8b57-48db-a5c7-9f71bb90d4aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=77716f2cdeac4472ae4a2a9343633a3c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:31.759252 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ea2137-8b57-48db-a5c7-9f71bb90d4aa admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:31.780943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:31.956015 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f1ea2137-8b57-48db-a5c7-9f71bb90d4aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77716f2cdeac4472ae4a2a9343633a3c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:31.956991 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f1ea2137-8b57-48db-a5c7-9f71bb90d4aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77716f2cdeac4472ae4a2a9343633a3c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:31.957612 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f1ea2137-8b57-48db-a5c7-9f71bb90d4aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77716f2cdeac4472ae4a2a9343633a3c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:31.971613 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f1ea2137-8b57-48db-a5c7-9f71bb90d4aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77716f2cdeac4472ae4a2a9343633a3c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:32.054301 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-f1ea2137-8b57-48db-a5c7-9f71bb90d4aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77716f2cdeac4472ae4a2a9343633a3c'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:32.069191 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1269/2566] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:43:31 2022] DELETE /identity/v3/users/77716f2cdeac4472ae4a2a9343633a3c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:43:32.472525 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c259a-3b0a-4af8-8009-11b4097b3fb4 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:32.472525 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e52c259a-3b0a-4af8-8009-11b4097b3fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:32.484643 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c259a-3b0a-4af8-8009-11b4097b3fb4 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:32.565285 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8296308-eb4b-4f3e-9ee5-2f00363e4fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:32.566234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8296308-eb4b-4f3e-9ee5-2f00363e4fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:32.566522 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8296308-eb4b-4f3e-9ee5-2f00363e4fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:32.566805 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8296308-eb4b-4f3e-9ee5-2f00363e4fdb admin admin] PATH_INFO: `/v3/projects/4eccf371af5b4612a07061a1d9bba658` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:32.568309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8296308-eb4b-4f3e-9ee5-2f00363e4fdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eccf371af5b4612a07061a1d9bba658)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:32.570626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8296308-eb4b-4f3e-9ee5-2f00363e4fdb admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:32.711739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:32.724792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b8296308-eb4b-4f3e-9ee5-2f00363e4fdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eccf371af5b4612a07061a1d9bba658', 'request_id': 'req-b8296308-eb4b-4f3e-9ee5-2f00363e4fdb'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:32.730251 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b8296308-eb4b-4f3e-9ee5-2f00363e4fdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eccf371af5b4612a07061a1d9bba658', 'request_id': 'req-b8296308-eb4b-4f3e-9ee5-2f00363e4fdb'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:32.736334 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b8296308-eb4b-4f3e-9ee5-2f00363e4fdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eccf371af5b4612a07061a1d9bba658', 'request_id': 'req-b8296308-eb4b-4f3e-9ee5-2f00363e4fdb'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:32.848547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b8296308-eb4b-4f3e-9ee5-2f00363e4fdb admin admin] The token cache is being invalidate because project 4eccf371af5b4612a07061a1d9bba658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:43:32.848841 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b8296308-eb4b-4f3e-9ee5-2f00363e4fdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:32.849475 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b8296308-eb4b-4f3e-9ee5-2f00363e4fdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:32.851053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1298/2567] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:43:32 2022] DELETE /identity/v3/projects/4eccf371af5b4612a07061a1d9bba658 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:43:34.731115 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b21725-ead7-4e20-b9ab-32eb765f7886 None None] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:34.731610 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b21725-ead7-4e20-b9ab-32eb765f7886 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:34.731729 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b21725-ead7-4e20-b9ab-32eb765f7886 None None] PATH_INFO: `/` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:34.733153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1270/2568] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jul 18 02:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:43:34.739151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e708057-3c29-498f-a42b-102b34f0c3d6 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:34.739599 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e708057-3c29-498f-a42b-102b34f0c3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:34.739719 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e708057-3c29-498f-a42b-102b34f0c3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:34.760687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-8e708057-3c29-498f-a42b-102b34f0c3d6 None None] MFA Rules not processed for user `6f51aae36f0b42868567840fa957ffe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:43:34.762079 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8e708057-3c29-498f-a42b-102b34f0c3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:34.831639 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1299/2569] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jul 18 02:43:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:43:34.843518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b21725-ead7-4e20-b9ab-32eb765f7886 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:34.845197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-54b21725-ead7-4e20-b9ab-32eb765f7886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:34.904318 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b21725-ead7-4e20-b9ab-32eb765f7886 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:34.907934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bf82c-aa18-4006-87d6-a3e6621a1e08 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8948dc6a55344eaa85e2a6092215ec6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:34.908579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bf82c-aa18-4006-87d6-a3e6621a1e08 service glance] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:34.908871 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bf82c-aa18-4006-87d6-a3e6621a1e08 service glance] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:34.909149 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bf82c-aa18-4006-87d6-a3e6621a1e08 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:34.920324 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bf82c-aa18-4006-87d6-a3e6621a1e08 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:34.921856 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bf82c-aa18-4006-87d6-a3e6621a1e08 service glance] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:34.933471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1271/2570] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:43:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:43:35.159143 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102853d8-486e-4dd0-8979-bc3c2a7f6a56 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:35.159432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102853d8-486e-4dd0-8979-bc3c2a7f6a56 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:35.159708 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102853d8-486e-4dd0-8979-bc3c2a7f6a56 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:35.161148 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1300/2571] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jul 18 02:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:43:35.166609 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eeadb-152c-4bdb-9363-33229651842e None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:35.166942 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eeadb-152c-4bdb-9363-33229651842e None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:35.167219 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267eeadb-152c-4bdb-9363-33229651842e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:35.186838 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-267eeadb-152c-4bdb-9363-33229651842e None None] MFA Rules not processed for user `fa9e6d3fe3e740e6aedab33d727ec478`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:43:35.188037 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-267eeadb-152c-4bdb-9363-33229651842e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:35.237549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1272/2572] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jul 18 02:43:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:43:35.250192 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102853d8-486e-4dd0-8979-bc3c2a7f6a56 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:35.251899 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-102853d8-486e-4dd0-8979-bc3c2a7f6a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:35.265015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102853d8-486e-4dd0-8979-bc3c2a7f6a56 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:35.269047 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5fb01-3061-411a-bbd1-fb8064533a76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:35.269836 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5fb01-3061-411a-bbd1-fb8064533a76 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:35.270125 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5fb01-3061-411a-bbd1-fb8064533a76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:35.270403 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5fb01-3061-411a-bbd1-fb8064533a76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:35.278448 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5fb01-3061-411a-bbd1-fb8064533a76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:35.279870 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d5fb01-3061-411a-bbd1-fb8064533a76 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:35.287639 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1301/2573] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:43:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:43:38.586974 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267eeadb-152c-4bdb-9363-33229651842e None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:38.590807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-267eeadb-152c-4bdb-9363-33229651842e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:38.608055 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267eeadb-152c-4bdb-9363-33229651842e None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:38.611918 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bf5d1-9202-469e-b0a3-8f6ece3f66f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:38.612580 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bf5d1-9202-469e-b0a3-8f6ece3f66f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:38.612867 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bf5d1-9202-469e-b0a3-8f6ece3f66f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:38.613147 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908bf5d1-9202-469e-b0a3-8f6ece3f66f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:38.614944 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-908bf5d1-9202-469e-b0a3-8f6ece3f66f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:38.623716 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b8a6d-26a5-44bf-b5f6-720567127d37 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:38.624831 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b8a6d-26a5-44bf-b5f6-720567127d37 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:38.625454 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b8a6d-26a5-44bf-b5f6-720567127d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:38.644959 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-af5b8a6d-26a5-44bf-b5f6-720567127d37 None None] MFA Rules not processed for user `01113a3f8cbf46b09fb5fcf4315a219b`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:43:38.646378 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-af5b8a6d-26a5-44bf-b5f6-720567127d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:38.678755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:38.698796 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908bf5d1-9202-469e-b0a3-8f6ece3f66f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:38.700345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908bf5d1-9202-469e-b0a3-8f6ece3f66f2 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:38.715015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1302/2574] 10.222.0.64 () {58 vars in 1009 bytes} [Mon Jul 18 02:43:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:43:38.718254 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1273/2575] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:43:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:43:38.729778 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b8a6d-26a5-44bf-b5f6-720567127d37 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:38.731369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-af5b8a6d-26a5-44bf-b5f6-720567127d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:38.781921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:38.805553 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b8a6d-26a5-44bf-b5f6-720567127d37 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:38.811680 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87744bde-3f47-4dc7-99b5-4d6141d50203 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4e51f478874d99a7fc4ee2dea77caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:38.812344 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87744bde-3f47-4dc7-99b5-4d6141d50203 service swift] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:38.812635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87744bde-3f47-4dc7-99b5-4d6141d50203 service swift] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:38.812921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87744bde-3f47-4dc7-99b5-4d6141d50203 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:38.821488 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87744bde-3f47-4dc7-99b5-4d6141d50203 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:38.822931 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87744bde-3f47-4dc7-99b5-4d6141d50203 service swift] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:38.831276 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1303/2576] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jul 18 02:43:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 02:43:43.490741 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bf5d1-9202-469e-b0a3-8f6ece3f66f2 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:43.494172 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-908bf5d1-9202-469e-b0a3-8f6ece3f66f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:43.509451 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908bf5d1-9202-469e-b0a3-8f6ece3f66f2 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:43.515497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf2488-fcc1-45b4-81de-47bd1e70d6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:43.516720 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf2488-fcc1-45b4-81de-47bd1e70d6b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:43.517182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf2488-fcc1-45b4-81de-47bd1e70d6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:43.517644 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf2488-fcc1-45b4-81de-47bd1e70d6b4 admin admin] PATH_INFO: `/v3/users/1f09a9a483934c88a06be690f02fba4b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:43.519071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf2488-fcc1-45b4-81de-47bd1e70d6b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f09a9a483934c88a06be690f02fba4b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:43.521819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf2488-fcc1-45b4-81de-47bd1e70d6b4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:43.775578 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-bddf2488-fcc1-45b4-81de-47bd1e70d6b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f09a9a483934c88a06be690f02fba4b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:43.776278 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-bddf2488-fcc1-45b4-81de-47bd1e70d6b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f09a9a483934c88a06be690f02fba4b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:43.776952 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-bddf2488-fcc1-45b4-81de-47bd1e70d6b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f09a9a483934c88a06be690f02fba4b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:43.792882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-bddf2488-fcc1-45b4-81de-47bd1e70d6b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f09a9a483934c88a06be690f02fba4b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:43.900255 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-bddf2488-fcc1-45b4-81de-47bd1e70d6b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f09a9a483934c88a06be690f02fba4b'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:43.916039 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1274/2577] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:43:43 2022] DELETE /identity/v3/users/1f09a9a483934c88a06be690f02fba4b => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:43:44.222622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87744bde-3f47-4dc7-99b5-4d6141d50203 service swift] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:44.249871 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87744bde-3f47-4dc7-99b5-4d6141d50203 service swift] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:44.332488 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c890d-f25d-4149-95bb-edf51f83dba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:44.333650 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c890d-f25d-4149-95bb-edf51f83dba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:44.334379 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c890d-f25d-4149-95bb-edf51f83dba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:44.334836 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c890d-f25d-4149-95bb-edf51f83dba4 admin admin] PATH_INFO: `/v3/projects/20ccca50870f4a86b5ba6c20ceb8d24a` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:44.336236 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c890d-f25d-4149-95bb-edf51f83dba4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20ccca50870f4a86b5ba6c20ceb8d24a)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:44.349397 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c890d-f25d-4149-95bb-edf51f83dba4 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:44.482806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d72c890d-f25d-4149-95bb-edf51f83dba4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20ccca50870f4a86b5ba6c20ceb8d24a', 'request_id': 'req-d72c890d-f25d-4149-95bb-edf51f83dba4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:44.494758 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d72c890d-f25d-4149-95bb-edf51f83dba4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20ccca50870f4a86b5ba6c20ceb8d24a', 'request_id': 'req-d72c890d-f25d-4149-95bb-edf51f83dba4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:44.508431 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d72c890d-f25d-4149-95bb-edf51f83dba4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20ccca50870f4a86b5ba6c20ceb8d24a', 'request_id': 'req-d72c890d-f25d-4149-95bb-edf51f83dba4'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:44.644257 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d72c890d-f25d-4149-95bb-edf51f83dba4 admin admin] The token cache is being invalidate because project 20ccca50870f4a86b5ba6c20ceb8d24a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:43:44.649287 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d72c890d-f25d-4149-95bb-edf51f83dba4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:44.649287 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d72c890d-f25d-4149-95bb-edf51f83dba4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:44.649287 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1304/2578] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:43:44 2022] DELETE /identity/v3/projects/20ccca50870f4a86b5ba6c20ceb8d24a => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:43:44.653513 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f5635-b394-4d2e-a1bf-261fbb044ffe None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:44.654086 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f5635-b394-4d2e-a1bf-261fbb044ffe None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:44.654332 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2f5635-b394-4d2e-a1bf-261fbb044ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:44.672792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6b2f5635-b394-4d2e-a1bf-261fbb044ffe None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:43:44.674280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6b2f5635-b394-4d2e-a1bf-261fbb044ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:44.742407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1275/2579] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:43:44.750571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a65c2-0cb4-4a42-98e4-7c4543d6e03e None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:44.750863 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a65c2-0cb4-4a42-98e4-7c4543d6e03e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:44.751171 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a65c2-0cb4-4a42-98e4-7c4543d6e03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:44.773068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-370a65c2-0cb4-4a42-98e4-7c4543d6e03e None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:43:44.774356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-370a65c2-0cb4-4a42-98e4-7c4543d6e03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:44.783365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1305/2580] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:43:44.787783 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f5635-b394-4d2e-a1bf-261fbb044ffe None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:44.798390 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2f5635-b394-4d2e-a1bf-261fbb044ffe None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:44.803506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75e3a0-72f5-4810-b675-cfe6e4b94156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:44.804289 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75e3a0-72f5-4810-b675-cfe6e4b94156 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:44.804694 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75e3a0-72f5-4810-b675-cfe6e4b94156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:44.805073 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c75e3a0-72f5-4810-b675-cfe6e4b94156 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:44.805978 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75e3a0-72f5-4810-b675-cfe6e4b94156 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:43:44.806502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75e3a0-72f5-4810-b675-cfe6e4b94156 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:44.808295 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c75e3a0-72f5-4810-b675-cfe6e4b94156 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:44.823390 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1276/2581] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:43:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:43:44.827714 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a65c2-0cb4-4a42-98e4-7c4543d6e03e None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:44.837611 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a65c2-0cb4-4a42-98e4-7c4543d6e03e None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:44.842893 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cb233-b054-4b09-8cf1-9e10292f24a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:44.843549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cb233-b054-4b09-8cf1-9e10292f24a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:44.843833 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cb233-b054-4b09-8cf1-9e10292f24a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:44.844110 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928cb233-b054-4b09-8cf1-9e10292f24a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:44.844801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928cb233-b054-4b09-8cf1-9e10292f24a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:44.846865 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928cb233-b054-4b09-8cf1-9e10292f24a2 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:44.983616 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1306/2582] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:43:44 2022] POST /identity/v3/projects => generated 365 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:43:44.988250 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75e3a0-72f5-4810-b675-cfe6e4b94156 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:44.999448 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c75e3a0-72f5-4810-b675-cfe6e4b94156 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:45.058945 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:45.075167 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212422fb-1d5e-4e79-9af5-f2e725cd12fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:45.075951 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212422fb-1d5e-4e79-9af5-f2e725cd12fa admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:45.076322 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212422fb-1d5e-4e79-9af5-f2e725cd12fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:45.076663 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212422fb-1d5e-4e79-9af5-f2e725cd12fa admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:45.077436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212422fb-1d5e-4e79-9af5-f2e725cd12fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:45.079404 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212422fb-1d5e-4e79-9af5-f2e725cd12fa admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:45.235286 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1277/2583] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:43:44 2022] POST /identity/v3/users => generated 283 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:43:45.239402 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cb233-b054-4b09-8cf1-9e10292f24a2 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:45.253069 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928cb233-b054-4b09-8cf1-9e10292f24a2 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:45.257865 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6add59d-69ff-4ac4-b72f-f3d9f32f2e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:45.258681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6add59d-69ff-4ac4-b72f-f3d9f32f2e8e admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:45.258970 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6add59d-69ff-4ac4-b72f-f3d9f32f2e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:45.259252 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6add59d-69ff-4ac4-b72f-f3d9f32f2e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:45.260615 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6add59d-69ff-4ac4-b72f-f3d9f32f2e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:45.262715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6add59d-69ff-4ac4-b72f-f3d9f32f2e8e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:45.274323 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1307/2584] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:43:45.280247 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212422fb-1d5e-4e79-9af5-f2e725cd12fa admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:45.295627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212422fb-1d5e-4e79-9af5-f2e725cd12fa admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:45.300934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3ef5e-508a-404c-8708-218f3b3abed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:45.301882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3ef5e-508a-404c-8708-218f3b3abed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:45.302229 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3ef5e-508a-404c-8708-218f3b3abed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:45.302601 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3ef5e-508a-404c-8708-218f3b3abed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:45.303503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3ef5e-508a-404c-8708-218f3b3abed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:45.305273 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3ef5e-508a-404c-8708-218f3b3abed2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:45.317614 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1278/2585] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:43:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:43:45.321645 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6add59d-69ff-4ac4-b72f-f3d9f32f2e8e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:45.332112 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6add59d-69ff-4ac4-b72f-f3d9f32f2e8e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:45.336852 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b145b-64ff-4204-a5cb-ca129bc52838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:45.337815 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b145b-64ff-4204-a5cb-ca129bc52838 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:45.338635 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b145b-64ff-4204-a5cb-ca129bc52838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:45.338919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b145b-64ff-4204-a5cb-ca129bc52838 admin admin] PATH_INFO: `/v3/projects/66966e655d894851a34bd58ef4a7f80b/users/27fb61510a5c47a8b584a7eab2d6e77b/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:45.357588 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b145b-64ff-4204-a5cb-ca129bc52838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66966e655d894851a34bd58ef4a7f80b, user_id=27fb61510a5c47a8b584a7eab2d6e77b, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:45.361287 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b145b-64ff-4204-a5cb-ca129bc52838 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:45.496831 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:45.501525 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1308/2586] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:43:45 2022] PUT /identity/v3/projects/66966e655d894851a34bd58ef4a7f80b/users/27fb61510a5c47a8b584a7eab2d6e77b/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:43:45.512752 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a7af4-0929-4453-ad6c-0a56557583ef None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:45.513171 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a7af4-0929-4453-ad6c-0a56557583ef None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:45.518240 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a7af4-0929-4453-ad6c-0a56557583ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:45.549276 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-586a7af4-0929-4453-ad6c-0a56557583ef None None] MFA Rules not processed for user `27fb61510a5c47a8b584a7eab2d6e77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:43:45.550750 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-586a7af4-0929-4453-ad6c-0a56557583ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:45.671299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1279/2587] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:43:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:43:45.675737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b145b-64ff-4204-a5cb-ca129bc52838 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:45.789825 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b145b-64ff-4204-a5cb-ca129bc52838 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:45.795458 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13846e9-a7e0-449d-aab2-2f2b6239dd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:45.796394 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13846e9-a7e0-449d-aab2-2f2b6239dd12 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:45.796768 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13846e9-a7e0-449d-aab2-2f2b6239dd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:45.797123 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13846e9-a7e0-449d-aab2-2f2b6239dd12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:45.798032 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13846e9-a7e0-449d-aab2-2f2b6239dd12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:45.800332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13846e9-a7e0-449d-aab2-2f2b6239dd12 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:45.941337 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1309/2588] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:43:45 2022] POST /identity/v3/projects => generated 363 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:43:45.945400 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a7af4-0929-4453-ad6c-0a56557583ef None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:45.958637 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a7af4-0929-4453-ad6c-0a56557583ef None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:46.114761 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b4468-faad-45b1-a66c-32d18ca61d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:46.114761 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b4468-faad-45b1-a66c-32d18ca61d74 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:46.114761 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b4468-faad-45b1-a66c-32d18ca61d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:46.114761 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b4468-faad-45b1-a66c-32d18ca61d74 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:46.115336 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b4468-faad-45b1-a66c-32d18ca61d74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:46.115336 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b4468-faad-45b1-a66c-32d18ca61d74 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:46.301367 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1280/2589] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:43:45 2022] POST /identity/v3/users => generated 288 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:43:46.305679 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13846e9-a7e0-449d-aab2-2f2b6239dd12 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:46.321507 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13846e9-a7e0-449d-aab2-2f2b6239dd12 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:46.326633 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f3f36-1729-4272-94e9-31696f72ff11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:46.327436 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f3f36-1729-4272-94e9-31696f72ff11 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:46.327947 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f3f36-1729-4272-94e9-31696f72ff11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:46.328246 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f3f36-1729-4272-94e9-31696f72ff11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:46.328937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f3f36-1729-4272-94e9-31696f72ff11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:46.330622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f3f36-1729-4272-94e9-31696f72ff11 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:46.342825 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1310/2590] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:43:46.347203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b4468-faad-45b1-a66c-32d18ca61d74 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:46.358541 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b4468-faad-45b1-a66c-32d18ca61d74 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:46.363919 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158eb0e-856b-4e56-ba1c-7dd0756e37bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:46.365033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158eb0e-856b-4e56-ba1c-7dd0756e37bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:46.365272 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158eb0e-856b-4e56-ba1c-7dd0756e37bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:46.365574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158eb0e-856b-4e56-ba1c-7dd0756e37bc admin admin] PATH_INFO: `/v3/projects/71cf38f2706e423da35603a73307de0d/users/81e2f39ff4f5441998f80b3bada37b4c/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:46.384747 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158eb0e-856b-4e56-ba1c-7dd0756e37bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=71cf38f2706e423da35603a73307de0d, user_id=81e2f39ff4f5441998f80b3bada37b4c, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:46.387506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158eb0e-856b-4e56-ba1c-7dd0756e37bc admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:46.603857 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1281/2591] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:43:46 2022] PUT /identity/v3/projects/71cf38f2706e423da35603a73307de0d/users/81e2f39ff4f5441998f80b3bada37b4c/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:43:46.607857 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f3f36-1729-4272-94e9-31696f72ff11 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:46.618569 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f3f36-1729-4272-94e9-31696f72ff11 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:46.685826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90e178-c731-4fec-be08-83039e0872c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:46.686783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90e178-c731-4fec-be08-83039e0872c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:46.687076 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90e178-c731-4fec-be08-83039e0872c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:46.687357 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90e178-c731-4fec-be08-83039e0872c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:46.688092 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90e178-c731-4fec-be08-83039e0872c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:46.689739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90e178-c731-4fec-be08-83039e0872c6 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:46.703184 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1311/2592] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:43:46.707046 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158eb0e-856b-4e56-ba1c-7dd0756e37bc admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:46.718792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158eb0e-856b-4e56-ba1c-7dd0756e37bc admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:46.725618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775810f-2f1c-473f-84e9-d076c0e8351f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:46.726949 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775810f-2f1c-473f-84e9-d076c0e8351f admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:46.727482 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775810f-2f1c-473f-84e9-d076c0e8351f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:46.728019 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775810f-2f1c-473f-84e9-d076c0e8351f admin admin] PATH_INFO: `/v3/projects/71cf38f2706e423da35603a73307de0d/users/81e2f39ff4f5441998f80b3bada37b4c/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:46.732878 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775810f-2f1c-473f-84e9-d076c0e8351f admin admin] RBAC: Authorizing `identity:create_grant(project_id=71cf38f2706e423da35603a73307de0d, user_id=81e2f39ff4f5441998f80b3bada37b4c, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:46.735988 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1775810f-2f1c-473f-84e9-d076c0e8351f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:46.748077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1282/2593] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:43:46 2022] PUT /identity/v3/projects/71cf38f2706e423da35603a73307de0d/users/81e2f39ff4f5441998f80b3bada37b4c/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:43:46.758124 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372da906-f698-45a8-b864-95b294653b57 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:46.758420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372da906-f698-45a8-b864-95b294653b57 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:46.758706 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372da906-f698-45a8-b864-95b294653b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:46.786917 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-372da906-f698-45a8-b864-95b294653b57 None None] MFA Rules not processed for user `81e2f39ff4f5441998f80b3bada37b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:43:46.788175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-372da906-f698-45a8-b864-95b294653b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:46.855974 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:46.867138 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1312/2594] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:43:46 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:43:46.881559 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775810f-2f1c-473f-84e9-d076c0e8351f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:46.883315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1775810f-2f1c-473f-84e9-d076c0e8351f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:46.895346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:46.988757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775810f-2f1c-473f-84e9-d076c0e8351f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:46.995288 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c869bfe4-2f6e-46f7-a29f-6df5c9f5acfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:46.996625 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869bfe4-2f6e-46f7-a29f-6df5c9f5acfe service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:46.997013 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869bfe4-2f6e-46f7-a29f-6df5c9f5acfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:46.997923 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c869bfe4-2f6e-46f7-a29f-6df5c9f5acfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:47.009422 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869bfe4-2f6e-46f7-a29f-6df5c9f5acfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:47.010970 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c869bfe4-2f6e-46f7-a29f-6df5c9f5acfe service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:47.022765 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1283/2595] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:43:46 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:43:49.054861 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372da906-f698-45a8-b864-95b294653b57 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:49.120531 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372da906-f698-45a8-b864-95b294653b57 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:49.125008 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff75a0d-6ae7-474e-974c-11c8d587fa62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:49.125903 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff75a0d-6ae7-474e-974c-11c8d587fa62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:49.126246 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff75a0d-6ae7-474e-974c-11c8d587fa62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:49.126523 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff75a0d-6ae7-474e-974c-11c8d587fa62 admin admin] PATH_INFO: `/v3/users/27fb61510a5c47a8b584a7eab2d6e77b` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:49.127709 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff75a0d-6ae7-474e-974c-11c8d587fa62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27fb61510a5c47a8b584a7eab2d6e77b)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:49.129642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff75a0d-6ae7-474e-974c-11c8d587fa62 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:49.370409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bff75a0d-6ae7-474e-974c-11c8d587fa62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27fb61510a5c47a8b584a7eab2d6e77b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:49.371216 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bff75a0d-6ae7-474e-974c-11c8d587fa62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27fb61510a5c47a8b584a7eab2d6e77b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:49.372470 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bff75a0d-6ae7-474e-974c-11c8d587fa62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27fb61510a5c47a8b584a7eab2d6e77b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:49.391811 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bff75a0d-6ae7-474e-974c-11c8d587fa62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27fb61510a5c47a8b584a7eab2d6e77b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:49.399786 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-bff75a0d-6ae7-474e-974c-11c8d587fa62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27fb61510a5c47a8b584a7eab2d6e77b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:49.479907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1313/2596] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:43:49 2022] DELETE /identity/v3/users/27fb61510a5c47a8b584a7eab2d6e77b => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:43:49.485221 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67cf58-6482-4357-824c-bd71791d39f8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:49.485686 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67cf58-6482-4357-824c-bd71791d39f8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:49.490303 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67cf58-6482-4357-824c-bd71791d39f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:49.504783 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-cf67cf58-6482-4357-824c-bd71791d39f8 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:43:49.506362 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cf67cf58-6482-4357-824c-bd71791d39f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:49.577592 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1284/2597] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:43:49.584675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff75a0d-6ae7-474e-974c-11c8d587fa62 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:49.586287 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-bff75a0d-6ae7-474e-974c-11c8d587fa62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:49.654419 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff75a0d-6ae7-474e-974c-11c8d587fa62 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:49.659897 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25405b28-7313-455b-826d-3d3d2b4fcafe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:49.660827 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25405b28-7313-455b-826d-3d3d2b4fcafe service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:49.665683 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25405b28-7313-455b-826d-3d3d2b4fcafe service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:49.665683 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25405b28-7313-455b-826d-3d3d2b4fcafe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:49.672938 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25405b28-7313-455b-826d-3d3d2b4fcafe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:49.674484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25405b28-7313-455b-826d-3d3d2b4fcafe service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:49.685247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1314/2598] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:43:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:43:50.188337 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67cf58-6482-4357-824c-bd71791d39f8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:50.189815 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cf67cf58-6482-4357-824c-bd71791d39f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:50.201663 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67cf58-6482-4357-824c-bd71791d39f8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:50.206434 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287a98c-eaf9-4f30-96b5-549ed744dbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:50.207516 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287a98c-eaf9-4f30-96b5-549ed744dbbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:50.207712 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287a98c-eaf9-4f30-96b5-549ed744dbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:50.207890 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287a98c-eaf9-4f30-96b5-549ed744dbbb admin admin] PATH_INFO: `/v3/projects/66966e655d894851a34bd58ef4a7f80b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:50.209078 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287a98c-eaf9-4f30-96b5-549ed744dbbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=66966e655d894851a34bd58ef4a7f80b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:50.211036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287a98c-eaf9-4f30-96b5-549ed744dbbb admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:50.329783 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5287a98c-eaf9-4f30-96b5-549ed744dbbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66966e655d894851a34bd58ef4a7f80b', 'request_id': 'req-5287a98c-eaf9-4f30-96b5-549ed744dbbb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:50.335436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5287a98c-eaf9-4f30-96b5-549ed744dbbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66966e655d894851a34bd58ef4a7f80b', 'request_id': 'req-5287a98c-eaf9-4f30-96b5-549ed744dbbb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:50.342307 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5287a98c-eaf9-4f30-96b5-549ed744dbbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66966e655d894851a34bd58ef4a7f80b', 'request_id': 'req-5287a98c-eaf9-4f30-96b5-549ed744dbbb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:50.412940 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5287a98c-eaf9-4f30-96b5-549ed744dbbb admin admin] The token cache is being invalidate because project 66966e655d894851a34bd58ef4a7f80b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:43:50.413243 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5287a98c-eaf9-4f30-96b5-549ed744dbbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:50.413937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-5287a98c-eaf9-4f30-96b5-549ed744dbbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:50.415551 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1285/2599] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:43:50 2022] DELETE /identity/v3/projects/66966e655d894851a34bd58ef4a7f80b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:43:50.420541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25405b28-7313-455b-826d-3d3d2b4fcafe service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:50.433258 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25405b28-7313-455b-826d-3d3d2b4fcafe service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:50.449416 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:50.498803 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916294b2-667c-437c-abfa-72ab79977372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:50.500000 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916294b2-667c-437c-abfa-72ab79977372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:50.500284 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916294b2-667c-437c-abfa-72ab79977372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:50.500562 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916294b2-667c-437c-abfa-72ab79977372 admin admin] PATH_INFO: `/v3/users/81e2f39ff4f5441998f80b3bada37b4c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:50.501945 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916294b2-667c-437c-abfa-72ab79977372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81e2f39ff4f5441998f80b3bada37b4c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:50.503869 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916294b2-667c-437c-abfa-72ab79977372 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:50.703367 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-916294b2-667c-437c-abfa-72ab79977372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81e2f39ff4f5441998f80b3bada37b4c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:50.704173 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-916294b2-667c-437c-abfa-72ab79977372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81e2f39ff4f5441998f80b3bada37b4c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:50.704888 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-916294b2-667c-437c-abfa-72ab79977372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81e2f39ff4f5441998f80b3bada37b4c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:50.717744 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-916294b2-667c-437c-abfa-72ab79977372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81e2f39ff4f5441998f80b3bada37b4c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:50.724482 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-916294b2-667c-437c-abfa-72ab79977372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81e2f39ff4f5441998f80b3bada37b4c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:50.832384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1315/2600] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:43:50 2022] DELETE /identity/v3/users/81e2f39ff4f5441998f80b3bada37b4c => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:43:51.314335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287a98c-eaf9-4f30-96b5-549ed744dbbb admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:51.315821 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5287a98c-eaf9-4f30-96b5-549ed744dbbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:51.329644 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287a98c-eaf9-4f30-96b5-549ed744dbbb admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:51.361608 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:51.389649 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95457081-906a-4172-af9e-592f1d52d7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:51.390534 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95457081-906a-4172-af9e-592f1d52d7b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:51.390824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95457081-906a-4172-af9e-592f1d52d7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:51.391105 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95457081-906a-4172-af9e-592f1d52d7b0 admin admin] PATH_INFO: `/v3/projects/71cf38f2706e423da35603a73307de0d` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:51.392299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95457081-906a-4172-af9e-592f1d52d7b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71cf38f2706e423da35603a73307de0d)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:51.394311 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95457081-906a-4172-af9e-592f1d52d7b0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:51.534264 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-95457081-906a-4172-af9e-592f1d52d7b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71cf38f2706e423da35603a73307de0d', 'request_id': 'req-95457081-906a-4172-af9e-592f1d52d7b0'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:51.539631 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-95457081-906a-4172-af9e-592f1d52d7b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71cf38f2706e423da35603a73307de0d', 'request_id': 'req-95457081-906a-4172-af9e-592f1d52d7b0'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:51.546512 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-95457081-906a-4172-af9e-592f1d52d7b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71cf38f2706e423da35603a73307de0d', 'request_id': 'req-95457081-906a-4172-af9e-592f1d52d7b0'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:51.683924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-95457081-906a-4172-af9e-592f1d52d7b0 admin admin] The token cache is being invalidate because project 71cf38f2706e423da35603a73307de0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:43:51.684231 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-95457081-906a-4172-af9e-592f1d52d7b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:51.684884 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-95457081-906a-4172-af9e-592f1d52d7b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:51.687616 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1286/2601] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:43:51 2022] DELETE /identity/v3/projects/71cf38f2706e423da35603a73307de0d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:43:51.694071 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21810a03-1b2d-4358-ad43-50b301155cca None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:51.694584 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21810a03-1b2d-4358-ad43-50b301155cca None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:51.694682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21810a03-1b2d-4358-ad43-50b301155cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:51.712663 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-21810a03-1b2d-4358-ad43-50b301155cca None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:43:51.713923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-21810a03-1b2d-4358-ad43-50b301155cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:51.786092 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1316/2602] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:43:51.800216 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0371653-2d4b-487c-8e05-c11ebc76e062 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:51.800632 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0371653-2d4b-487c-8e05-c11ebc76e062 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:51.801078 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0371653-2d4b-487c-8e05-c11ebc76e062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:51.821108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c0371653-2d4b-487c-8e05-c11ebc76e062 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:43:51.822757 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c0371653-2d4b-487c-8e05-c11ebc76e062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:51.830335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1287/2603] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:43:51.840626 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21810a03-1b2d-4358-ad43-50b301155cca None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:51.850360 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21810a03-1b2d-4358-ad43-50b301155cca None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:51.854988 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e6b46-0e9e-4006-9762-0956a164b9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:51.856431 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e6b46-0e9e-4006-9762-0956a164b9fb admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:51.856718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e6b46-0e9e-4006-9762-0956a164b9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:51.856995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e6b46-0e9e-4006-9762-0956a164b9fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:51.857741 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e6b46-0e9e-4006-9762-0956a164b9fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:43:51.858057 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e6b46-0e9e-4006-9762-0956a164b9fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:51.859670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1e6b46-0e9e-4006-9762-0956a164b9fb admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:51.871934 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1317/2604] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:43:51.876535 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0371653-2d4b-487c-8e05-c11ebc76e062 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:51.885739 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0371653-2d4b-487c-8e05-c11ebc76e062 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:51.890638 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01a315-930b-4f94-bdc8-b9a74debf2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:51.891351 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01a315-930b-4f94-bdc8-b9a74debf2a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:51.891585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01a315-930b-4f94-bdc8-b9a74debf2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:51.891862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01a315-930b-4f94-bdc8-b9a74debf2a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:51.892546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01a315-930b-4f94-bdc8-b9a74debf2a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:51.894498 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa01a315-930b-4f94-bdc8-b9a74debf2a0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:52.091441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1288/2605] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:43:51 2022] POST /identity/v3/projects => generated 383 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:43:52.095725 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e6b46-0e9e-4006-9762-0956a164b9fb admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:52.106286 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e6b46-0e9e-4006-9762-0956a164b9fb admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:52.126659 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:52.166025 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33fa1b-4a91-4078-b8d6-533c532e50c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:52.166705 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33fa1b-4a91-4078-b8d6-533c532e50c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:52.166995 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33fa1b-4a91-4078-b8d6-533c532e50c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:52.167276 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33fa1b-4a91-4078-b8d6-533c532e50c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:52.168012 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33fa1b-4a91-4078-b8d6-533c532e50c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:52.170079 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33fa1b-4a91-4078-b8d6-533c532e50c9 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:52.254019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1318/2606] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:43:52 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:43:52.258714 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01a315-930b-4f94-bdc8-b9a74debf2a0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:52.269587 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa01a315-930b-4f94-bdc8-b9a74debf2a0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:52.274715 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397f929-b6ae-41f9-933c-66067b854f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:52.275386 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397f929-b6ae-41f9-933c-66067b854f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:52.275672 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397f929-b6ae-41f9-933c-66067b854f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:52.275953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397f929-b6ae-41f9-933c-66067b854f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:52.276734 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397f929-b6ae-41f9-933c-66067b854f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:52.279081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397f929-b6ae-41f9-933c-66067b854f1b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:52.290118 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1289/2607] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:43:52.294334 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33fa1b-4a91-4078-b8d6-533c532e50c9 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:52.304360 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33fa1b-4a91-4078-b8d6-533c532e50c9 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:52.308894 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4337229-d197-4341-a532-e955d2901868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:52.309553 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4337229-d197-4341-a532-e955d2901868 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:52.309893 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4337229-d197-4341-a532-e955d2901868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:52.310175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4337229-d197-4341-a532-e955d2901868 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:52.310932 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4337229-d197-4341-a532-e955d2901868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:52.312800 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4337229-d197-4341-a532-e955d2901868 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:52.323631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1319/2608] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:43:52.328669 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397f929-b6ae-41f9-933c-66067b854f1b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:52.340598 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397f929-b6ae-41f9-933c-66067b854f1b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:52.345316 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a598171-a68f-49f8-8cf9-f8a5a66f4a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:52.346213 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a598171-a68f-49f8-8cf9-f8a5a66f4a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:52.346504 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a598171-a68f-49f8-8cf9-f8a5a66f4a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:52.346791 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a598171-a68f-49f8-8cf9-f8a5a66f4a2b admin admin] PATH_INFO: `/v3/projects/0bcaf5a473cc450c8fcc9a550ff2d6eb/users/1eaca6c7f82445eeb725b507dbfbcc7a/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:52.361875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a598171-a68f-49f8-8cf9-f8a5a66f4a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bcaf5a473cc450c8fcc9a550ff2d6eb, user_id=1eaca6c7f82445eeb725b507dbfbcc7a, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:52.364612 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a598171-a68f-49f8-8cf9-f8a5a66f4a2b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:52.479813 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1290/2609] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:43:52 2022] PUT /identity/v3/projects/0bcaf5a473cc450c8fcc9a550ff2d6eb/users/1eaca6c7f82445eeb725b507dbfbcc7a/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:43:52.490425 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7691c98-f65a-41b2-8150-10caf045537f None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:52.490714 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7691c98-f65a-41b2-8150-10caf045537f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:52.490998 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7691c98-f65a-41b2-8150-10caf045537f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:52.523221 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-f7691c98-f65a-41b2-8150-10caf045537f None None] MFA Rules not processed for user `1eaca6c7f82445eeb725b507dbfbcc7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:43:52.524477 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f7691c98-f65a-41b2-8150-10caf045537f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:52.593389 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1320/2610] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:43:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:43:52.598094 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a598171-a68f-49f8-8cf9-f8a5a66f4a2b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:52.656238 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:52.659878 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a598171-a68f-49f8-8cf9-f8a5a66f4a2b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:52.665003 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87ca66-b37f-46f5-9640-5ccb7d83ae00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:52.665668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87ca66-b37f-46f5-9640-5ccb7d83ae00 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:52.669200 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87ca66-b37f-46f5-9640-5ccb7d83ae00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:52.669200 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe87ca66-b37f-46f5-9640-5ccb7d83ae00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:52.669200 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87ca66-b37f-46f5-9640-5ccb7d83ae00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:52.669200 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe87ca66-b37f-46f5-9640-5ccb7d83ae00 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:52.787804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1291/2611] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:43:52 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:43:52.791982 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7691c98-f65a-41b2-8150-10caf045537f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:52.802721 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7691c98-f65a-41b2-8150-10caf045537f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:52.862876 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed1161-1cb6-4ad3-9f24-9ea5b7466f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:52.863662 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed1161-1cb6-4ad3-9f24-9ea5b7466f17 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:52.864062 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed1161-1cb6-4ad3-9f24-9ea5b7466f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:52.864452 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed1161-1cb6-4ad3-9f24-9ea5b7466f17 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:52.865268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed1161-1cb6-4ad3-9f24-9ea5b7466f17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:52.867347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed1161-1cb6-4ad3-9f24-9ea5b7466f17 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:52.952636 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1321/2612] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:43:52 2022] POST /identity/v3/users => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:43:52.956722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87ca66-b37f-46f5-9640-5ccb7d83ae00 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:52.968097 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe87ca66-b37f-46f5-9640-5ccb7d83ae00 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:52.972921 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630dacd-7186-4809-9ec9-a91a9acc5bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:52.973668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630dacd-7186-4809-9ec9-a91a9acc5bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:52.973988 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630dacd-7186-4809-9ec9-a91a9acc5bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:52.978257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630dacd-7186-4809-9ec9-a91a9acc5bd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:52.978257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630dacd-7186-4809-9ec9-a91a9acc5bd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:52.978257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630dacd-7186-4809-9ec9-a91a9acc5bd8 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:52.988508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1292/2613] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:43:52.992913 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed1161-1cb6-4ad3-9f24-9ea5b7466f17 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:53.003953 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed1161-1cb6-4ad3-9f24-9ea5b7466f17 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:53.008616 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d681399-8ede-4d84-99a7-9ef5ec3265fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:53.009499 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d681399-8ede-4d84-99a7-9ef5ec3265fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:53.009825 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d681399-8ede-4d84-99a7-9ef5ec3265fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:53.010107 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d681399-8ede-4d84-99a7-9ef5ec3265fd admin admin] PATH_INFO: `/v3/projects/ca97cc3c6c394bd68e7997c6c64c424a/users/a62dd374ce8148f68929d0b4df487ddf/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:53.025002 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d681399-8ede-4d84-99a7-9ef5ec3265fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca97cc3c6c394bd68e7997c6c64c424a, user_id=a62dd374ce8148f68929d0b4df487ddf, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:53.027704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d681399-8ede-4d84-99a7-9ef5ec3265fd admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:53.101476 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:53.107661 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1322/2614] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:43:52 2022] PUT /identity/v3/projects/ca97cc3c6c394bd68e7997c6c64c424a/users/a62dd374ce8148f68929d0b4df487ddf/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:43:53.111649 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630dacd-7186-4809-9ec9-a91a9acc5bd8 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:53.122067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630dacd-7186-4809-9ec9-a91a9acc5bd8 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:53.176940 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69cb4e1-4c0c-44c5-8adc-b06387f50b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:53.177548 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cb4e1-4c0c-44c5-8adc-b06387f50b00 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:53.177861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cb4e1-4c0c-44c5-8adc-b06387f50b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:53.178142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69cb4e1-4c0c-44c5-8adc-b06387f50b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:53.178860 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69cb4e1-4c0c-44c5-8adc-b06387f50b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:53.180443 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69cb4e1-4c0c-44c5-8adc-b06387f50b00 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:53.190807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1293/2615] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:43:53.195039 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d681399-8ede-4d84-99a7-9ef5ec3265fd admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:53.205322 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d681399-8ede-4d84-99a7-9ef5ec3265fd admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:53.209948 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd92f0a-ea64-4cd8-a186-a12faaa45f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:53.210817 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd92f0a-ea64-4cd8-a186-a12faaa45f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:53.211097 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd92f0a-ea64-4cd8-a186-a12faaa45f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:53.211422 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd92f0a-ea64-4cd8-a186-a12faaa45f14 admin admin] PATH_INFO: `/v3/projects/ca97cc3c6c394bd68e7997c6c64c424a/users/a62dd374ce8148f68929d0b4df487ddf/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:53.213439 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd92f0a-ea64-4cd8-a186-a12faaa45f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca97cc3c6c394bd68e7997c6c64c424a, user_id=a62dd374ce8148f68929d0b4df487ddf, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:53.216136 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd92f0a-ea64-4cd8-a186-a12faaa45f14 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:53.226095 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1323/2616] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:43:53 2022] PUT /identity/v3/projects/ca97cc3c6c394bd68e7997c6c64c424a/users/a62dd374ce8148f68929d0b4df487ddf/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:43:53.238479 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c9844-e6d0-42d0-8811-c6a080f29c2f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:53.238777 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c9844-e6d0-42d0-8811-c6a080f29c2f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:53.239063 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c9844-e6d0-42d0-8811-c6a080f29c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:53.265295 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-529c9844-e6d0-42d0-8811-c6a080f29c2f None None] MFA Rules not processed for user `a62dd374ce8148f68929d0b4df487ddf`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:43:53.266539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-529c9844-e6d0-42d0-8811-c6a080f29c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:53.334698 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1294/2617] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:43:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:43:53.345631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd92f0a-ea64-4cd8-a186-a12faaa45f14 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:53.347349 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-cfd92f0a-ea64-4cd8-a186-a12faaa45f14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:53.404365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd92f0a-ea64-4cd8-a186-a12faaa45f14 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:53.407959 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66393408-579d-408f-bdd4-3913b2f9196b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:53.408596 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66393408-579d-408f-bdd4-3913b2f9196b service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:53.408882 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66393408-579d-408f-bdd4-3913b2f9196b service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:53.409164 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66393408-579d-408f-bdd4-3913b2f9196b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:53.418565 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66393408-579d-408f-bdd4-3913b2f9196b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:53.419996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66393408-579d-408f-bdd4-3913b2f9196b service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:53.429415 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1324/2618] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:43:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:43:53.526329 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c9844-e6d0-42d0-8811-c6a080f29c2f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:53.536189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c9844-e6d0-42d0-8811-c6a080f29c2f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:53.539786 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5285e-6b68-42e8-b6c3-aa78ad0a509a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:53.540427 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5285e-6b68-42e8-b6c3-aa78ad0a509a service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:53.540714 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5285e-6b68-42e8-b6c3-aa78ad0a509a service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:53.540993 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f5285e-6b68-42e8-b6c3-aa78ad0a509a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:53.588895 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:53.597497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5285e-6b68-42e8-b6c3-aa78ad0a509a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:53.598970 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f5285e-6b68-42e8-b6c3-aa78ad0a509a service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:53.608374 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1295/2619] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:43:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:43:54.046192 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b57c11-d1f8-47b6-bf8e-27f99167b226 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:54.046676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b57c11-d1f8-47b6-bf8e-27f99167b226 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:54.049399 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b57c11-d1f8-47b6-bf8e-27f99167b226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:54.067186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-79b57c11-d1f8-47b6-bf8e-27f99167b226 None None] MFA Rules not processed for user `01113a3f8cbf46b09fb5fcf4315a219b`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:43:54.068732 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-79b57c11-d1f8-47b6-bf8e-27f99167b226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:54.134430 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1325/2620] 10.222.0.64 () {58 vars in 967 bytes} [Mon Jul 18 02:43:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:43:54.152829 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5285e-6b68-42e8-b6c3-aa78ad0a509a service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:54.152829 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e8f5285e-6b68-42e8-b6c3-aa78ad0a509a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:54.221626 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f5285e-6b68-42e8-b6c3-aa78ad0a509a service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:54.226860 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1fef87-614e-4a8e-a71a-b30c937cb68a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a4e51f478874d99a7fc4ee2dea77caf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:54.227513 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fef87-614e-4a8e-a71a-b30c937cb68a service swift] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:54.227800 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fef87-614e-4a8e-a71a-b30c937cb68a service swift] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:54.228079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1fef87-614e-4a8e-a71a-b30c937cb68a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:54.236889 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fef87-614e-4a8e-a71a-b30c937cb68a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:54.238872 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1fef87-614e-4a8e-a71a-b30c937cb68a service swift] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:54.248138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1296/2621] 10.222.0.64 () {60 vars in 1384 bytes} [Mon Jul 18 02:43:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 02:43:56.850448 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b57c11-d1f8-47b6-bf8e-27f99167b226 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:56.916791 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b57c11-d1f8-47b6-bf8e-27f99167b226 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:56.924254 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540a45e-9d3f-4ecc-8449-60c3bd02f0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:56.924254 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540a45e-9d3f-4ecc-8449-60c3bd02f0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:56.924547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540a45e-9d3f-4ecc-8449-60c3bd02f0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:56.924759 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540a45e-9d3f-4ecc-8449-60c3bd02f0c1 admin admin] PATH_INFO: `/v3/users/1eaca6c7f82445eeb725b507dbfbcc7a` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:56.926037 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540a45e-9d3f-4ecc-8449-60c3bd02f0c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eaca6c7f82445eeb725b507dbfbcc7a)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:56.928580 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540a45e-9d3f-4ecc-8449-60c3bd02f0c1 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:57.099082 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:57.108655 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b540a45e-9d3f-4ecc-8449-60c3bd02f0c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eaca6c7f82445eeb725b507dbfbcc7a'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:57.109315 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b540a45e-9d3f-4ecc-8449-60c3bd02f0c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eaca6c7f82445eeb725b507dbfbcc7a'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:57.109977 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b540a45e-9d3f-4ecc-8449-60c3bd02f0c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eaca6c7f82445eeb725b507dbfbcc7a'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:57.122011 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b540a45e-9d3f-4ecc-8449-60c3bd02f0c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eaca6c7f82445eeb725b507dbfbcc7a'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:57.128729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-b540a45e-9d3f-4ecc-8449-60c3bd02f0c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eaca6c7f82445eeb725b507dbfbcc7a'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:57.209165 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1326/2622] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:43:56 2022] DELETE /identity/v3/users/1eaca6c7f82445eeb725b507dbfbcc7a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:43:57.213865 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51cfaf-f0b0-4b6a-b4e8-86039d878d0a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:57.214355 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51cfaf-f0b0-4b6a-b4e8-86039d878d0a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:57.214464 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51cfaf-f0b0-4b6a-b4e8-86039d878d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:57.231658 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-9b51cfaf-f0b0-4b6a-b4e8-86039d878d0a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:43:57.232860 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9b51cfaf-f0b0-4b6a-b4e8-86039d878d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:57.290208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1297/2623] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:43:57.299868 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540a45e-9d3f-4ecc-8449-60c3bd02f0c1 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:57.301283 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-b540a45e-9d3f-4ecc-8449-60c3bd02f0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:57.358443 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540a45e-9d3f-4ecc-8449-60c3bd02f0c1 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:57.362003 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f7b0c-2ef8-42dd-8c7c-3a60eaf930c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:57.362652 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f7b0c-2ef8-42dd-8c7c-3a60eaf930c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:57.362940 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f7b0c-2ef8-42dd-8c7c-3a60eaf930c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:57.363224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5f7b0c-2ef8-42dd-8c7c-3a60eaf930c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:57.372714 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f7b0c-2ef8-42dd-8c7c-3a60eaf930c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:57.374192 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5f7b0c-2ef8-42dd-8c7c-3a60eaf930c2 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:57.383496 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1327/2624] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:43:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:43:57.800537 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51cfaf-f0b0-4b6a-b4e8-86039d878d0a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:57.802211 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9b51cfaf-f0b0-4b6a-b4e8-86039d878d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:57.815233 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51cfaf-f0b0-4b6a-b4e8-86039d878d0a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:57.820435 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16eaf1c-292f-4ce8-bb09-432ce79d4a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:57.821316 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16eaf1c-292f-4ce8-bb09-432ce79d4a03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:57.821599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16eaf1c-292f-4ce8-bb09-432ce79d4a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:57.821902 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16eaf1c-292f-4ce8-bb09-432ce79d4a03 admin admin] PATH_INFO: `/v3/projects/0bcaf5a473cc450c8fcc9a550ff2d6eb` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:57.823246 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16eaf1c-292f-4ce8-bb09-432ce79d4a03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bcaf5a473cc450c8fcc9a550ff2d6eb)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:57.825152 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16eaf1c-292f-4ce8-bb09-432ce79d4a03 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:57.993982 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a16eaf1c-292f-4ce8-bb09-432ce79d4a03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bcaf5a473cc450c8fcc9a550ff2d6eb', 'request_id': 'req-a16eaf1c-292f-4ce8-bb09-432ce79d4a03'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:58.000065 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a16eaf1c-292f-4ce8-bb09-432ce79d4a03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bcaf5a473cc450c8fcc9a550ff2d6eb', 'request_id': 'req-a16eaf1c-292f-4ce8-bb09-432ce79d4a03'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:58.007003 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a16eaf1c-292f-4ce8-bb09-432ce79d4a03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bcaf5a473cc450c8fcc9a550ff2d6eb', 'request_id': 'req-a16eaf1c-292f-4ce8-bb09-432ce79d4a03'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:58.082843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a16eaf1c-292f-4ce8-bb09-432ce79d4a03 admin admin] The token cache is being invalidate because project 0bcaf5a473cc450c8fcc9a550ff2d6eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:43:58.083262 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a16eaf1c-292f-4ce8-bb09-432ce79d4a03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:58.083975 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-a16eaf1c-292f-4ce8-bb09-432ce79d4a03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:58.085583 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1298/2625] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:43:57 2022] DELETE /identity/v3/projects/0bcaf5a473cc450c8fcc9a550ff2d6eb => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:43:58.090266 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f7b0c-2ef8-42dd-8c7c-3a60eaf930c2 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:58.099923 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5f7b0c-2ef8-42dd-8c7c-3a60eaf930c2 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:58.157886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d0dc6-1977-4983-989a-1b7c239028ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:58.158804 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d0dc6-1977-4983-989a-1b7c239028ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:58.159088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d0dc6-1977-4983-989a-1b7c239028ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:58.159368 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d0dc6-1977-4983-989a-1b7c239028ae admin admin] PATH_INFO: `/v3/users/a62dd374ce8148f68929d0b4df487ddf` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:58.160545 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d0dc6-1977-4983-989a-1b7c239028ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=a62dd374ce8148f68929d0b4df487ddf)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:58.162496 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d0dc6-1977-4983-989a-1b7c239028ae admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:58.325858 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-768d0dc6-1977-4983-989a-1b7c239028ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a62dd374ce8148f68929d0b4df487ddf'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:58.326445 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-768d0dc6-1977-4983-989a-1b7c239028ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a62dd374ce8148f68929d0b4df487ddf'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:58.327044 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-768d0dc6-1977-4983-989a-1b7c239028ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a62dd374ce8148f68929d0b4df487ddf'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:58.334935 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:58.344962 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-768d0dc6-1977-4983-989a-1b7c239028ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a62dd374ce8148f68929d0b4df487ddf'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:58.353983 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-768d0dc6-1977-4983-989a-1b7c239028ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a62dd374ce8148f68929d0b4df487ddf'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:58.459340 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1328/2626] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:43:58 2022] DELETE /identity/v3/users/a62dd374ce8148f68929d0b4df487ddf => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:43:58.896663 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16eaf1c-292f-4ce8-bb09-432ce79d4a03 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:58.898204 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a16eaf1c-292f-4ce8-bb09-432ce79d4a03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:58.908315 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:58.912372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16eaf1c-292f-4ce8-bb09-432ce79d4a03 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:58.969623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203a013f-9920-4ff2-8762-8ccf5a97cb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:58.970552 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a013f-9920-4ff2-8762-8ccf5a97cb5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:58.970836 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a013f-9920-4ff2-8762-8ccf5a97cb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:58.971115 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203a013f-9920-4ff2-8762-8ccf5a97cb5e admin admin] PATH_INFO: `/v3/projects/ca97cc3c6c394bd68e7997c6c64c424a` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:58.972280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a013f-9920-4ff2-8762-8ccf5a97cb5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca97cc3c6c394bd68e7997c6c64c424a)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:58.974379 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203a013f-9920-4ff2-8762-8ccf5a97cb5e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:59.072261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-203a013f-9920-4ff2-8762-8ccf5a97cb5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca97cc3c6c394bd68e7997c6c64c424a', 'request_id': 'req-203a013f-9920-4ff2-8762-8ccf5a97cb5e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:59.078660 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-203a013f-9920-4ff2-8762-8ccf5a97cb5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca97cc3c6c394bd68e7997c6c64c424a', 'request_id': 'req-203a013f-9920-4ff2-8762-8ccf5a97cb5e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:59.085064 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-203a013f-9920-4ff2-8762-8ccf5a97cb5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca97cc3c6c394bd68e7997c6c64c424a', 'request_id': 'req-203a013f-9920-4ff2-8762-8ccf5a97cb5e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:59.158136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-203a013f-9920-4ff2-8762-8ccf5a97cb5e admin admin] The token cache is being invalidate because project ca97cc3c6c394bd68e7997c6c64c424a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:43:59.158452 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-203a013f-9920-4ff2-8762-8ccf5a97cb5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:59.159080 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-203a013f-9920-4ff2-8762-8ccf5a97cb5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:43:59.160633 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1299/2627] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:43:58 2022] DELETE /identity/v3/projects/ca97cc3c6c394bd68e7997c6c64c424a => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:43:59.166234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01d7ea-e224-424b-9570-2196088e4fb7 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:59.166712 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01d7ea-e224-424b-9570-2196088e4fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:59.166810 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01d7ea-e224-424b-9570-2196088e4fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:59.186385 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-1d01d7ea-e224-424b-9570-2196088e4fb7 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:43:59.187892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1d01d7ea-e224-424b-9570-2196088e4fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:59.245664 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1329/2628] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:43:59.255046 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5ce72-7222-4a21-a9ce-59241b60b715 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:59.255336 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5ce72-7222-4a21-a9ce-59241b60b715 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:59.255619 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a5ce72-7222-4a21-a9ce-59241b60b715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:59.274347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-74a5ce72-7222-4a21-a9ce-59241b60b715 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:43:59.275552 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-74a5ce72-7222-4a21-a9ce-59241b60b715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:59.283560 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1300/2629] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:43:59.287599 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01d7ea-e224-424b-9570-2196088e4fb7 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:59.297213 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01d7ea-e224-424b-9570-2196088e4fb7 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:59.301872 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba6e14-85c6-428e-8ce8-7d678887cab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:59.302523 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba6e14-85c6-428e-8ce8-7d678887cab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:59.302811 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba6e14-85c6-428e-8ce8-7d678887cab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:59.303089 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ba6e14-85c6-428e-8ce8-7d678887cab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:59.303858 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba6e14-85c6-428e-8ce8-7d678887cab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:43:59.304166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba6e14-85c6-428e-8ce8-7d678887cab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:59.305769 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ba6e14-85c6-428e-8ce8-7d678887cab0 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:59.317832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1330/2630] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:43:59.322008 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5ce72-7222-4a21-a9ce-59241b60b715 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:59.332181 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a5ce72-7222-4a21-a9ce-59241b60b715 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:59.336985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630993a-90b9-4761-a521-38eaa2add6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:59.337665 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630993a-90b9-4761-a521-38eaa2add6f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:59.337982 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630993a-90b9-4761-a521-38eaa2add6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:59.338260 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630993a-90b9-4761-a521-38eaa2add6f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:59.338942 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630993a-90b9-4761-a521-38eaa2add6f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:59.340840 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630993a-90b9-4761-a521-38eaa2add6f0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:59.421398 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1301/2631] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:43:59 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:43:59.425483 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba6e14-85c6-428e-8ce8-7d678887cab0 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:59.436003 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ba6e14-85c6-428e-8ce8-7d678887cab0 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:59.492129 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95875273-0099-4e62-8ae3-73b56fdc9427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:59.492801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95875273-0099-4e62-8ae3-73b56fdc9427 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:59.493117 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95875273-0099-4e62-8ae3-73b56fdc9427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:59.493400 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95875273-0099-4e62-8ae3-73b56fdc9427 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:59.494118 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95875273-0099-4e62-8ae3-73b56fdc9427 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:59.496552 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95875273-0099-4e62-8ae3-73b56fdc9427 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:59.591957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1331/2632] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:43:59 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:43:59.596136 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630993a-90b9-4761-a521-38eaa2add6f0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:59.607211 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630993a-90b9-4761-a521-38eaa2add6f0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:59.611845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da131c-d006-442f-98ba-380880e9e1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:59.612508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da131c-d006-442f-98ba-380880e9e1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:59.612798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da131c-d006-442f-98ba-380880e9e1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:59.613113 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da131c-d006-442f-98ba-380880e9e1a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:59.613910 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da131c-d006-442f-98ba-380880e9e1a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:59.615520 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da131c-d006-442f-98ba-380880e9e1a1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:59.626803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1302/2633] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:43:59.630880 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95875273-0099-4e62-8ae3-73b56fdc9427 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:59.640980 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95875273-0099-4e62-8ae3-73b56fdc9427 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:59.645611 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221177b-8379-4247-b249-b6b5c64c797c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:59.646316 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221177b-8379-4247-b249-b6b5c64c797c admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:59.646602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221177b-8379-4247-b249-b6b5c64c797c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:59.647049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221177b-8379-4247-b249-b6b5c64c797c admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:59.647774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221177b-8379-4247-b249-b6b5c64c797c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:59.649376 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221177b-8379-4247-b249-b6b5c64c797c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:59.659325 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1332/2634] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:43:59.663530 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da131c-d006-442f-98ba-380880e9e1a1 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:59.674198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da131c-d006-442f-98ba-380880e9e1a1 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:59.678824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5f9b0-2617-46f5-8a1e-b4bb891d8a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:59.679736 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5f9b0-2617-46f5-8a1e-b4bb891d8a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:59.680021 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5f9b0-2617-46f5-8a1e-b4bb891d8a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:59.680299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5f9b0-2617-46f5-8a1e-b4bb891d8a6b admin admin] PATH_INFO: `/v3/projects/8ff43ae712904300803fccbca0f3c5af/users/dd851a4357ac4fe985a18899b6c7516b/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:59.695083 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5f9b0-2617-46f5-8a1e-b4bb891d8a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ff43ae712904300803fccbca0f3c5af, user_id=dd851a4357ac4fe985a18899b6c7516b, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:59.697745 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5f9b0-2617-46f5-8a1e-b4bb891d8a6b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:59.792674 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1303/2635] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:43:59 2022] PUT /identity/v3/projects/8ff43ae712904300803fccbca0f3c5af/users/dd851a4357ac4fe985a18899b6c7516b/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:43:59.803110 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f71ec9-4271-4781-8cd6-71b121792747 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:59.803406 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f71ec9-4271-4781-8cd6-71b121792747 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:59.803763 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f71ec9-4271-4781-8cd6-71b121792747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:59.838514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a9f71ec9-4271-4781-8cd6-71b121792747 None None] MFA Rules not processed for user `dd851a4357ac4fe985a18899b6c7516b`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:43:59.841885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a9f71ec9-4271-4781-8cd6-71b121792747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:59.868468 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:59.902676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1333/2636] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:43:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:43:59.913745 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5f9b0-2617-46f5-8a1e-b4bb891d8a6b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:43:59.915547 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7ee5f9b0-2617-46f5-8a1e-b4bb891d8a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:43:59.950816 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:43:59.973548 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5f9b0-2617-46f5-8a1e-b4bb891d8a6b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:43:59.977300 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268c7be-9f1f-42e7-8037-645f9ed2098b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8948dc6a55344eaa85e2a6092215ec6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:43:59.978027 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268c7be-9f1f-42e7-8037-645f9ed2098b service glance] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:43:59.978316 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268c7be-9f1f-42e7-8037-645f9ed2098b service glance] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:43:59.978595 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268c7be-9f1f-42e7-8037-645f9ed2098b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:43:59.987081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268c7be-9f1f-42e7-8037-645f9ed2098b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:43:59.993815 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9268c7be-9f1f-42e7-8037-645f9ed2098b service glance] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:43:59.998009 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1304/2637] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:43:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:44:10.168883 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=14 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:10.203034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=12 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:17.138912 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f71ec9-4271-4781-8cd6-71b121792747 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:17.200811 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f71ec9-4271-4781-8cd6-71b121792747 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:17.205373 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115905c-8db2-4ced-b737-6ab2c386c29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:17.206279 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115905c-8db2-4ced-b737-6ab2c386c29d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:17.206571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115905c-8db2-4ced-b737-6ab2c386c29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:17.206846 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115905c-8db2-4ced-b737-6ab2c386c29d admin admin] PATH_INFO: `/v3/users/dd851a4357ac4fe985a18899b6c7516b` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:17.208037 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115905c-8db2-4ced-b737-6ab2c386c29d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd851a4357ac4fe985a18899b6c7516b)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:17.209958 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115905c-8db2-4ced-b737-6ab2c386c29d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:17.393567 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3115905c-8db2-4ced-b737-6ab2c386c29d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd851a4357ac4fe985a18899b6c7516b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:17.394180 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3115905c-8db2-4ced-b737-6ab2c386c29d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd851a4357ac4fe985a18899b6c7516b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:17.394792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3115905c-8db2-4ced-b737-6ab2c386c29d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd851a4357ac4fe985a18899b6c7516b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:17.407276 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3115905c-8db2-4ced-b737-6ab2c386c29d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd851a4357ac4fe985a18899b6c7516b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:17.414058 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-3115905c-8db2-4ced-b737-6ab2c386c29d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd851a4357ac4fe985a18899b6c7516b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:17.512316 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1334/2638] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:44:17 2022] DELETE /identity/v3/users/dd851a4357ac4fe985a18899b6c7516b => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:44:17.516873 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd037d4-888c-4ec8-a737-41571aa32757 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:17.517400 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd037d4-888c-4ec8-a737-41571aa32757 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:17.517503 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd037d4-888c-4ec8-a737-41571aa32757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:17.535366 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8dd037d4-888c-4ec8-a737-41571aa32757 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:44:17.536564 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8dd037d4-888c-4ec8-a737-41571aa32757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:17.595532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1305/2639] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:44:17.605226 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115905c-8db2-4ced-b737-6ab2c386c29d admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:17.607195 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-3115905c-8db2-4ced-b737-6ab2c386c29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:17.665312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115905c-8db2-4ced-b737-6ab2c386c29d admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:17.669461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bffa0d-1ae2-4ca7-8bdc-e9302f3423e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:17.670137 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bffa0d-1ae2-4ca7-8bdc-e9302f3423e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:17.670424 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bffa0d-1ae2-4ca7-8bdc-e9302f3423e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:17.670702 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bffa0d-1ae2-4ca7-8bdc-e9302f3423e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:17.679687 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bffa0d-1ae2-4ca7-8bdc-e9302f3423e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:17.681106 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bffa0d-1ae2-4ca7-8bdc-e9302f3423e4 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:17.691431 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1335/2640] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:44:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:44:18.121124 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd037d4-888c-4ec8-a737-41571aa32757 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:18.122977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8dd037d4-888c-4ec8-a737-41571aa32757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:18.135467 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd037d4-888c-4ec8-a737-41571aa32757 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:18.150178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce885f0-34ac-4010-b13e-c3e74fa293d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:18.150977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce885f0-34ac-4010-b13e-c3e74fa293d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:18.151270 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce885f0-34ac-4010-b13e-c3e74fa293d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:18.151555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce885f0-34ac-4010-b13e-c3e74fa293d9 admin admin] PATH_INFO: `/v3/projects/8ff43ae712904300803fccbca0f3c5af` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:18.152761 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce885f0-34ac-4010-b13e-c3e74fa293d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ff43ae712904300803fccbca0f3c5af)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:18.155382 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce885f0-34ac-4010-b13e-c3e74fa293d9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:18.301798 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-bce885f0-34ac-4010-b13e-c3e74fa293d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ff43ae712904300803fccbca0f3c5af', 'request_id': 'req-bce885f0-34ac-4010-b13e-c3e74fa293d9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:18.307534 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-bce885f0-34ac-4010-b13e-c3e74fa293d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ff43ae712904300803fccbca0f3c5af', 'request_id': 'req-bce885f0-34ac-4010-b13e-c3e74fa293d9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:18.314175 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-bce885f0-34ac-4010-b13e-c3e74fa293d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ff43ae712904300803fccbca0f3c5af', 'request_id': 'req-bce885f0-34ac-4010-b13e-c3e74fa293d9'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:18.414478 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-bce885f0-34ac-4010-b13e-c3e74fa293d9 admin admin] The token cache is being invalidate because project 8ff43ae712904300803fccbca0f3c5af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:44:18.414692 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-bce885f0-34ac-4010-b13e-c3e74fa293d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:18.415310 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-bce885f0-34ac-4010-b13e-c3e74fa293d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:18.416902 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1306/2641] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:44:18 2022] DELETE /identity/v3/projects/8ff43ae712904300803fccbca0f3c5af => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:44:18.421759 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69842b23-c77a-48de-9403-67f3381279da None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:18.422237 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69842b23-c77a-48de-9403-67f3381279da None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:18.422351 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69842b23-c77a-48de-9403-67f3381279da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:18.439731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-69842b23-c77a-48de-9403-67f3381279da None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:44:18.440933 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-69842b23-c77a-48de-9403-67f3381279da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:18.457595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:18.499398 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1336/2642] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:44:18.508178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921b05b-78a5-4ce3-8b6d-0d6c1d202d09 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:18.508470 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921b05b-78a5-4ce3-8b6d-0d6c1d202d09 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:18.508762 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921b05b-78a5-4ce3-8b6d-0d6c1d202d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:18.527441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5921b05b-78a5-4ce3-8b6d-0d6c1d202d09 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:44:18.529470 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5921b05b-78a5-4ce3-8b6d-0d6c1d202d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:18.537574 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1307/2643] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:44:18.541797 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69842b23-c77a-48de-9403-67f3381279da None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:18.551265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69842b23-c77a-48de-9403-67f3381279da None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:18.555835 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de1437-a883-49a1-a89c-592e935c6fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:18.556485 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de1437-a883-49a1-a89c-592e935c6fbc admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:18.556769 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de1437-a883-49a1-a89c-592e935c6fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:18.557047 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09de1437-a883-49a1-a89c-592e935c6fbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:18.557793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de1437-a883-49a1-a89c-592e935c6fbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:44:18.558101 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de1437-a883-49a1-a89c-592e935c6fbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:18.559691 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09de1437-a883-49a1-a89c-592e935c6fbc admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:18.571116 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1337/2644] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:44:18.575856 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921b05b-78a5-4ce3-8b6d-0d6c1d202d09 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:18.585182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921b05b-78a5-4ce3-8b6d-0d6c1d202d09 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:18.590159 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d72f4-4304-4044-bbd7-308b680a4078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:18.591439 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d72f4-4304-4044-bbd7-308b680a4078 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:18.591755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d72f4-4304-4044-bbd7-308b680a4078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:18.592040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d72f4-4304-4044-bbd7-308b680a4078 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:18.592763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d72f4-4304-4044-bbd7-308b680a4078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:18.594716 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d72f4-4304-4044-bbd7-308b680a4078 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:18.690900 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1308/2645] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:44:18 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:44:18.695179 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de1437-a883-49a1-a89c-592e935c6fbc admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:18.705762 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09de1437-a883-49a1-a89c-592e935c6fbc admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:18.763434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a39c22-8cc1-4417-b21b-987935ec3d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:18.764129 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a39c22-8cc1-4417-b21b-987935ec3d08 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:18.764395 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a39c22-8cc1-4417-b21b-987935ec3d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:18.764676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a39c22-8cc1-4417-b21b-987935ec3d08 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:18.765369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a39c22-8cc1-4417-b21b-987935ec3d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:18.767327 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a39c22-8cc1-4417-b21b-987935ec3d08 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:18.987311 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1338/2646] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:44:18 2022] POST /identity/v3/users => generated 289 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:44:19.002213 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d72f4-4304-4044-bbd7-308b680a4078 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:19.013284 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d72f4-4304-4044-bbd7-308b680a4078 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:19.017891 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddc5f1-c7cd-4aad-bcdd-e4a05500c3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:19.018585 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddc5f1-c7cd-4aad-bcdd-e4a05500c3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:19.018875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddc5f1-c7cd-4aad-bcdd-e4a05500c3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:19.019156 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ddc5f1-c7cd-4aad-bcdd-e4a05500c3a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:19.019876 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ddc5f1-c7cd-4aad-bcdd-e4a05500c3a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:19.021470 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ddc5f1-c7cd-4aad-bcdd-e4a05500c3a9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:19.032541 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1309/2647] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:44:19.051567 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a39c22-8cc1-4417-b21b-987935ec3d08 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:19.062367 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a39c22-8cc1-4417-b21b-987935ec3d08 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:19.067217 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd3b2d-bc29-42d1-aa65-65c230cc0bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:19.067865 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd3b2d-bc29-42d1-aa65-65c230cc0bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:19.068147 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd3b2d-bc29-42d1-aa65-65c230cc0bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:19.068455 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd3b2d-bc29-42d1-aa65-65c230cc0bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:19.069170 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd3b2d-bc29-42d1-aa65-65c230cc0bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:19.070784 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd3b2d-bc29-42d1-aa65-65c230cc0bd9 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:19.081244 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1339/2648] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:44:19.085207 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddc5f1-c7cd-4aad-bcdd-e4a05500c3a9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:19.095518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ddc5f1-c7cd-4aad-bcdd-e4a05500c3a9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:19.100151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c25000-1fa6-4b1e-9d1e-b1abf8d0a1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:19.101064 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c25000-1fa6-4b1e-9d1e-b1abf8d0a1e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:19.101351 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c25000-1fa6-4b1e-9d1e-b1abf8d0a1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:19.101627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c25000-1fa6-4b1e-9d1e-b1abf8d0a1e3 admin admin] PATH_INFO: `/v3/projects/3f75b7e368e440d29fec6fb02bf79c05/users/9db11c75db4846d6b08f1deb50ddb0a7/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:19.117942 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c25000-1fa6-4b1e-9d1e-b1abf8d0a1e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f75b7e368e440d29fec6fb02bf79c05, user_id=9db11c75db4846d6b08f1deb50ddb0a7, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:19.120687 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c25000-1fa6-4b1e-9d1e-b1abf8d0a1e3 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:19.210117 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1310/2649] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:44:19 2022] PUT /identity/v3/projects/3f75b7e368e440d29fec6fb02bf79c05/users/9db11c75db4846d6b08f1deb50ddb0a7/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:44:19.220168 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041132c-0a06-41d2-a86b-6548cf29e385 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:19.220459 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041132c-0a06-41d2-a86b-6548cf29e385 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:19.220743 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041132c-0a06-41d2-a86b-6548cf29e385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:19.247897 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9041132c-0a06-41d2-a86b-6548cf29e385 None None] MFA Rules not processed for user `9db11c75db4846d6b08f1deb50ddb0a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:44:19.249055 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9041132c-0a06-41d2-a86b-6548cf29e385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:19.312141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1340/2650] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:44:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:44:19.323537 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c25000-1fa6-4b1e-9d1e-b1abf8d0a1e3 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:19.325292 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-16c25000-1fa6-4b1e-9d1e-b1abf8d0a1e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:19.347085 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:19.382525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c25000-1fa6-4b1e-9d1e-b1abf8d0a1e3 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:19.386205 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e243fab4-175e-48d5-bd7d-648d2cde2de2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:19.386845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243fab4-175e-48d5-bd7d-648d2cde2de2 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:19.387129 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243fab4-175e-48d5-bd7d-648d2cde2de2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:19.387405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e243fab4-175e-48d5-bd7d-648d2cde2de2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:19.395605 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243fab4-175e-48d5-bd7d-648d2cde2de2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:19.397024 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e243fab4-175e-48d5-bd7d-648d2cde2de2 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:19.405837 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1311/2651] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:44:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:44:29.308561 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:29.444142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=17 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:35.484045 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041132c-0a06-41d2-a86b-6548cf29e385 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:35.549539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041132c-0a06-41d2-a86b-6548cf29e385 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:35.554291 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb6f3d-d5f8-4e77-a6ad-356502b54c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:35.555175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb6f3d-d5f8-4e77-a6ad-356502b54c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:35.555462 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb6f3d-d5f8-4e77-a6ad-356502b54c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:35.555744 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb6f3d-d5f8-4e77-a6ad-356502b54c3a admin admin] PATH_INFO: `/v3/users/9db11c75db4846d6b08f1deb50ddb0a7` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:35.556976 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb6f3d-d5f8-4e77-a6ad-356502b54c3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9db11c75db4846d6b08f1deb50ddb0a7)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:35.558936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb6f3d-d5f8-4e77-a6ad-356502b54c3a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:35.761217 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f7fb6f3d-d5f8-4e77-a6ad-356502b54c3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9db11c75db4846d6b08f1deb50ddb0a7'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:35.761907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f7fb6f3d-d5f8-4e77-a6ad-356502b54c3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9db11c75db4846d6b08f1deb50ddb0a7'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:35.762524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f7fb6f3d-d5f8-4e77-a6ad-356502b54c3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9db11c75db4846d6b08f1deb50ddb0a7'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:35.774235 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f7fb6f3d-d5f8-4e77-a6ad-356502b54c3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9db11c75db4846d6b08f1deb50ddb0a7'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:35.780972 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-f7fb6f3d-d5f8-4e77-a6ad-356502b54c3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9db11c75db4846d6b08f1deb50ddb0a7'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:35.849957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1341/2652] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:44:35 2022] DELETE /identity/v3/users/9db11c75db4846d6b08f1deb50ddb0a7 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:44:35.854803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2264e73-95db-4da5-b6d1-4638acb07351 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:35.855261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2264e73-95db-4da5-b6d1-4638acb07351 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:35.855402 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2264e73-95db-4da5-b6d1-4638acb07351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:35.872421 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b2264e73-95db-4da5-b6d1-4638acb07351 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:44:35.873615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b2264e73-95db-4da5-b6d1-4638acb07351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:35.944696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1312/2653] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:44:35.963218 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb6f3d-d5f8-4e77-a6ad-356502b54c3a admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:35.964681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-f7fb6f3d-d5f8-4e77-a6ad-356502b54c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:36.023840 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb6f3d-d5f8-4e77-a6ad-356502b54c3a admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:36.027489 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa35653-5bab-45a9-897b-9d211256314e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:36.028134 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa35653-5bab-45a9-897b-9d211256314e service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:36.028420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa35653-5bab-45a9-897b-9d211256314e service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:36.028699 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa35653-5bab-45a9-897b-9d211256314e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:36.037606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa35653-5bab-45a9-897b-9d211256314e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:36.039070 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa35653-5bab-45a9-897b-9d211256314e service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:36.048783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1342/2654] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:44:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:44:36.440111 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2264e73-95db-4da5-b6d1-4638acb07351 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:36.441548 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b2264e73-95db-4da5-b6d1-4638acb07351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:36.454519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2264e73-95db-4da5-b6d1-4638acb07351 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:36.459307 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c5548-4fce-4ec5-ad04-fa60b481cec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:36.460233 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c5548-4fce-4ec5-ad04-fa60b481cec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:36.460463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c5548-4fce-4ec5-ad04-fa60b481cec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:36.460740 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c5548-4fce-4ec5-ad04-fa60b481cec2 admin admin] PATH_INFO: `/v3/projects/3f75b7e368e440d29fec6fb02bf79c05` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:36.461973 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c5548-4fce-4ec5-ad04-fa60b481cec2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f75b7e368e440d29fec6fb02bf79c05)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:36.463890 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31c5548-4fce-4ec5-ad04-fa60b481cec2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:36.575291 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b31c5548-4fce-4ec5-ad04-fa60b481cec2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f75b7e368e440d29fec6fb02bf79c05', 'request_id': 'req-b31c5548-4fce-4ec5-ad04-fa60b481cec2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:36.580802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b31c5548-4fce-4ec5-ad04-fa60b481cec2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f75b7e368e440d29fec6fb02bf79c05', 'request_id': 'req-b31c5548-4fce-4ec5-ad04-fa60b481cec2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:36.587037 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b31c5548-4fce-4ec5-ad04-fa60b481cec2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f75b7e368e440d29fec6fb02bf79c05', 'request_id': 'req-b31c5548-4fce-4ec5-ad04-fa60b481cec2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:36.700416 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b31c5548-4fce-4ec5-ad04-fa60b481cec2 admin admin] The token cache is being invalidate because project 3f75b7e368e440d29fec6fb02bf79c05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:44:36.700705 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b31c5548-4fce-4ec5-ad04-fa60b481cec2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:36.701332 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-b31c5548-4fce-4ec5-ad04-fa60b481cec2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:36.702906 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1313/2655] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:44:36 2022] DELETE /identity/v3/projects/3f75b7e368e440d29fec6fb02bf79c05 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:44:36.708073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d049d-2d6d-4f97-b0a8-55494d53879e None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:36.708547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d049d-2d6d-4f97-b0a8-55494d53879e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:36.708732 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d049d-2d6d-4f97-b0a8-55494d53879e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:36.727091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-ea5d049d-2d6d-4f97-b0a8-55494d53879e None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:44:36.728351 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ea5d049d-2d6d-4f97-b0a8-55494d53879e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:36.746621 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:36.790363 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1343/2656] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:44:36.798520 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa827cae-d29a-4b6e-8b8a-c9195c5e2eb9 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:36.798815 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa827cae-d29a-4b6e-8b8a-c9195c5e2eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:36.799128 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa827cae-d29a-4b6e-8b8a-c9195c5e2eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:36.819674 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-aa827cae-d29a-4b6e-8b8a-c9195c5e2eb9 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:44:36.820880 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-aa827cae-d29a-4b6e-8b8a-c9195c5e2eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:36.829749 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1314/2657] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:44:36.834023 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d049d-2d6d-4f97-b0a8-55494d53879e None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:36.844249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d049d-2d6d-4f97-b0a8-55494d53879e None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:36.848973 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f968771-563f-46a9-9061-605f0ddb098b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:36.850203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f968771-563f-46a9-9061-605f0ddb098b admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:36.850496 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f968771-563f-46a9-9061-605f0ddb098b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:36.850778 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f968771-563f-46a9-9061-605f0ddb098b admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:36.851515 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f968771-563f-46a9-9061-605f0ddb098b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:44:36.851821 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f968771-563f-46a9-9061-605f0ddb098b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:36.853428 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f968771-563f-46a9-9061-605f0ddb098b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:36.867035 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1344/2658] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:44:36.871454 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa827cae-d29a-4b6e-8b8a-c9195c5e2eb9 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:36.882301 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa827cae-d29a-4b6e-8b8a-c9195c5e2eb9 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:36.887400 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09ae9a-e163-4fb9-9e72-b098ecf46999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:36.888058 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09ae9a-e163-4fb9-9e72-b098ecf46999 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:36.888344 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09ae9a-e163-4fb9-9e72-b098ecf46999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:36.888623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a09ae9a-e163-4fb9-9e72-b098ecf46999 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:36.889363 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09ae9a-e163-4fb9-9e72-b098ecf46999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:36.891378 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a09ae9a-e163-4fb9-9e72-b098ecf46999 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:37.005398 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1315/2659] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:44:36 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:44:37.009469 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f968771-563f-46a9-9061-605f0ddb098b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:37.019900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f968771-563f-46a9-9061-605f0ddb098b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:37.079594 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81c045-fe06-4f19-9e48-52ef141cea74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:37.080272 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81c045-fe06-4f19-9e48-52ef141cea74 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:37.080559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81c045-fe06-4f19-9e48-52ef141cea74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:37.080841 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81c045-fe06-4f19-9e48-52ef141cea74 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:37.081543 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81c045-fe06-4f19-9e48-52ef141cea74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:37.083502 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc81c045-fe06-4f19-9e48-52ef141cea74 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:37.165173 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1345/2660] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:44:37 2022] POST /identity/v3/users => generated 283 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:44:37.175534 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09ae9a-e163-4fb9-9e72-b098ecf46999 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:37.179702 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a09ae9a-e163-4fb9-9e72-b098ecf46999 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:37.184286 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac574f74-a74d-42d3-871e-f485661c431c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:37.184943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574f74-a74d-42d3-871e-f485661c431c admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:37.185230 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574f74-a74d-42d3-871e-f485661c431c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:37.185554 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574f74-a74d-42d3-871e-f485661c431c admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:37.186327 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac574f74-a74d-42d3-871e-f485661c431c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:37.187956 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac574f74-a74d-42d3-871e-f485661c431c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:37.198568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1316/2661] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:44:37.202572 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81c045-fe06-4f19-9e48-52ef141cea74 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:37.213203 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc81c045-fe06-4f19-9e48-52ef141cea74 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:37.218025 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e2d64-1d7b-4694-8f8b-354ac1f43e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:37.218678 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e2d64-1d7b-4694-8f8b-354ac1f43e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:37.218971 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e2d64-1d7b-4694-8f8b-354ac1f43e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:37.219258 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e2d64-1d7b-4694-8f8b-354ac1f43e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:37.219989 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e2d64-1d7b-4694-8f8b-354ac1f43e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:37.221603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e2d64-1d7b-4694-8f8b-354ac1f43e96 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:37.232539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1346/2662] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:44:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:44:37.236725 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac574f74-a74d-42d3-871e-f485661c431c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:37.247327 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac574f74-a74d-42d3-871e-f485661c431c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:37.252009 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788cd5c-becb-4eb7-903e-6b3490f82183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:37.252894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788cd5c-becb-4eb7-903e-6b3490f82183 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:37.253181 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788cd5c-becb-4eb7-903e-6b3490f82183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:37.253462 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788cd5c-becb-4eb7-903e-6b3490f82183 admin admin] PATH_INFO: `/v3/projects/7963eb9a579146a1aa22c173b3393479/users/742814e483d649f296054636ac8cb0c6/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:37.269171 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788cd5c-becb-4eb7-903e-6b3490f82183 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7963eb9a579146a1aa22c173b3393479, user_id=742814e483d649f296054636ac8cb0c6, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:37.272367 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788cd5c-becb-4eb7-903e-6b3490f82183 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:37.338466 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1317/2663] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:44:37 2022] PUT /identity/v3/projects/7963eb9a579146a1aa22c173b3393479/users/742814e483d649f296054636ac8cb0c6/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:44:37.349855 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786694fd-0aa3-4254-aed0-9b5de3b37a8f None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:37.350138 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786694fd-0aa3-4254-aed0-9b5de3b37a8f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:37.350513 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786694fd-0aa3-4254-aed0-9b5de3b37a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:37.377461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-786694fd-0aa3-4254-aed0-9b5de3b37a8f None None] MFA Rules not processed for user `742814e483d649f296054636ac8cb0c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:44:37.378818 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-786694fd-0aa3-4254-aed0-9b5de3b37a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:37.454723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1347/2664] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:44:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:44:37.466733 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788cd5c-becb-4eb7-903e-6b3490f82183 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:37.470000 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2788cd5c-becb-4eb7-903e-6b3490f82183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:37.494282 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:37.535354 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788cd5c-becb-4eb7-903e-6b3490f82183 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:37.539263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59497ea4-b313-45cf-bf39-9c38ed00447c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:37.540736 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59497ea4-b313-45cf-bf39-9c38ed00447c service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:37.540736 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59497ea4-b313-45cf-bf39-9c38ed00447c service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:37.541741 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59497ea4-b313-45cf-bf39-9c38ed00447c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:37.564986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59497ea4-b313-45cf-bf39-9c38ed00447c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:37.566504 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59497ea4-b313-45cf-bf39-9c38ed00447c service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:37.576306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1318/2665] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:44:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:44:42.703085 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786694fd-0aa3-4254-aed0-9b5de3b37a8f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:42.704493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-786694fd-0aa3-4254-aed0-9b5de3b37a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:42.715098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:42.781937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786694fd-0aa3-4254-aed0-9b5de3b37a8f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:42.785490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d9e3a-1c05-4c3f-a72d-bbea2b3d6d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:42.786169 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d9e3a-1c05-4c3f-a72d-bbea2b3d6d7c service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:42.786452 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d9e3a-1c05-4c3f-a72d-bbea2b3d6d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:42.786730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d9e3a-1c05-4c3f-a72d-bbea2b3d6d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:42.788556 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-de4d9e3a-1c05-4c3f-a72d-bbea2b3d6d7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:42.878601 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d9e3a-1c05-4c3f-a72d-bbea2b3d6d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:42.880233 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d9e3a-1c05-4c3f-a72d-bbea2b3d6d7c service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:42.900519 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1348/2666] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:44:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:44:47.200843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59497ea4-b313-45cf-bf39-9c38ed00447c service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:47.202370 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-59497ea4-b313-45cf-bf39-9c38ed00447c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:47.216763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59497ea4-b313-45cf-bf39-9c38ed00447c service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:47.221325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6e70f9-59d6-4dd8-9717-a695cf118a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:47.223325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e70f9-59d6-4dd8-9717-a695cf118a40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:47.223325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e70f9-59d6-4dd8-9717-a695cf118a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:47.223325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6e70f9-59d6-4dd8-9717-a695cf118a40 admin admin] PATH_INFO: `/v3/users/2109160a00894044a5d07516ab1aed2e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:47.224045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e70f9-59d6-4dd8-9717-a695cf118a40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2109160a00894044a5d07516ab1aed2e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:47.226511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6e70f9-59d6-4dd8-9717-a695cf118a40 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:47.469557 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4e6e70f9-59d6-4dd8-9717-a695cf118a40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2109160a00894044a5d07516ab1aed2e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:47.470306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4e6e70f9-59d6-4dd8-9717-a695cf118a40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2109160a00894044a5d07516ab1aed2e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:47.470908 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4e6e70f9-59d6-4dd8-9717-a695cf118a40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2109160a00894044a5d07516ab1aed2e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:47.483392 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4e6e70f9-59d6-4dd8-9717-a695cf118a40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2109160a00894044a5d07516ab1aed2e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:47.593174 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4e6e70f9-59d6-4dd8-9717-a695cf118a40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2109160a00894044a5d07516ab1aed2e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:47.606371 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1319/2667] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:44:47 2022] DELETE /identity/v3/users/2109160a00894044a5d07516ab1aed2e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:44:47.875189 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d9e3a-1c05-4c3f-a72d-bbea2b3d6d7c service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:47.897256 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d9e3a-1c05-4c3f-a72d-bbea2b3d6d7c service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:47.966429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0368e46-257f-4ea9-9cbb-41908b67c633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:47.967319 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0368e46-257f-4ea9-9cbb-41908b67c633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:47.967602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0368e46-257f-4ea9-9cbb-41908b67c633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:47.967883 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0368e46-257f-4ea9-9cbb-41908b67c633 admin admin] PATH_INFO: `/v3/projects/2875f1f411b245f4805eb9e95306063d` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:47.969166 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0368e46-257f-4ea9-9cbb-41908b67c633 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2875f1f411b245f4805eb9e95306063d)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:47.971178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0368e46-257f-4ea9-9cbb-41908b67c633 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:47.978296 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:48.092182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a0368e46-257f-4ea9-9cbb-41908b67c633 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2875f1f411b245f4805eb9e95306063d', 'request_id': 'req-a0368e46-257f-4ea9-9cbb-41908b67c633'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:48.097748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a0368e46-257f-4ea9-9cbb-41908b67c633 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2875f1f411b245f4805eb9e95306063d', 'request_id': 'req-a0368e46-257f-4ea9-9cbb-41908b67c633'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:48.104758 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a0368e46-257f-4ea9-9cbb-41908b67c633 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2875f1f411b245f4805eb9e95306063d', 'request_id': 'req-a0368e46-257f-4ea9-9cbb-41908b67c633'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:48.266945 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a0368e46-257f-4ea9-9cbb-41908b67c633 admin admin] The token cache is being invalidate because project 2875f1f411b245f4805eb9e95306063d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:44:48.267241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a0368e46-257f-4ea9-9cbb-41908b67c633 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:48.267993 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-a0368e46-257f-4ea9-9cbb-41908b67c633 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:48.269561 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1349/2668] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:44:47 2022] DELETE /identity/v3/projects/2875f1f411b245f4805eb9e95306063d => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:44:48.275285 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981349f7-5a8a-4381-b59d-6f1f1b85ecb3 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:48.275771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981349f7-5a8a-4381-b59d-6f1f1b85ecb3 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:48.276051 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981349f7-5a8a-4381-b59d-6f1f1b85ecb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:48.333072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-981349f7-5a8a-4381-b59d-6f1f1b85ecb3 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:44:48.334860 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-981349f7-5a8a-4381-b59d-6f1f1b85ecb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:48.386817 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:48.404451 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1320/2669] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:44:48.413441 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c2d59-d64b-47bc-ad3f-8c6b662dd1c0 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:48.413764 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c2d59-d64b-47bc-ad3f-8c6b662dd1c0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:48.414051 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c2d59-d64b-47bc-ad3f-8c6b662dd1c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:48.433186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-244c2d59-d64b-47bc-ad3f-8c6b662dd1c0 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:44:48.434417 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-244c2d59-d64b-47bc-ad3f-8c6b662dd1c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:48.443126 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1350/2670] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:44:48.447660 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981349f7-5a8a-4381-b59d-6f1f1b85ecb3 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:48.457317 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981349f7-5a8a-4381-b59d-6f1f1b85ecb3 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:48.462481 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f4040-7eeb-4a91-a322-e3bdf576156e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:48.463134 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f4040-7eeb-4a91-a322-e3bdf576156e admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:48.463422 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f4040-7eeb-4a91-a322-e3bdf576156e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:48.463700 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f4040-7eeb-4a91-a322-e3bdf576156e admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:48.464421 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f4040-7eeb-4a91-a322-e3bdf576156e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:44:48.464727 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f4040-7eeb-4a91-a322-e3bdf576156e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:48.466393 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f4040-7eeb-4a91-a322-e3bdf576156e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:48.478340 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1321/2671] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:44:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:44:48.482549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c2d59-d64b-47bc-ad3f-8c6b662dd1c0 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:48.491819 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c2d59-d64b-47bc-ad3f-8c6b662dd1c0 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:48.496434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9936c-ddb4-4e9a-a746-32b7c8b7c180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:48.497091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9936c-ddb4-4e9a-a746-32b7c8b7c180 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:48.497429 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9936c-ddb4-4e9a-a746-32b7c8b7c180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:48.497727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad9936c-ddb4-4e9a-a746-32b7c8b7c180 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:48.498463 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9936c-ddb4-4e9a-a746-32b7c8b7c180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:48.500453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad9936c-ddb4-4e9a-a746-32b7c8b7c180 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:48.594077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1351/2672] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:44:48 2022] POST /identity/v3/projects => generated 391 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:44:48.598168 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f4040-7eeb-4a91-a322-e3bdf576156e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:48.608084 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f4040-7eeb-4a91-a322-e3bdf576156e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:48.663335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6d336-2758-47e9-9c76-f93e0baf884d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:48.664055 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6d336-2758-47e9-9c76-f93e0baf884d admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:48.664346 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6d336-2758-47e9-9c76-f93e0baf884d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:48.664628 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6d336-2758-47e9-9c76-f93e0baf884d admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:48.665330 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6d336-2758-47e9-9c76-f93e0baf884d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:48.667293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6d336-2758-47e9-9c76-f93e0baf884d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:48.811135 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1322/2673] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:44:48 2022] POST /identity/v3/users => generated 296 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:44:48.815425 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9936c-ddb4-4e9a-a746-32b7c8b7c180 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:48.828177 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad9936c-ddb4-4e9a-a746-32b7c8b7c180 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:48.834777 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fc1c1-bf30-4fea-a54e-2429319fbd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:48.835757 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fc1c1-bf30-4fea-a54e-2429319fbd72 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:48.836139 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fc1c1-bf30-4fea-a54e-2429319fbd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:48.836539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fc1c1-bf30-4fea-a54e-2429319fbd72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:48.837268 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fc1c1-bf30-4fea-a54e-2429319fbd72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:48.839107 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fc1c1-bf30-4fea-a54e-2429319fbd72 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:48.851202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1352/2674] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:44:48.856234 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6d336-2758-47e9-9c76-f93e0baf884d admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:48.872045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6d336-2758-47e9-9c76-f93e0baf884d admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:48.879545 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603f18b-348d-4caf-a326-6a2db749e4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:48.880236 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603f18b-348d-4caf-a326-6a2db749e4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:48.880521 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603f18b-348d-4caf-a326-6a2db749e4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:48.880807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603f18b-348d-4caf-a326-6a2db749e4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:48.881540 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603f18b-348d-4caf-a326-6a2db749e4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:48.883502 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603f18b-348d-4caf-a326-6a2db749e4e0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:48.894924 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1323/2675] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:44:48.899432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fc1c1-bf30-4fea-a54e-2429319fbd72 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:48.910285 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fc1c1-bf30-4fea-a54e-2429319fbd72 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:48.916908 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4c4d4-cfd6-4ed2-92f5-12adf5795785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:48.917990 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4c4d4-cfd6-4ed2-92f5-12adf5795785 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:48.918273 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4c4d4-cfd6-4ed2-92f5-12adf5795785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:48.918551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f4c4d4-cfd6-4ed2-92f5-12adf5795785 admin admin] PATH_INFO: `/v3/projects/0d8e36f497924fb0ac1759dc31dcc92e/users/a5ffa06f6b3740c6963b6a96c65e66e3/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:48.932992 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4c4d4-cfd6-4ed2-92f5-12adf5795785 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d8e36f497924fb0ac1759dc31dcc92e, user_id=a5ffa06f6b3740c6963b6a96c65e66e3, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:48.935670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f4c4d4-cfd6-4ed2-92f5-12adf5795785 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:49.021956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1353/2676] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:44:48 2022] PUT /identity/v3/projects/0d8e36f497924fb0ac1759dc31dcc92e/users/a5ffa06f6b3740c6963b6a96c65e66e3/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:44:49.033025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e8126-b3f8-455d-a682-b34aed56a16d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:49.033330 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e8126-b3f8-455d-a682-b34aed56a16d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:49.033603 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e8126-b3f8-455d-a682-b34aed56a16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:49.060397 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-df5e8126-b3f8-455d-a682-b34aed56a16d None None] MFA Rules not processed for user `a5ffa06f6b3740c6963b6a96c65e66e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:44:49.061666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-df5e8126-b3f8-455d-a682-b34aed56a16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:49.124816 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1324/2677] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:44:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:44:49.129262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4c4d4-cfd6-4ed2-92f5-12adf5795785 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:49.197806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f4c4d4-cfd6-4ed2-92f5-12adf5795785 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:49.202592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce228a-c484-4969-b30e-9127a950f97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:49.203258 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce228a-c484-4969-b30e-9127a950f97a admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:49.203548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce228a-c484-4969-b30e-9127a950f97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:49.203833 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce228a-c484-4969-b30e-9127a950f97a admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:49.204537 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce228a-c484-4969-b30e-9127a950f97a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:49.206495 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce228a-c484-4969-b30e-9127a950f97a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:49.628423 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1354/2678] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:44:49 2022] POST /identity/v3/projects => generated 393 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:44:49.633179 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e8126-b3f8-455d-a682-b34aed56a16d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:49.644121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e8126-b3f8-455d-a682-b34aed56a16d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:49.684023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:49.699967 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930279b-8259-4382-8223-57b258840ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:49.700636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930279b-8259-4382-8223-57b258840ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:49.700943 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930279b-8259-4382-8223-57b258840ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:49.701208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930279b-8259-4382-8223-57b258840ad0 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:49.701938 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930279b-8259-4382-8223-57b258840ad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:49.703861 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930279b-8259-4382-8223-57b258840ad0 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:49.815470 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1325/2679] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:44:49 2022] POST /identity/v3/users => generated 303 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:44:49.819779 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce228a-c484-4969-b30e-9127a950f97a admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:49.830207 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce228a-c484-4969-b30e-9127a950f97a admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:49.834842 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c3951-bbef-4c7b-80e9-9ed26aee1628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:49.835504 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c3951-bbef-4c7b-80e9-9ed26aee1628 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:49.835937 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c3951-bbef-4c7b-80e9-9ed26aee1628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:49.836053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c3951-bbef-4c7b-80e9-9ed26aee1628 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:49.836775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c3951-bbef-4c7b-80e9-9ed26aee1628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:49.838475 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c3951-bbef-4c7b-80e9-9ed26aee1628 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:49.849306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1355/2680] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:44:49.853451 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930279b-8259-4382-8223-57b258840ad0 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:49.863605 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930279b-8259-4382-8223-57b258840ad0 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:49.869910 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53292f58-cccf-4257-ab8c-7e88d7c43abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:49.870815 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53292f58-cccf-4257-ab8c-7e88d7c43abe admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:49.871102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53292f58-cccf-4257-ab8c-7e88d7c43abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:49.871381 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53292f58-cccf-4257-ab8c-7e88d7c43abe admin admin] PATH_INFO: `/v3/projects/c8c7953ef1d046c992f4d55d81ea8073/users/d0127d85ec0544db8d120257bc0c1060/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:49.887066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53292f58-cccf-4257-ab8c-7e88d7c43abe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8c7953ef1d046c992f4d55d81ea8073, user_id=d0127d85ec0544db8d120257bc0c1060, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:49.889695 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53292f58-cccf-4257-ab8c-7e88d7c43abe admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:50.158947 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1326/2681] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:44:49 2022] PUT /identity/v3/projects/c8c7953ef1d046c992f4d55d81ea8073/users/d0127d85ec0544db8d120257bc0c1060/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:44:50.163644 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c3951-bbef-4c7b-80e9-9ed26aee1628 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:50.170215 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:50.174034 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c3951-bbef-4c7b-80e9-9ed26aee1628 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:50.232370 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5564dd43-1990-4f0a-bffa-1ca66d9b0bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:50.233032 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564dd43-1990-4f0a-bffa-1ca66d9b0bbf admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:50.233316 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564dd43-1990-4f0a-bffa-1ca66d9b0bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:50.233681 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5564dd43-1990-4f0a-bffa-1ca66d9b0bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:50.234435 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564dd43-1990-4f0a-bffa-1ca66d9b0bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:50.236029 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5564dd43-1990-4f0a-bffa-1ca66d9b0bbf admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:50.246769 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1356/2682] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:44:50.251568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53292f58-cccf-4257-ab8c-7e88d7c43abe admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:50.261596 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53292f58-cccf-4257-ab8c-7e88d7c43abe admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:50.266358 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d5153-50cc-46fe-8289-4321d2b72eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:50.267235 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d5153-50cc-46fe-8289-4321d2b72eea admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:50.267519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d5153-50cc-46fe-8289-4321d2b72eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:50.267797 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d5153-50cc-46fe-8289-4321d2b72eea admin admin] PATH_INFO: `/v3/projects/c8c7953ef1d046c992f4d55d81ea8073/users/d0127d85ec0544db8d120257bc0c1060/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:50.269815 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d5153-50cc-46fe-8289-4321d2b72eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8c7953ef1d046c992f4d55d81ea8073, user_id=d0127d85ec0544db8d120257bc0c1060, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:50.272441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d5153-50cc-46fe-8289-4321d2b72eea admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:50.289295 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1327/2683] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:44:50 2022] PUT /identity/v3/projects/c8c7953ef1d046c992f4d55d81ea8073/users/d0127d85ec0544db8d120257bc0c1060/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:44:50.299792 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80ddb0-be24-418a-b4af-a28dc77cdee9 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:50.300088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80ddb0-be24-418a-b4af-a28dc77cdee9 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:50.300371 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80ddb0-be24-418a-b4af-a28dc77cdee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:50.327653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-0c80ddb0-be24-418a-b4af-a28dc77cdee9 None None] MFA Rules not processed for user `d0127d85ec0544db8d120257bc0c1060`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:44:50.332099 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0c80ddb0-be24-418a-b4af-a28dc77cdee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:50.394609 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1357/2684] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:44:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:44:50.406391 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d5153-50cc-46fe-8289-4321d2b72eea admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:50.408151 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e52d5153-50cc-46fe-8289-4321d2b72eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:50.466123 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d5153-50cc-46fe-8289-4321d2b72eea admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:50.469746 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ba587-5164-4f4e-b329-2065bcba5dd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:50.470393 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ba587-5164-4f4e-b329-2065bcba5dd2 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:50.470696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ba587-5164-4f4e-b329-2065bcba5dd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:50.470976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ba587-5164-4f4e-b329-2065bcba5dd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:50.479868 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ba587-5164-4f4e-b329-2065bcba5dd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:50.481554 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ba587-5164-4f4e-b329-2065bcba5dd2 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:50.492298 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1328/2685] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:44:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:44:50.536741 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80ddb0-be24-418a-b4af-a28dc77cdee9 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:50.538181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0c80ddb0-be24-418a-b4af-a28dc77cdee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:50.550332 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80ddb0-be24-418a-b4af-a28dc77cdee9 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:50.554517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef422ec-8760-4698-a23a-d0448d101fd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:50.555165 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef422ec-8760-4698-a23a-d0448d101fd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:50.555452 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef422ec-8760-4698-a23a-d0448d101fd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:50.555733 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef422ec-8760-4698-a23a-d0448d101fd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:50.611575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef422ec-8760-4698-a23a-d0448d101fd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:50.613009 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef422ec-8760-4698-a23a-d0448d101fd5 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:50.622437 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1358/2686] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:44:50 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:44:52.049816 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ba587-5164-4f4e-b329-2065bcba5dd2 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:52.051197 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a00ba587-5164-4f4e-b329-2065bcba5dd2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:52.142389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ba587-5164-4f4e-b329-2065bcba5dd2 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:52.147747 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0285c2f-d095-407e-be01-b82aa9e6d091 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '213ba948a3f34c39bce3f6db093479eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:52.152446 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0285c2f-d095-407e-be01-b82aa9e6d091 service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:52.152446 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0285c2f-d095-407e-be01-b82aa9e6d091 service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:52.152446 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0285c2f-d095-407e-be01-b82aa9e6d091 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:52.152446 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d0285c2f-d095-407e-be01-b82aa9e6d091 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:52.162973 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0285c2f-d095-407e-be01-b82aa9e6d091 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:52.164563 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0285c2f-d095-407e-be01-b82aa9e6d091 service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:52.174652 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1329/2687] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:44:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:44:55.749515 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef422ec-8760-4698-a23a-d0448d101fd5 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:55.777412 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:55.813062 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef422ec-8760-4698-a23a-d0448d101fd5 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:55.818433 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20582d-ae95-4bda-b6d0-fa1a144fb08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:55.823765 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20582d-ae95-4bda-b6d0-fa1a144fb08e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:55.823765 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20582d-ae95-4bda-b6d0-fa1a144fb08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:55.823765 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20582d-ae95-4bda-b6d0-fa1a144fb08e admin admin] PATH_INFO: `/v3/users/a5ffa06f6b3740c6963b6a96c65e66e3` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:55.823765 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20582d-ae95-4bda-b6d0-fa1a144fb08e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5ffa06f6b3740c6963b6a96c65e66e3)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:55.823765 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20582d-ae95-4bda-b6d0-fa1a144fb08e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:56.046623 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ba20582d-ae95-4bda-b6d0-fa1a144fb08e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5ffa06f6b3740c6963b6a96c65e66e3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:56.047365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ba20582d-ae95-4bda-b6d0-fa1a144fb08e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5ffa06f6b3740c6963b6a96c65e66e3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:56.047976 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ba20582d-ae95-4bda-b6d0-fa1a144fb08e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5ffa06f6b3740c6963b6a96c65e66e3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:56.060322 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ba20582d-ae95-4bda-b6d0-fa1a144fb08e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5ffa06f6b3740c6963b6a96c65e66e3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:56.068377 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ba20582d-ae95-4bda-b6d0-fa1a144fb08e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5ffa06f6b3740c6963b6a96c65e66e3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:56.135952 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1359/2688] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:44:55 2022] DELETE /identity/v3/users/a5ffa06f6b3740c6963b6a96c65e66e3 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:44:56.140390 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f26be1-e293-47bd-b6d2-bdf3a68b4941 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:56.140849 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f26be1-e293-47bd-b6d2-bdf3a68b4941 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:56.140958 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f26be1-e293-47bd-b6d2-bdf3a68b4941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:56.153950 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:56.159911 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-63f26be1-e293-47bd-b6d2-bdf3a68b4941 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:44:56.161156 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-63f26be1-e293-47bd-b6d2-bdf3a68b4941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:56.227803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1330/2689] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:44:56.238343 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20582d-ae95-4bda-b6d0-fa1a144fb08e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:56.239749 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ba20582d-ae95-4bda-b6d0-fa1a144fb08e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:56.321604 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20582d-ae95-4bda-b6d0-fa1a144fb08e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:56.324148 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694adf68-42c4-4495-8084-ba8f1f0c9545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:56.324908 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694adf68-42c4-4495-8084-ba8f1f0c9545 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:56.325191 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694adf68-42c4-4495-8084-ba8f1f0c9545 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:56.325474 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694adf68-42c4-4495-8084-ba8f1f0c9545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:56.335129 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694adf68-42c4-4495-8084-ba8f1f0c9545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:56.336566 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694adf68-42c4-4495-8084-ba8f1f0c9545 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:56.351069 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1360/2690] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:44:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:44:56.789459 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f26be1-e293-47bd-b6d2-bdf3a68b4941 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:56.791776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-63f26be1-e293-47bd-b6d2-bdf3a68b4941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:56.813155 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f26be1-e293-47bd-b6d2-bdf3a68b4941 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:56.820899 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bfedf-f0b7-441a-823b-dd9ce1c50ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:56.822388 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bfedf-f0b7-441a-823b-dd9ce1c50ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:56.823253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bfedf-f0b7-441a-823b-dd9ce1c50ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:56.823695 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5bfedf-f0b7-441a-823b-dd9ce1c50ad7 admin admin] PATH_INFO: `/v3/projects/0d8e36f497924fb0ac1759dc31dcc92e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:56.825189 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bfedf-f0b7-441a-823b-dd9ce1c50ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d8e36f497924fb0ac1759dc31dcc92e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:56.827390 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5bfedf-f0b7-441a-823b-dd9ce1c50ad7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:56.960511 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0e5bfedf-f0b7-441a-823b-dd9ce1c50ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d8e36f497924fb0ac1759dc31dcc92e', 'request_id': 'req-0e5bfedf-f0b7-441a-823b-dd9ce1c50ad7'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:56.966667 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0e5bfedf-f0b7-441a-823b-dd9ce1c50ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d8e36f497924fb0ac1759dc31dcc92e', 'request_id': 'req-0e5bfedf-f0b7-441a-823b-dd9ce1c50ad7'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:56.973054 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0e5bfedf-f0b7-441a-823b-dd9ce1c50ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d8e36f497924fb0ac1759dc31dcc92e', 'request_id': 'req-0e5bfedf-f0b7-441a-823b-dd9ce1c50ad7'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:57.038211 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0e5bfedf-f0b7-441a-823b-dd9ce1c50ad7 admin admin] The token cache is being invalidate because project 0d8e36f497924fb0ac1759dc31dcc92e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:44:57.038490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0e5bfedf-f0b7-441a-823b-dd9ce1c50ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:57.039103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0e5bfedf-f0b7-441a-823b-dd9ce1c50ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:57.040659 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1331/2691] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:44:56 2022] DELETE /identity/v3/projects/0d8e36f497924fb0ac1759dc31dcc92e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:44:57.044658 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694adf68-42c4-4495-8084-ba8f1f0c9545 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:57.054498 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694adf68-42c4-4495-8084-ba8f1f0c9545 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:57.082270 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:57.114512 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5f26e-06e9-4a9f-9e9f-70800a80d8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:57.115388 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5f26e-06e9-4a9f-9e9f-70800a80d8fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:57.115676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5f26e-06e9-4a9f-9e9f-70800a80d8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:57.115956 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5f26e-06e9-4a9f-9e9f-70800a80d8fb admin admin] PATH_INFO: `/v3/users/d0127d85ec0544db8d120257bc0c1060` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:57.117146 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5f26e-06e9-4a9f-9e9f-70800a80d8fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0127d85ec0544db8d120257bc0c1060)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:57.119119 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5f26e-06e9-4a9f-9e9f-70800a80d8fb admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:57.335996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-9af5f26e-06e9-4a9f-9e9f-70800a80d8fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0127d85ec0544db8d120257bc0c1060'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:57.336632 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-9af5f26e-06e9-4a9f-9e9f-70800a80d8fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0127d85ec0544db8d120257bc0c1060'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:57.337382 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-9af5f26e-06e9-4a9f-9e9f-70800a80d8fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0127d85ec0544db8d120257bc0c1060'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:57.350183 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-9af5f26e-06e9-4a9f-9e9f-70800a80d8fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0127d85ec0544db8d120257bc0c1060'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:57.357204 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-9af5f26e-06e9-4a9f-9e9f-70800a80d8fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0127d85ec0544db8d120257bc0c1060'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:57.415882 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1361/2692] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:44:57 2022] DELETE /identity/v3/users/d0127d85ec0544db8d120257bc0c1060 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:44:57.932744 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bfedf-f0b7-441a-823b-dd9ce1c50ad7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:57.934392 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0e5bfedf-f0b7-441a-823b-dd9ce1c50ad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:57.949419 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5bfedf-f0b7-441a-823b-dd9ce1c50ad7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:58.007733 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca1215b-4dd7-4bd3-9918-9cb4b0eb241f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:58.008618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1215b-4dd7-4bd3-9918-9cb4b0eb241f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:58.008900 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1215b-4dd7-4bd3-9918-9cb4b0eb241f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:58.009176 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca1215b-4dd7-4bd3-9918-9cb4b0eb241f admin admin] PATH_INFO: `/v3/projects/c8c7953ef1d046c992f4d55d81ea8073` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:58.010363 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1215b-4dd7-4bd3-9918-9cb4b0eb241f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8c7953ef1d046c992f4d55d81ea8073)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:58.012247 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca1215b-4dd7-4bd3-9918-9cb4b0eb241f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:58.130190 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:58.146475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dca1215b-4dd7-4bd3-9918-9cb4b0eb241f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8c7953ef1d046c992f4d55d81ea8073', 'request_id': 'req-dca1215b-4dd7-4bd3-9918-9cb4b0eb241f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:58.152792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dca1215b-4dd7-4bd3-9918-9cb4b0eb241f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8c7953ef1d046c992f4d55d81ea8073', 'request_id': 'req-dca1215b-4dd7-4bd3-9918-9cb4b0eb241f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:58.159092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dca1215b-4dd7-4bd3-9918-9cb4b0eb241f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8c7953ef1d046c992f4d55d81ea8073', 'request_id': 'req-dca1215b-4dd7-4bd3-9918-9cb4b0eb241f'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:58.221291 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dca1215b-4dd7-4bd3-9918-9cb4b0eb241f admin admin] The token cache is being invalidate because project c8c7953ef1d046c992f4d55d81ea8073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:44:58.221792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dca1215b-4dd7-4bd3-9918-9cb4b0eb241f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:58.222970 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dca1215b-4dd7-4bd3-9918-9cb4b0eb241f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:44:58.224618 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1332/2693] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:44:57 2022] DELETE /identity/v3/projects/c8c7953ef1d046c992f4d55d81ea8073 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:44:58.231118 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a41a5-823d-43a7-a152-eb1580000267 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:58.231844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a41a5-823d-43a7-a152-eb1580000267 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:58.231844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a41a5-823d-43a7-a152-eb1580000267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:58.249262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-958a41a5-823d-43a7-a152-eb1580000267 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:44:58.250542 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-958a41a5-823d-43a7-a152-eb1580000267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:58.311309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1362/2694] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:44:58.319961 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6e018-7c79-4b60-9a6b-2046581164cc None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:58.320253 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6e018-7c79-4b60-9a6b-2046581164cc None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:58.320559 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6e018-7c79-4b60-9a6b-2046581164cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:58.339985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b6e6e018-7c79-4b60-9a6b-2046581164cc None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:44:58.341183 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b6e6e018-7c79-4b60-9a6b-2046581164cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:58.348959 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1333/2695] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:44:58.353273 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a41a5-823d-43a7-a152-eb1580000267 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:58.367969 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a41a5-823d-43a7-a152-eb1580000267 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:58.375743 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5760cd-a524-416b-b472-0c2a4e04c77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:58.376875 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5760cd-a524-416b-b472-0c2a4e04c77d admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:58.377397 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5760cd-a524-416b-b472-0c2a4e04c77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:58.378033 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5760cd-a524-416b-b472-0c2a4e04c77d admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:58.379410 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5760cd-a524-416b-b472-0c2a4e04c77d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:44:58.379960 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5760cd-a524-416b-b472-0c2a4e04c77d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:58.382578 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5760cd-a524-416b-b472-0c2a4e04c77d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:58.399515 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1363/2696] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:44:58.401577 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6e018-7c79-4b60-9a6b-2046581164cc None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:58.410980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6e018-7c79-4b60-9a6b-2046581164cc None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:58.415655 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11def9c0-9612-4683-8e08-d27189cafb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:58.416306 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11def9c0-9612-4683-8e08-d27189cafb9f admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:58.416616 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11def9c0-9612-4683-8e08-d27189cafb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:58.416901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11def9c0-9612-4683-8e08-d27189cafb9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:58.417596 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11def9c0-9612-4683-8e08-d27189cafb9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:58.419564 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11def9c0-9612-4683-8e08-d27189cafb9f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:58.543203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1334/2697] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:44:58 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:44:58.547527 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5760cd-a524-416b-b472-0c2a4e04c77d admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:58.558425 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5760cd-a524-416b-b472-0c2a4e04c77d admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:58.588845 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:58.616055 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f439f3-225e-4c3b-aec9-036112d463e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:58.617044 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f439f3-225e-4c3b-aec9-036112d463e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:58.617380 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f439f3-225e-4c3b-aec9-036112d463e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:58.617662 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f439f3-225e-4c3b-aec9-036112d463e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:58.618398 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f439f3-225e-4c3b-aec9-036112d463e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:58.620848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f439f3-225e-4c3b-aec9-036112d463e1 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:58.737467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1364/2698] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:44:58 2022] POST /identity/v3/users => generated 288 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:44:58.741465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11def9c0-9612-4683-8e08-d27189cafb9f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:58.752578 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11def9c0-9612-4683-8e08-d27189cafb9f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:58.757333 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa35725-4676-4f7e-b278-efbf85b286fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:58.758026 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa35725-4676-4f7e-b278-efbf85b286fd admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:58.758313 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa35725-4676-4f7e-b278-efbf85b286fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:58.758598 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa35725-4676-4f7e-b278-efbf85b286fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:58.759324 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa35725-4676-4f7e-b278-efbf85b286fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:58.761507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa35725-4676-4f7e-b278-efbf85b286fd admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:58.772444 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1335/2699] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:44:58.777028 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f439f3-225e-4c3b-aec9-036112d463e1 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:58.787258 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f439f3-225e-4c3b-aec9-036112d463e1 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:58.791925 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2078835f-0589-4437-807d-2d48c72f3961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:58.792582 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078835f-0589-4437-807d-2d48c72f3961 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:58.792868 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078835f-0589-4437-807d-2d48c72f3961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:58.793148 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2078835f-0589-4437-807d-2d48c72f3961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:58.793975 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078835f-0589-4437-807d-2d48c72f3961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:58.795506 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2078835f-0589-4437-807d-2d48c72f3961 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:58.805415 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1365/2700] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:44:58.810153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa35725-4676-4f7e-b278-efbf85b286fd admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:58.821191 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa35725-4676-4f7e-b278-efbf85b286fd admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:58.826820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a16d0-85b8-4eb7-89d0-fc4ff9576b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:58.827722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a16d0-85b8-4eb7-89d0-fc4ff9576b6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:58.828011 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a16d0-85b8-4eb7-89d0-fc4ff9576b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:58.828292 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a16d0-85b8-4eb7-89d0-fc4ff9576b6b admin admin] PATH_INFO: `/v3/projects/6ff7303e69364172bf28feb8ece8a5f3/users/b4cd6ac6c1344635a0bdd37e7403c4ff/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:58.843341 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a16d0-85b8-4eb7-89d0-fc4ff9576b6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff7303e69364172bf28feb8ece8a5f3, user_id=b4cd6ac6c1344635a0bdd37e7403c4ff, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:58.846036 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a16d0-85b8-4eb7-89d0-fc4ff9576b6b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:58.969826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1336/2701] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:44:58 2022] PUT /identity/v3/projects/6ff7303e69364172bf28feb8ece8a5f3/users/b4cd6ac6c1344635a0bdd37e7403c4ff/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:44:58.981653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa484ab4-761e-451d-b7a5-53fd9ea2aac5 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:58.982013 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa484ab4-761e-451d-b7a5-53fd9ea2aac5 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:58.982327 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa484ab4-761e-451d-b7a5-53fd9ea2aac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:59.010572 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-fa484ab4-761e-451d-b7a5-53fd9ea2aac5 None None] MFA Rules not processed for user `b4cd6ac6c1344635a0bdd37e7403c4ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:44:59.011874 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-fa484ab4-761e-451d-b7a5-53fd9ea2aac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:59.078028 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1366/2702] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:44:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:44:59.082451 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a16d0-85b8-4eb7-89d0-fc4ff9576b6b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:59.145663 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a16d0-85b8-4eb7-89d0-fc4ff9576b6b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:59.150436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09181966-83b9-46a5-a714-f8701c6e0a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:59.151119 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181966-83b9-46a5-a714-f8701c6e0a01 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:59.151411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181966-83b9-46a5-a714-f8701c6e0a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:59.151693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09181966-83b9-46a5-a714-f8701c6e0a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:59.152377 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09181966-83b9-46a5-a714-f8701c6e0a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:59.154331 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09181966-83b9-46a5-a714-f8701c6e0a01 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:59.235554 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1337/2703] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:44:59 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:44:59.239600 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa484ab4-761e-451d-b7a5-53fd9ea2aac5 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:59.251351 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa484ab4-761e-451d-b7a5-53fd9ea2aac5 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:59.308731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ea928-ac65-4350-a5a2-0a1e6545c02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:59.309442 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ea928-ac65-4350-a5a2-0a1e6545c02b admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:59.309771 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ea928-ac65-4350-a5a2-0a1e6545c02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:59.310057 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ea928-ac65-4350-a5a2-0a1e6545c02b admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:59.310743 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ea928-ac65-4350-a5a2-0a1e6545c02b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:59.312692 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ea928-ac65-4350-a5a2-0a1e6545c02b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:59.387435 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1367/2704] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:44:59 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:44:59.392032 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09181966-83b9-46a5-a714-f8701c6e0a01 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:59.403276 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09181966-83b9-46a5-a714-f8701c6e0a01 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:59.408011 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a609b-eb8b-4cd2-8408-3e96da3a77db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:59.408717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a609b-eb8b-4cd2-8408-3e96da3a77db admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:59.409012 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a609b-eb8b-4cd2-8408-3e96da3a77db admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:59.409294 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a609b-eb8b-4cd2-8408-3e96da3a77db admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:59.410064 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a609b-eb8b-4cd2-8408-3e96da3a77db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:59.411732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6a609b-eb8b-4cd2-8408-3e96da3a77db admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:59.423171 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1338/2705] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:44:59.427430 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ea928-ac65-4350-a5a2-0a1e6545c02b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:59.437848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ea928-ac65-4350-a5a2-0a1e6545c02b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:59.442791 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e6c7e-553a-4b8d-b68e-7b085ed97671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:59.443447 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e6c7e-553a-4b8d-b68e-7b085ed97671 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:59.443738 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e6c7e-553a-4b8d-b68e-7b085ed97671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:59.444024 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e6c7e-553a-4b8d-b68e-7b085ed97671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:59.444743 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e6c7e-553a-4b8d-b68e-7b085ed97671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:59.446385 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e6c7e-553a-4b8d-b68e-7b085ed97671 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:59.456966 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1368/2706] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:44:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 02:44:59.461382 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a609b-eb8b-4cd2-8408-3e96da3a77db admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:59.471978 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a609b-eb8b-4cd2-8408-3e96da3a77db admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:59.476610 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad5799-a247-4ec3-b747-78cf28a08e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:59.477494 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad5799-a247-4ec3-b747-78cf28a08e1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:59.477816 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad5799-a247-4ec3-b747-78cf28a08e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:59.478101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad5799-a247-4ec3-b747-78cf28a08e1f admin admin] PATH_INFO: `/v3/projects/0e0b50dde658476e966abf977867e57b/users/4aff616b846543e689e36b6676aa1d1e/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:59.493321 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad5799-a247-4ec3-b747-78cf28a08e1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0b50dde658476e966abf977867e57b, user_id=4aff616b846543e689e36b6676aa1d1e, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:59.496266 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad5799-a247-4ec3-b747-78cf28a08e1f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:59.563291 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1339/2707] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:44:59 2022] PUT /identity/v3/projects/0e0b50dde658476e966abf977867e57b/users/4aff616b846543e689e36b6676aa1d1e/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:44:59.573854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8a1e9-faa3-4f43-9951-6c191d4d3efc None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:59.574144 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8a1e9-faa3-4f43-9951-6c191d4d3efc None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:59.574424 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae8a1e9-faa3-4f43-9951-6c191d4d3efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:59.601623 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-8ae8a1e9-faa3-4f43-9951-6c191d4d3efc None None] MFA Rules not processed for user `4aff616b846543e689e36b6676aa1d1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:44:59.602879 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-8ae8a1e9-faa3-4f43-9951-6c191d4d3efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:44:59.614399 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:59.671845 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1369/2708] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:44:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:44:59.676336 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad5799-a247-4ec3-b747-78cf28a08e1f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:59.685644 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:44:59.741193 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad5799-a247-4ec3-b747-78cf28a08e1f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:59.746081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbd0b7-c2d0-4403-b051-fc56acb717cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:59.746805 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbd0b7-c2d0-4403-b051-fc56acb717cc admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:59.747090 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbd0b7-c2d0-4403-b051-fc56acb717cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:59.747372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecbd0b7-c2d0-4403-b051-fc56acb717cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:59.748202 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecbd0b7-c2d0-4403-b051-fc56acb717cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:59.750150 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecbd0b7-c2d0-4403-b051-fc56acb717cc admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:44:59.839981 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1340/2709] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:44:59 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:44:59.844080 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8a1e9-faa3-4f43-9951-6c191d4d3efc None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:44:59.855315 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae8a1e9-faa3-4f43-9951-6c191d4d3efc None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:44:59.914124 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa7edd-a755-4d1e-8140-59247909811a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:44:59.914807 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa7edd-a755-4d1e-8140-59247909811a admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:44:59.915097 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa7edd-a755-4d1e-8140-59247909811a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:44:59.915380 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa7edd-a755-4d1e-8140-59247909811a admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:44:59.916085 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa7edd-a755-4d1e-8140-59247909811a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:44:59.918055 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa7edd-a755-4d1e-8140-59247909811a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:00.005072 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1370/2710] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:44:59 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:45:00.009020 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbd0b7-c2d0-4403-b051-fc56acb717cc admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:00.020443 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecbd0b7-c2d0-4403-b051-fc56acb717cc admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:00.025058 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fda48-aa8f-44c5-844e-ce7c8534c74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:00.025721 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fda48-aa8f-44c5-844e-ce7c8534c74a admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:00.026033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fda48-aa8f-44c5-844e-ce7c8534c74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:00.026304 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474fda48-aa8f-44c5-844e-ce7c8534c74a admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:00.027024 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474fda48-aa8f-44c5-844e-ce7c8534c74a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:00.028598 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474fda48-aa8f-44c5-844e-ce7c8534c74a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:00.039043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1341/2711] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:45:00.043443 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa7edd-a755-4d1e-8140-59247909811a admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:00.054132 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa7edd-a755-4d1e-8140-59247909811a admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:00.059540 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dbc45-3629-4174-99f4-4ab267d4605d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:00.060438 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dbc45-3629-4174-99f4-4ab267d4605d admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:00.060755 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dbc45-3629-4174-99f4-4ab267d4605d admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:00.061037 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9dbc45-3629-4174-99f4-4ab267d4605d admin admin] PATH_INFO: `/v3/projects/908e28c4c31843dc913fe8e61bbb0876/users/320397b319f447c38196094ff613ca44/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:00.076514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9dbc45-3629-4174-99f4-4ab267d4605d admin admin] RBAC: Authorizing `identity:create_grant(project_id=908e28c4c31843dc913fe8e61bbb0876, user_id=320397b319f447c38196094ff613ca44, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:00.079200 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9dbc45-3629-4174-99f4-4ab267d4605d admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:00.158114 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1371/2712] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:45:00 2022] PUT /identity/v3/projects/908e28c4c31843dc913fe8e61bbb0876/users/320397b319f447c38196094ff613ca44/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:45:00.162081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fda48-aa8f-44c5-844e-ce7c8534c74a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:00.172301 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474fda48-aa8f-44c5-844e-ce7c8534c74a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:00.229295 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99bf8c-4d89-49ba-b59e-34a000b1b67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:00.230024 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99bf8c-4d89-49ba-b59e-34a000b1b67c admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:00.230313 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99bf8c-4d89-49ba-b59e-34a000b1b67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:00.230600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99bf8c-4d89-49ba-b59e-34a000b1b67c admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:00.231328 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99bf8c-4d89-49ba-b59e-34a000b1b67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:00.232932 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99bf8c-4d89-49ba-b59e-34a000b1b67c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:00.243100 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1342/2713] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:45:00.247799 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dbc45-3629-4174-99f4-4ab267d4605d admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:00.258282 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9dbc45-3629-4174-99f4-4ab267d4605d admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:00.263483 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da185f-5511-480e-b45a-f13e848d00e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:00.264366 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da185f-5511-480e-b45a-f13e848d00e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:00.264772 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da185f-5511-480e-b45a-f13e848d00e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:00.265052 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da185f-5511-480e-b45a-f13e848d00e1 admin admin] PATH_INFO: `/v3/projects/908e28c4c31843dc913fe8e61bbb0876/users/320397b319f447c38196094ff613ca44/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:00.267502 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da185f-5511-480e-b45a-f13e848d00e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=908e28c4c31843dc913fe8e61bbb0876, user_id=320397b319f447c38196094ff613ca44, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:00.270532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da185f-5511-480e-b45a-f13e848d00e1 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:00.281448 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1372/2714] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:45:00 2022] PUT /identity/v3/projects/908e28c4c31843dc913fe8e61bbb0876/users/320397b319f447c38196094ff613ca44/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:45:00.292538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f41498-59da-4cc9-a0da-f9a54a95c175 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:00.292832 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f41498-59da-4cc9-a0da-f9a54a95c175 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:00.293140 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f41498-59da-4cc9-a0da-f9a54a95c175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:00.322386 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-76f41498-59da-4cc9-a0da-f9a54a95c175 None None] MFA Rules not processed for user `320397b319f447c38196094ff613ca44`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:45:00.324206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-76f41498-59da-4cc9-a0da-f9a54a95c175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:00.420531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1343/2715] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:45:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:45:00.431690 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da185f-5511-480e-b45a-f13e848d00e1 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:00.434388 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-e2da185f-5511-480e-b45a-f13e848d00e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:00.493362 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da185f-5511-480e-b45a-f13e848d00e1 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:00.499141 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1e052-176e-40b9-805e-1c9a0ad7acb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:00.500174 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1e052-176e-40b9-805e-1c9a0ad7acb5 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:00.500488 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1e052-176e-40b9-805e-1c9a0ad7acb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:00.500770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1e052-176e-40b9-805e-1c9a0ad7acb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:00.512217 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1e052-176e-40b9-805e-1c9a0ad7acb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:00.513689 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1e052-176e-40b9-805e-1c9a0ad7acb5 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:00.523460 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1373/2716] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:45:00 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:45:00.658258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f41498-59da-4cc9-a0da-f9a54a95c175 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:00.660094 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-76f41498-59da-4cc9-a0da-f9a54a95c175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:00.667124 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:00.673103 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f41498-59da-4cc9-a0da-f9a54a95c175 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:00.679934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985fa85c-629d-4298-9588-2cdec4527522 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:00.679934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fa85c-629d-4298-9588-2cdec4527522 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:00.679934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fa85c-629d-4298-9588-2cdec4527522 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:00.679934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985fa85c-629d-4298-9588-2cdec4527522 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:00.738080 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985fa85c-629d-4298-9588-2cdec4527522 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:00.739522 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985fa85c-629d-4298-9588-2cdec4527522 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:00.749090 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1344/2717] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:45:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:45:05.071400 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1e052-176e-40b9-805e-1c9a0ad7acb5 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:05.077309 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:05.136623 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1e052-176e-40b9-805e-1c9a0ad7acb5 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:05.141388 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673dcb94-bfba-43a2-8eaf-e9a7cf7ea5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:05.142297 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673dcb94-bfba-43a2-8eaf-e9a7cf7ea5ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:05.142587 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673dcb94-bfba-43a2-8eaf-e9a7cf7ea5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:05.142864 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673dcb94-bfba-43a2-8eaf-e9a7cf7ea5ec admin admin] PATH_INFO: `/v3/users/b4cd6ac6c1344635a0bdd37e7403c4ff` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:05.144077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673dcb94-bfba-43a2-8eaf-e9a7cf7ea5ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4cd6ac6c1344635a0bdd37e7403c4ff)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:05.146254 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673dcb94-bfba-43a2-8eaf-e9a7cf7ea5ec admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:05.439839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-673dcb94-bfba-43a2-8eaf-e9a7cf7ea5ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4cd6ac6c1344635a0bdd37e7403c4ff'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:05.440446 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-673dcb94-bfba-43a2-8eaf-e9a7cf7ea5ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4cd6ac6c1344635a0bdd37e7403c4ff'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:05.441054 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-673dcb94-bfba-43a2-8eaf-e9a7cf7ea5ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4cd6ac6c1344635a0bdd37e7403c4ff'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:05.452873 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-673dcb94-bfba-43a2-8eaf-e9a7cf7ea5ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4cd6ac6c1344635a0bdd37e7403c4ff'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:05.459629 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-673dcb94-bfba-43a2-8eaf-e9a7cf7ea5ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4cd6ac6c1344635a0bdd37e7403c4ff'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:05.530284 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1374/2718] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:45:05 2022] DELETE /identity/v3/users/b4cd6ac6c1344635a0bdd37e7403c4ff => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:45:05.539449 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd538db5-51a1-4b6c-8207-46871af985d1 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:05.539449 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd538db5-51a1-4b6c-8207-46871af985d1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:05.539449 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd538db5-51a1-4b6c-8207-46871af985d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:05.553298 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-bd538db5-51a1-4b6c-8207-46871af985d1 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:45:05.554539 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bd538db5-51a1-4b6c-8207-46871af985d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:05.613683 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1345/2719] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:45:05.623445 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673dcb94-bfba-43a2-8eaf-e9a7cf7ea5ec admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:05.624892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-673dcb94-bfba-43a2-8eaf-e9a7cf7ea5ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:05.682413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673dcb94-bfba-43a2-8eaf-e9a7cf7ea5ec admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:05.686090 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81844090-72a2-4881-a782-fa35a47c45ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:05.686744 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81844090-72a2-4881-a782-fa35a47c45ee service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:05.687044 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81844090-72a2-4881-a782-fa35a47c45ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:05.687315 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81844090-72a2-4881-a782-fa35a47c45ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:05.697179 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81844090-72a2-4881-a782-fa35a47c45ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:05.699964 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81844090-72a2-4881-a782-fa35a47c45ee service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:05.709620 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1375/2720] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:45:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:45:06.822949 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd538db5-51a1-4b6c-8207-46871af985d1 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:06.824452 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bd538db5-51a1-4b6c-8207-46871af985d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:06.836546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd538db5-51a1-4b6c-8207-46871af985d1 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:06.841671 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05afb8-e595-4175-be9f-c88a8158a4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:06.842570 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05afb8-e595-4175-be9f-c88a8158a4ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:06.843001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05afb8-e595-4175-be9f-c88a8158a4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:06.843283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f05afb8-e595-4175-be9f-c88a8158a4ba admin admin] PATH_INFO: `/v3/projects/6ff7303e69364172bf28feb8ece8a5f3` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:06.844468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05afb8-e595-4175-be9f-c88a8158a4ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ff7303e69364172bf28feb8ece8a5f3)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:06.846416 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f05afb8-e595-4175-be9f-c88a8158a4ba admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:07.005525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3f05afb8-e595-4175-be9f-c88a8158a4ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ff7303e69364172bf28feb8ece8a5f3', 'request_id': 'req-3f05afb8-e595-4175-be9f-c88a8158a4ba'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:07.011251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3f05afb8-e595-4175-be9f-c88a8158a4ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ff7303e69364172bf28feb8ece8a5f3', 'request_id': 'req-3f05afb8-e595-4175-be9f-c88a8158a4ba'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:07.017863 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3f05afb8-e595-4175-be9f-c88a8158a4ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ff7303e69364172bf28feb8ece8a5f3', 'request_id': 'req-3f05afb8-e595-4175-be9f-c88a8158a4ba'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:07.095443 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3f05afb8-e595-4175-be9f-c88a8158a4ba admin admin] The token cache is being invalidate because project 6ff7303e69364172bf28feb8ece8a5f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:45:07.095737 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3f05afb8-e595-4175-be9f-c88a8158a4ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:07.143685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3f05afb8-e595-4175-be9f-c88a8158a4ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:07.143685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1346/2721] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:45:06 2022] DELETE /identity/v3/projects/6ff7303e69364172bf28feb8ece8a5f3 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:45:07.144337 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81844090-72a2-4881-a782-fa35a47c45ee service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:07.144337 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81844090-72a2-4881-a782-fa35a47c45ee service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:07.144337 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:07.168931 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96a7a1-89a9-4636-818c-4e3e72e3c8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:07.169837 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96a7a1-89a9-4636-818c-4e3e72e3c8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:07.170122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96a7a1-89a9-4636-818c-4e3e72e3c8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:07.172336 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96a7a1-89a9-4636-818c-4e3e72e3c8e7 admin admin] PATH_INFO: `/v3/users/4aff616b846543e689e36b6676aa1d1e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:07.172336 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96a7a1-89a9-4636-818c-4e3e72e3c8e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aff616b846543e689e36b6676aa1d1e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:07.173456 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96a7a1-89a9-4636-818c-4e3e72e3c8e7 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:07.342255 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ee96a7a1-89a9-4636-818c-4e3e72e3c8e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aff616b846543e689e36b6676aa1d1e'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:07.342845 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ee96a7a1-89a9-4636-818c-4e3e72e3c8e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aff616b846543e689e36b6676aa1d1e'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:07.343461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ee96a7a1-89a9-4636-818c-4e3e72e3c8e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aff616b846543e689e36b6676aa1d1e'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:07.355345 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ee96a7a1-89a9-4636-818c-4e3e72e3c8e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aff616b846543e689e36b6676aa1d1e'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:07.362065 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ee96a7a1-89a9-4636-818c-4e3e72e3c8e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aff616b846543e689e36b6676aa1d1e'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:07.437784 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1376/2722] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:45:07 2022] DELETE /identity/v3/users/4aff616b846543e689e36b6676aa1d1e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:45:07.880666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05afb8-e595-4175-be9f-c88a8158a4ba admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:07.880666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3f05afb8-e595-4175-be9f-c88a8158a4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:07.890260 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f05afb8-e595-4175-be9f-c88a8158a4ba admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:07.912144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:07.949229 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be4eb5-cf6f-4959-bc8b-e72d8c4b7f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:07.950128 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be4eb5-cf6f-4959-bc8b-e72d8c4b7f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:07.950419 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be4eb5-cf6f-4959-bc8b-e72d8c4b7f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:07.950700 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be4eb5-cf6f-4959-bc8b-e72d8c4b7f3a admin admin] PATH_INFO: `/v3/projects/0e0b50dde658476e966abf977867e57b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:07.951912 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be4eb5-cf6f-4959-bc8b-e72d8c4b7f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e0b50dde658476e966abf977867e57b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:07.953848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be4eb5-cf6f-4959-bc8b-e72d8c4b7f3a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:08.101999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-96be4eb5-cf6f-4959-bc8b-e72d8c4b7f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e0b50dde658476e966abf977867e57b', 'request_id': 'req-96be4eb5-cf6f-4959-bc8b-e72d8c4b7f3a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:08.108623 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-96be4eb5-cf6f-4959-bc8b-e72d8c4b7f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e0b50dde658476e966abf977867e57b', 'request_id': 'req-96be4eb5-cf6f-4959-bc8b-e72d8c4b7f3a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:08.114874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-96be4eb5-cf6f-4959-bc8b-e72d8c4b7f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e0b50dde658476e966abf977867e57b', 'request_id': 'req-96be4eb5-cf6f-4959-bc8b-e72d8c4b7f3a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:08.197064 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-96be4eb5-cf6f-4959-bc8b-e72d8c4b7f3a admin admin] The token cache is being invalidate because project 0e0b50dde658476e966abf977867e57b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:45:08.197351 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-96be4eb5-cf6f-4959-bc8b-e72d8c4b7f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:08.198012 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-96be4eb5-cf6f-4959-bc8b-e72d8c4b7f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:08.199568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1347/2723] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:45:07 2022] DELETE /identity/v3/projects/0e0b50dde658476e966abf977867e57b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:45:08.203488 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96a7a1-89a9-4636-818c-4e3e72e3c8e7 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:08.204884 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ee96a7a1-89a9-4636-818c-4e3e72e3c8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:08.217285 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96a7a1-89a9-4636-818c-4e3e72e3c8e7 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:08.271459 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e3d0ef-7629-44f7-8872-1b5a2b0ecf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:08.272339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3d0ef-7629-44f7-8872-1b5a2b0ecf2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:08.272620 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3d0ef-7629-44f7-8872-1b5a2b0ecf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:08.272892 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e3d0ef-7629-44f7-8872-1b5a2b0ecf2b admin admin] PATH_INFO: `/v3/users/320397b319f447c38196094ff613ca44` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:08.274173 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3d0ef-7629-44f7-8872-1b5a2b0ecf2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=320397b319f447c38196094ff613ca44)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:08.276612 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e3d0ef-7629-44f7-8872-1b5a2b0ecf2b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:08.487814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-39e3d0ef-7629-44f7-8872-1b5a2b0ecf2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '320397b319f447c38196094ff613ca44'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:08.488390 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-39e3d0ef-7629-44f7-8872-1b5a2b0ecf2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '320397b319f447c38196094ff613ca44'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:08.489026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-39e3d0ef-7629-44f7-8872-1b5a2b0ecf2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '320397b319f447c38196094ff613ca44'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:08.490193 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:08.501627 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-39e3d0ef-7629-44f7-8872-1b5a2b0ecf2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '320397b319f447c38196094ff613ca44'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:08.508850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-39e3d0ef-7629-44f7-8872-1b5a2b0ecf2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '320397b319f447c38196094ff613ca44'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:08.580936 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1377/2724] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:45:08 2022] DELETE /identity/v3/users/320397b319f447c38196094ff613ca44 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:45:09.166011 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be4eb5-cf6f-4959-bc8b-e72d8c4b7f3a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:09.167508 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-96be4eb5-cf6f-4959-bc8b-e72d8c4b7f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:09.182881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be4eb5-cf6f-4959-bc8b-e72d8c4b7f3a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:09.247699 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e4054f-4169-4482-94b1-92e925e4ceb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:09.248581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4054f-4169-4482-94b1-92e925e4ceb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:09.248878 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4054f-4169-4482-94b1-92e925e4ceb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:09.249155 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e4054f-4169-4482-94b1-92e925e4ceb2 admin admin] PATH_INFO: `/v3/projects/908e28c4c31843dc913fe8e61bbb0876` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:09.250353 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4054f-4169-4482-94b1-92e925e4ceb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=908e28c4c31843dc913fe8e61bbb0876)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:09.252293 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e4054f-4169-4482-94b1-92e925e4ceb2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:09.387725 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-20e4054f-4169-4482-94b1-92e925e4ceb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '908e28c4c31843dc913fe8e61bbb0876', 'request_id': 'req-20e4054f-4169-4482-94b1-92e925e4ceb2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:09.392263 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:09.393446 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-20e4054f-4169-4482-94b1-92e925e4ceb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '908e28c4c31843dc913fe8e61bbb0876', 'request_id': 'req-20e4054f-4169-4482-94b1-92e925e4ceb2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:09.399630 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-20e4054f-4169-4482-94b1-92e925e4ceb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '908e28c4c31843dc913fe8e61bbb0876', 'request_id': 'req-20e4054f-4169-4482-94b1-92e925e4ceb2'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:09.483169 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-20e4054f-4169-4482-94b1-92e925e4ceb2 admin admin] The token cache is being invalidate because project 908e28c4c31843dc913fe8e61bbb0876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:45:09.483455 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-20e4054f-4169-4482-94b1-92e925e4ceb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:09.484077 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-20e4054f-4169-4482-94b1-92e925e4ceb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:09.485620 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1348/2725] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:45:09 2022] DELETE /identity/v3/projects/908e28c4c31843dc913fe8e61bbb0876 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:45:09.491516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83555144-e6d3-4a9c-8eb5-bb3069f72b18 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:09.491987 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83555144-e6d3-4a9c-8eb5-bb3069f72b18 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:09.492102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83555144-e6d3-4a9c-8eb5-bb3069f72b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:09.510467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-83555144-e6d3-4a9c-8eb5-bb3069f72b18 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:45:09.511691 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-83555144-e6d3-4a9c-8eb5-bb3069f72b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:09.569009 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1378/2726] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:45:09.577622 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff2ca4-bbfc-4b74-b07d-31ee57119d2a None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:09.577944 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff2ca4-bbfc-4b74-b07d-31ee57119d2a None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:09.578232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff2ca4-bbfc-4b74-b07d-31ee57119d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:09.596156 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-26ff2ca4-bbfc-4b74-b07d-31ee57119d2a None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:45:09.597414 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-26ff2ca4-bbfc-4b74-b07d-31ee57119d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:09.605965 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1349/2727] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:45:09.610142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83555144-e6d3-4a9c-8eb5-bb3069f72b18 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:09.620405 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83555144-e6d3-4a9c-8eb5-bb3069f72b18 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:09.625046 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5e227-4534-4fa5-bfe7-98680eff853e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:09.625724 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5e227-4534-4fa5-bfe7-98680eff853e admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:09.626128 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5e227-4534-4fa5-bfe7-98680eff853e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:09.626416 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5e227-4534-4fa5-bfe7-98680eff853e admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:09.627145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5e227-4534-4fa5-bfe7-98680eff853e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:45:09.627458 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5e227-4534-4fa5-bfe7-98680eff853e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:09.629070 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5e227-4534-4fa5-bfe7-98680eff853e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:09.640753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1379/2728] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:45:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:45:09.645157 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff2ca4-bbfc-4b74-b07d-31ee57119d2a None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:09.654641 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff2ca4-bbfc-4b74-b07d-31ee57119d2a None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:09.659248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263957bd-a30f-449b-aead-b9c599dbfbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:09.659898 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263957bd-a30f-449b-aead-b9c599dbfbed admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:09.660242 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263957bd-a30f-449b-aead-b9c599dbfbed admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:09.660745 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263957bd-a30f-449b-aead-b9c599dbfbed admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:09.662018 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263957bd-a30f-449b-aead-b9c599dbfbed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:09.664056 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263957bd-a30f-449b-aead-b9c599dbfbed admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:09.771672 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1350/2729] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:45:09 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:45:09.776548 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5e227-4534-4fa5-bfe7-98680eff853e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:09.788977 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5e227-4534-4fa5-bfe7-98680eff853e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:09.844799 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6af4aa-83bf-41d9-9e6a-8216cfa6ba21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:09.845466 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6af4aa-83bf-41d9-9e6a-8216cfa6ba21 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:09.845869 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6af4aa-83bf-41d9-9e6a-8216cfa6ba21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:09.846156 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6af4aa-83bf-41d9-9e6a-8216cfa6ba21 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:09.846834 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6af4aa-83bf-41d9-9e6a-8216cfa6ba21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:09.848796 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6af4aa-83bf-41d9-9e6a-8216cfa6ba21 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:09.947877 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1380/2730] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:45:09 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:45:09.951845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263957bd-a30f-449b-aead-b9c599dbfbed admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:09.962088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263957bd-a30f-449b-aead-b9c599dbfbed admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:09.967435 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2337aca-cf26-45eb-91ec-600715dcc388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:09.968099 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2337aca-cf26-45eb-91ec-600715dcc388 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:09.968389 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2337aca-cf26-45eb-91ec-600715dcc388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:09.968747 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2337aca-cf26-45eb-91ec-600715dcc388 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:09.969482 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2337aca-cf26-45eb-91ec-600715dcc388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:09.971117 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2337aca-cf26-45eb-91ec-600715dcc388 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:09.983460 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1351/2731] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:45:09.987348 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6af4aa-83bf-41d9-9e6a-8216cfa6ba21 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:09.997095 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6af4aa-83bf-41d9-9e6a-8216cfa6ba21 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:10.001675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c3ce9-376d-4bf3-abee-45b54548c887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:10.002360 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c3ce9-376d-4bf3-abee-45b54548c887 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:10.002650 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c3ce9-376d-4bf3-abee-45b54548c887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:10.002932 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c3ce9-376d-4bf3-abee-45b54548c887 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:10.003651 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c3ce9-376d-4bf3-abee-45b54548c887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:10.005267 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c3ce9-376d-4bf3-abee-45b54548c887 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:10.015027 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1381/2732] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:45:10.018876 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2337aca-cf26-45eb-91ec-600715dcc388 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:10.030015 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2337aca-cf26-45eb-91ec-600715dcc388 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:10.034767 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c295e1-a673-46e1-bf66-12446b768e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:10.035622 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c295e1-a673-46e1-bf66-12446b768e20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:10.035901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c295e1-a673-46e1-bf66-12446b768e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:10.036177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c295e1-a673-46e1-bf66-12446b768e20 admin admin] PATH_INFO: `/v3/projects/e3be893ac3314c2caa6d8e3c62dabe59/users/bdca648ae49649019deac994a533b931/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:10.051188 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c295e1-a673-46e1-bf66-12446b768e20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3be893ac3314c2caa6d8e3c62dabe59, user_id=bdca648ae49649019deac994a533b931, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:10.053834 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c295e1-a673-46e1-bf66-12446b768e20 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:10.136990 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1352/2733] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:45:10 2022] PUT /identity/v3/projects/e3be893ac3314c2caa6d8e3c62dabe59/users/bdca648ae49649019deac994a533b931/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:45:10.148254 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd8590-72e6-4957-815a-f3685179a292 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:10.148537 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd8590-72e6-4957-815a-f3685179a292 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:10.148823 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd8590-72e6-4957-815a-f3685179a292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:10.175752 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-1ebd8590-72e6-4957-815a-f3685179a292 None None] MFA Rules not processed for user `bdca648ae49649019deac994a533b931`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:45:10.176972 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1ebd8590-72e6-4957-815a-f3685179a292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:10.195413 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:10.242982 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1382/2734] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:45:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:45:10.255329 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c295e1-a673-46e1-bf66-12446b768e20 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:10.257097 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-30c295e1-a673-46e1-bf66-12446b768e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:10.342707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c295e1-a673-46e1-bf66-12446b768e20 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:10.346614 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c289453-6d66-4492-8897-c7fd2271b97f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:10.347259 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c289453-6d66-4492-8897-c7fd2271b97f service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:10.347544 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c289453-6d66-4492-8897-c7fd2271b97f service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:10.347816 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c289453-6d66-4492-8897-c7fd2271b97f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:10.356745 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c289453-6d66-4492-8897-c7fd2271b97f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:10.358208 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c289453-6d66-4492-8897-c7fd2271b97f service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:10.367908 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1353/2735] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:45:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:45:17.163157 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd8590-72e6-4957-815a-f3685179a292 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:17.164571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1ebd8590-72e6-4957-815a-f3685179a292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:17.231549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebd8590-72e6-4957-815a-f3685179a292 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:17.236048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe314e3-4330-4cf2-9c2f-34721bc47804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:17.236917 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe314e3-4330-4cf2-9c2f-34721bc47804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:17.237205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe314e3-4330-4cf2-9c2f-34721bc47804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:17.237500 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe314e3-4330-4cf2-9c2f-34721bc47804 admin admin] PATH_INFO: `/v3/users/742814e483d649f296054636ac8cb0c6` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:17.238715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe314e3-4330-4cf2-9c2f-34721bc47804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=742814e483d649f296054636ac8cb0c6)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:17.240712 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe314e3-4330-4cf2-9c2f-34721bc47804 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:17.262224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c289453-6d66-4492-8897-c7fd2271b97f service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:17.273651 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c289453-6d66-4492-8897-c7fd2271b97f service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:17.282963 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3fab9-1cd3-4422-b3ec-fb2ec2135e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:17.282963 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3fab9-1cd3-4422-b3ec-fb2ec2135e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:17.282963 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3fab9-1cd3-4422-b3ec-fb2ec2135e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:17.282963 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3fab9-1cd3-4422-b3ec-fb2ec2135e8d admin admin] PATH_INFO: `/v3/users/bdca648ae49649019deac994a533b931` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:17.283360 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3fab9-1cd3-4422-b3ec-fb2ec2135e8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdca648ae49649019deac994a533b931)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:17.283360 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3fab9-1cd3-4422-b3ec-fb2ec2135e8d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:17.521385 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ebe314e3-4330-4cf2-9c2f-34721bc47804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '742814e483d649f296054636ac8cb0c6'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:17.522068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ebe314e3-4330-4cf2-9c2f-34721bc47804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '742814e483d649f296054636ac8cb0c6'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:17.522673 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ebe314e3-4330-4cf2-9c2f-34721bc47804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '742814e483d649f296054636ac8cb0c6'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:17.534677 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ebe314e3-4330-4cf2-9c2f-34721bc47804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '742814e483d649f296054636ac8cb0c6'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:17.541568 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ebe314e3-4330-4cf2-9c2f-34721bc47804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '742814e483d649f296054636ac8cb0c6'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:17.641426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4dc3fab9-1cd3-4422-b3ec-fb2ec2135e8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdca648ae49649019deac994a533b931'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:17.642078 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4dc3fab9-1cd3-4422-b3ec-fb2ec2135e8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdca648ae49649019deac994a533b931'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:17.642767 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4dc3fab9-1cd3-4422-b3ec-fb2ec2135e8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdca648ae49649019deac994a533b931'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:17.650790 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:17.655707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4dc3fab9-1cd3-4422-b3ec-fb2ec2135e8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdca648ae49649019deac994a533b931'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:17.669015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1383/2736] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:45:17 2022] DELETE /identity/v3/users/742814e483d649f296054636ac8cb0c6 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:45:17.673411 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427c874-36e1-4490-bdcd-f2fb802240c2 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:17.673692 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427c874-36e1-4490-bdcd-f2fb802240c2 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:17.674071 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427c874-36e1-4490-bdcd-f2fb802240c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:17.691154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-4427c874-36e1-4490-bdcd-f2fb802240c2 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:45:17.692637 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4427c874-36e1-4490-bdcd-f2fb802240c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:17.725686 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:17.751038 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1384/2737] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:45:17.753054 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-4dc3fab9-1cd3-4422-b3ec-fb2ec2135e8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdca648ae49649019deac994a533b931'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:17.760685 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427c874-36e1-4490-bdcd-f2fb802240c2 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:17.765570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4427c874-36e1-4490-bdcd-f2fb802240c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:17.767487 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1354/2738] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:45:17 2022] DELETE /identity/v3/users/bdca648ae49649019deac994a533b931 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:45:17.771782 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcef925-80e2-439c-b58e-b7a8a6e7952c None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:17.772160 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcef925-80e2-439c-b58e-b7a8a6e7952c None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:17.772446 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcef925-80e2-439c-b58e-b7a8a6e7952c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:17.791526 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-1dcef925-80e2-439c-b58e-b7a8a6e7952c None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:45:17.792791 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1dcef925-80e2-439c-b58e-b7a8a6e7952c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:17.821392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427c874-36e1-4490-bdcd-f2fb802240c2 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:17.854899 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1355/2739] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:45:17.865142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcef925-80e2-439c-b58e-b7a8a6e7952c None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:17.870563 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503e43c-f97e-428f-8c3e-4d732c67be5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:17.871263 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503e43c-f97e-428f-8c3e-4d732c67be5e service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:17.871551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503e43c-f97e-428f-8c3e-4d732c67be5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:17.871874 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503e43c-f97e-428f-8c3e-4d732c67be5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:17.881009 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503e43c-f97e-428f-8c3e-4d732c67be5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:17.882487 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503e43c-f97e-428f-8c3e-4d732c67be5e service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:17.892105 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1385/2740] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:45:17.920597 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcef925-80e2-439c-b58e-b7a8a6e7952c None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:17.924241 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d88be-b5e8-40b9-8a0e-8f128cbeeea6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:17.924893 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d88be-b5e8-40b9-8a0e-8f128cbeeea6 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:17.925183 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d88be-b5e8-40b9-8a0e-8f128cbeeea6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:17.925472 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d88be-b5e8-40b9-8a0e-8f128cbeeea6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:17.934985 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d88be-b5e8-40b9-8a0e-8f128cbeeea6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:17.936437 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d88be-b5e8-40b9-8a0e-8f128cbeeea6 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:17.946704 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1356/2741] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:45:18.378583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503e43c-f97e-428f-8c3e-4d732c67be5e service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:18.380047 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-c503e43c-f97e-428f-8c3e-4d732c67be5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:18.393869 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503e43c-f97e-428f-8c3e-4d732c67be5e service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:18.401694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee42da-250a-4c8b-a4d0-8baf932556c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:18.401893 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d88be-b5e8-40b9-8a0e-8f128cbeeea6 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:18.403327 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee42da-250a-4c8b-a4d0-8baf932556c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:18.403623 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee42da-250a-4c8b-a4d0-8baf932556c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:18.403900 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee42da-250a-4c8b-a4d0-8baf932556c1 admin admin] PATH_INFO: `/v3/projects/7963eb9a579146a1aa22c173b3393479` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:18.405131 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee42da-250a-4c8b-a4d0-8baf932556c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7963eb9a579146a1aa22c173b3393479)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:18.406411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-3c3d88be-b5e8-40b9-8a0e-8f128cbeeea6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:18.407073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee42da-250a-4c8b-a4d0-8baf932556c1 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:18.426481 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d88be-b5e8-40b9-8a0e-8f128cbeeea6 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:18.432128 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61d47a-bce3-49e5-a58e-e3a05247e1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:18.433005 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61d47a-bce3-49e5-a58e-e3a05247e1cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:18.433290 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61d47a-bce3-49e5-a58e-e3a05247e1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:18.433572 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61d47a-bce3-49e5-a58e-e3a05247e1cb admin admin] PATH_INFO: `/v3/projects/e3be893ac3314c2caa6d8e3c62dabe59` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:18.435320 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61d47a-bce3-49e5-a58e-e3a05247e1cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3be893ac3314c2caa6d8e3c62dabe59)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:18.437350 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce61d47a-bce3-49e5-a58e-e3a05247e1cb admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:18.536287 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e3ee42da-250a-4c8b-a4d0-8baf932556c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7963eb9a579146a1aa22c173b3393479', 'request_id': 'req-e3ee42da-250a-4c8b-a4d0-8baf932556c1'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:18.542087 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e3ee42da-250a-4c8b-a4d0-8baf932556c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7963eb9a579146a1aa22c173b3393479', 'request_id': 'req-e3ee42da-250a-4c8b-a4d0-8baf932556c1'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:18.549201 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e3ee42da-250a-4c8b-a4d0-8baf932556c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7963eb9a579146a1aa22c173b3393479', 'request_id': 'req-e3ee42da-250a-4c8b-a4d0-8baf932556c1'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:18.559882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ce61d47a-bce3-49e5-a58e-e3a05247e1cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3be893ac3314c2caa6d8e3c62dabe59', 'request_id': 'req-ce61d47a-bce3-49e5-a58e-e3a05247e1cb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:18.565779 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ce61d47a-bce3-49e5-a58e-e3a05247e1cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3be893ac3314c2caa6d8e3c62dabe59', 'request_id': 'req-ce61d47a-bce3-49e5-a58e-e3a05247e1cb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:18.571952 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ce61d47a-bce3-49e5-a58e-e3a05247e1cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3be893ac3314c2caa6d8e3c62dabe59', 'request_id': 'req-ce61d47a-bce3-49e5-a58e-e3a05247e1cb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:18.661099 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e3ee42da-250a-4c8b-a4d0-8baf932556c1 admin admin] The token cache is being invalidate because project 7963eb9a579146a1aa22c173b3393479 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:45:18.661298 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e3ee42da-250a-4c8b-a4d0-8baf932556c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:18.661919 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-e3ee42da-250a-4c8b-a4d0-8baf932556c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:18.663504 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1386/2742] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:45:18 2022] DELETE /identity/v3/projects/7963eb9a579146a1aa22c173b3393479 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:45:18.752821 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ce61d47a-bce3-49e5-a58e-e3a05247e1cb admin admin] The token cache is being invalidate because project e3be893ac3314c2caa6d8e3c62dabe59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:45:18.753118 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ce61d47a-bce3-49e5-a58e-e3a05247e1cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:18.755140 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ce61d47a-bce3-49e5-a58e-e3a05247e1cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:18.756134 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1357/2743] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:45:18 2022] DELETE /identity/v3/projects/e3be893ac3314c2caa6d8e3c62dabe59 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:45:18.760940 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ea3ee-9585-4711-9533-f08551002e73 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:18.761240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ea3ee-9585-4711-9533-f08551002e73 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:18.761527 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ea3ee-9585-4711-9533-f08551002e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:18.782394 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-817ea3ee-9585-4711-9533-f08551002e73 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:45:18.783641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-817ea3ee-9585-4711-9533-f08551002e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:18.801967 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:18.846997 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1387/2744] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:45:18.856002 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95fff7-751f-4266-ad80-96cfe9a00975 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:18.857545 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95fff7-751f-4266-ad80-96cfe9a00975 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:18.857545 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a95fff7-751f-4266-ad80-96cfe9a00975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:18.863045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:18.875736 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-2a95fff7-751f-4266-ad80-96cfe9a00975 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:45:18.876953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-2a95fff7-751f-4266-ad80-96cfe9a00975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:18.885112 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1358/2745] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:45:18.890324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ea3ee-9585-4711-9533-f08551002e73 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:18.900801 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817ea3ee-9585-4711-9533-f08551002e73 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:18.906018 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae0e35-4841-470a-b656-19e80f8911f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:18.906685 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae0e35-4841-470a-b656-19e80f8911f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:18.907111 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae0e35-4841-470a-b656-19e80f8911f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:18.907394 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae0e35-4841-470a-b656-19e80f8911f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:18.908124 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae0e35-4841-470a-b656-19e80f8911f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:45:18.908435 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae0e35-4841-470a-b656-19e80f8911f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:18.910097 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae0e35-4841-470a-b656-19e80f8911f2 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:18.921800 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1388/2746] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:45:18.926028 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95fff7-751f-4266-ad80-96cfe9a00975 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:18.935547 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a95fff7-751f-4266-ad80-96cfe9a00975 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:18.940549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef6c42-78bb-43e8-831e-7fcbf7fe8544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:18.941199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef6c42-78bb-43e8-831e-7fcbf7fe8544 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:18.941481 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef6c42-78bb-43e8-831e-7fcbf7fe8544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:18.941787 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef6c42-78bb-43e8-831e-7fcbf7fe8544 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:18.942532 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef6c42-78bb-43e8-831e-7fcbf7fe8544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:18.944427 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef6c42-78bb-43e8-831e-7fcbf7fe8544 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:19.068329 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1359/2747] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:45:18 2022] POST /identity/v3/projects => generated 371 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:45:19.072487 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae0e35-4841-470a-b656-19e80f8911f2 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:19.082932 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae0e35-4841-470a-b656-19e80f8911f2 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:19.139227 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de36d4-b4ea-421b-8bb8-81352e375fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:19.139907 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de36d4-b4ea-421b-8bb8-81352e375fce admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:19.140214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de36d4-b4ea-421b-8bb8-81352e375fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:19.140572 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de36d4-b4ea-421b-8bb8-81352e375fce admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:19.141245 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de36d4-b4ea-421b-8bb8-81352e375fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:19.143134 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de36d4-b4ea-421b-8bb8-81352e375fce admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:19.267910 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1389/2748] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:45:19 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:45:19.271921 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef6c42-78bb-43e8-831e-7fcbf7fe8544 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:19.282573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef6c42-78bb-43e8-831e-7fcbf7fe8544 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:19.287283 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11cbc6-62ea-47a7-8587-da53ea79aec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:19.287941 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11cbc6-62ea-47a7-8587-da53ea79aec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:19.288274 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11cbc6-62ea-47a7-8587-da53ea79aec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:19.288555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11cbc6-62ea-47a7-8587-da53ea79aec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:19.289280 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11cbc6-62ea-47a7-8587-da53ea79aec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:19.290910 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af11cbc6-62ea-47a7-8587-da53ea79aec4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:19.300895 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1360/2749] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:45:19.304714 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de36d4-b4ea-421b-8bb8-81352e375fce admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:19.315265 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de36d4-b4ea-421b-8bb8-81352e375fce admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:19.319864 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069f46a-31fd-4941-8a70-d72ec5897e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:19.320509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069f46a-31fd-4941-8a70-d72ec5897e79 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:19.320796 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069f46a-31fd-4941-8a70-d72ec5897e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:19.321076 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069f46a-31fd-4941-8a70-d72ec5897e79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:19.321830 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069f46a-31fd-4941-8a70-d72ec5897e79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:19.323818 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069f46a-31fd-4941-8a70-d72ec5897e79 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:19.334829 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1390/2750] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:45:19.338822 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11cbc6-62ea-47a7-8587-da53ea79aec4 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:19.348933 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11cbc6-62ea-47a7-8587-da53ea79aec4 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:19.353468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942f377-121d-4036-830e-84ab3c54f08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:19.354403 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942f377-121d-4036-830e-84ab3c54f08a admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:19.354686 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942f377-121d-4036-830e-84ab3c54f08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:19.354964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942f377-121d-4036-830e-84ab3c54f08a admin admin] PATH_INFO: `/v3/projects/cfeb440135b24a28aad8dc108ea37fa7/users/75182ca310554c5da6d22360ca942107/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:19.369180 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942f377-121d-4036-830e-84ab3c54f08a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfeb440135b24a28aad8dc108ea37fa7, user_id=75182ca310554c5da6d22360ca942107, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:19.372356 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942f377-121d-4036-830e-84ab3c54f08a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:19.444213 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1361/2751] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:45:19 2022] PUT /identity/v3/projects/cfeb440135b24a28aad8dc108ea37fa7/users/75182ca310554c5da6d22360ca942107/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:45:19.455025 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb89bce-78dc-456b-ba3f-892386b5b1c6 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:19.455485 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb89bce-78dc-456b-ba3f-892386b5b1c6 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:19.455591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb89bce-78dc-456b-ba3f-892386b5b1c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:19.481812 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-9cb89bce-78dc-456b-ba3f-892386b5b1c6 None None] MFA Rules not processed for user `75182ca310554c5da6d22360ca942107`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:45:19.483026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9cb89bce-78dc-456b-ba3f-892386b5b1c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:19.546756 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1391/2752] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:45:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:45:19.551188 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942f377-121d-4036-830e-84ab3c54f08a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:19.612648 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942f377-121d-4036-830e-84ab3c54f08a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:19.617323 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24833186-ff2f-4d43-a279-66fed86c3a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:19.618014 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24833186-ff2f-4d43-a279-66fed86c3a09 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:19.618307 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24833186-ff2f-4d43-a279-66fed86c3a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:19.618594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24833186-ff2f-4d43-a279-66fed86c3a09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:19.619281 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24833186-ff2f-4d43-a279-66fed86c3a09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:19.621839 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24833186-ff2f-4d43-a279-66fed86c3a09 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:19.708660 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1362/2753] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:45:19 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:45:19.712693 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb89bce-78dc-456b-ba3f-892386b5b1c6 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:19.723392 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb89bce-78dc-456b-ba3f-892386b5b1c6 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:19.735751 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:19.778599 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccb023-c8e5-4c28-9e1b-75c51fe58a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:19.779267 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccb023-c8e5-4c28-9e1b-75c51fe58a42 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:19.779553 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccb023-c8e5-4c28-9e1b-75c51fe58a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:19.779867 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ccb023-c8e5-4c28-9e1b-75c51fe58a42 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:19.780932 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ccb023-c8e5-4c28-9e1b-75c51fe58a42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:19.783598 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ccb023-c8e5-4c28-9e1b-75c51fe58a42 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:19.890559 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1392/2754] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:45:19 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:45:19.894645 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24833186-ff2f-4d43-a279-66fed86c3a09 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:19.905558 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24833186-ff2f-4d43-a279-66fed86c3a09 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:19.910232 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55646cb-3e5f-4c40-9286-4e150837db60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:19.911960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55646cb-3e5f-4c40-9286-4e150837db60 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:19.911960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55646cb-3e5f-4c40-9286-4e150837db60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:19.911960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55646cb-3e5f-4c40-9286-4e150837db60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:19.912405 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55646cb-3e5f-4c40-9286-4e150837db60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:19.914043 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55646cb-3e5f-4c40-9286-4e150837db60 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:19.926335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1363/2755] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:45:19.930412 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccb023-c8e5-4c28-9e1b-75c51fe58a42 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:19.940771 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ccb023-c8e5-4c28-9e1b-75c51fe58a42 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:19.945424 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94bcfa-05da-4917-abbc-3e6926ff606b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:19.946333 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94bcfa-05da-4917-abbc-3e6926ff606b admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:19.946619 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94bcfa-05da-4917-abbc-3e6926ff606b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:19.946902 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94bcfa-05da-4917-abbc-3e6926ff606b admin admin] PATH_INFO: `/v3/projects/13b6ec64958f4a16824a4832352d5f22/users/04d41dbfd24a46098cf06d9810a7c211/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:19.961277 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94bcfa-05da-4917-abbc-3e6926ff606b admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b6ec64958f4a16824a4832352d5f22, user_id=04d41dbfd24a46098cf06d9810a7c211, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:19.963951 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94bcfa-05da-4917-abbc-3e6926ff606b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:20.044992 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1393/2756] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:45:19 2022] PUT /identity/v3/projects/13b6ec64958f4a16824a4832352d5f22/users/04d41dbfd24a46098cf06d9810a7c211/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:45:20.048868 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55646cb-3e5f-4c40-9286-4e150837db60 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:20.059149 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55646cb-3e5f-4c40-9286-4e150837db60 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:20.115335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1aec6e-bfb5-48ee-81fd-6effcf939f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:20.116001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1aec6e-bfb5-48ee-81fd-6effcf939f20 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:20.116286 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1aec6e-bfb5-48ee-81fd-6effcf939f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:20.116586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1aec6e-bfb5-48ee-81fd-6effcf939f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:20.117361 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1aec6e-bfb5-48ee-81fd-6effcf939f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:20.119045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1aec6e-bfb5-48ee-81fd-6effcf939f20 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:20.128939 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1364/2757] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:45:20.133313 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94bcfa-05da-4917-abbc-3e6926ff606b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:20.147849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94bcfa-05da-4917-abbc-3e6926ff606b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:20.152616 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db67e5f-d62f-4300-9b0b-5719de154cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:20.154562 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db67e5f-d62f-4300-9b0b-5719de154cd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:20.154854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db67e5f-d62f-4300-9b0b-5719de154cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:20.155134 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db67e5f-d62f-4300-9b0b-5719de154cd7 admin admin] PATH_INFO: `/v3/projects/13b6ec64958f4a16824a4832352d5f22/users/04d41dbfd24a46098cf06d9810a7c211/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:20.158032 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db67e5f-d62f-4300-9b0b-5719de154cd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b6ec64958f4a16824a4832352d5f22, user_id=04d41dbfd24a46098cf06d9810a7c211, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:20.160728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db67e5f-d62f-4300-9b0b-5719de154cd7 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:20.171926 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1394/2758] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:45:20 2022] PUT /identity/v3/projects/13b6ec64958f4a16824a4832352d5f22/users/04d41dbfd24a46098cf06d9810a7c211/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:45:20.182997 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36b15a-e4fa-4877-a75a-63968cd21807 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:20.183287 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36b15a-e4fa-4877-a75a-63968cd21807 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:20.183566 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36b15a-e4fa-4877-a75a-63968cd21807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:20.201826 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:20.210092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-bb36b15a-e4fa-4877-a75a-63968cd21807 None None] MFA Rules not processed for user `04d41dbfd24a46098cf06d9810a7c211`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:45:20.211333 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-bb36b15a-e4fa-4877-a75a-63968cd21807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:20.278868 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1365/2759] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:45:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:45:20.289423 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db67e5f-d62f-4300-9b0b-5719de154cd7 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:20.291174 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4db67e5f-d62f-4300-9b0b-5719de154cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:20.348253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db67e5f-d62f-4300-9b0b-5719de154cd7 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:20.351922 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8641243-dfac-4a4f-bb59-e0598a03d89b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:20.352572 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8641243-dfac-4a4f-bb59-e0598a03d89b service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:20.352859 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8641243-dfac-4a4f-bb59-e0598a03d89b service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:20.353138 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8641243-dfac-4a4f-bb59-e0598a03d89b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:20.408096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8641243-dfac-4a4f-bb59-e0598a03d89b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:20.409461 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8641243-dfac-4a4f-bb59-e0598a03d89b service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:20.418245 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1395/2760] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:45:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:45:23.613820 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36b15a-e4fa-4877-a75a-63968cd21807 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:23.674497 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36b15a-e4fa-4877-a75a-63968cd21807 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:23.678997 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042fb85-e04e-4dc5-bf62-c70e592d9ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:23.679862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042fb85-e04e-4dc5-bf62-c70e592d9ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:23.680144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042fb85-e04e-4dc5-bf62-c70e592d9ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:23.680417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1042fb85-e04e-4dc5-bf62-c70e592d9ef2 admin admin] PATH_INFO: `/v3/users/75182ca310554c5da6d22360ca942107` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:23.681606 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042fb85-e04e-4dc5-bf62-c70e592d9ef2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75182ca310554c5da6d22360ca942107)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:23.683551 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1042fb85-e04e-4dc5-bf62-c70e592d9ef2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:23.886592 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1042fb85-e04e-4dc5-bf62-c70e592d9ef2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75182ca310554c5da6d22360ca942107'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:23.887255 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1042fb85-e04e-4dc5-bf62-c70e592d9ef2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75182ca310554c5da6d22360ca942107'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:23.887891 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1042fb85-e04e-4dc5-bf62-c70e592d9ef2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75182ca310554c5da6d22360ca942107'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:23.900423 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1042fb85-e04e-4dc5-bf62-c70e592d9ef2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75182ca310554c5da6d22360ca942107'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:23.969771 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-1042fb85-e04e-4dc5-bf62-c70e592d9ef2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75182ca310554c5da6d22360ca942107'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:23.982426 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1366/2761] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:45:23 2022] DELETE /identity/v3/users/75182ca310554c5da6d22360ca942107 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:45:23.986934 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc0350-495f-4639-9d20-714912ddd225 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:23.992432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc0350-495f-4639-9d20-714912ddd225 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:23.992432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc0350-495f-4639-9d20-714912ddd225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:24.004738 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-6efc0350-495f-4639-9d20-714912ddd225 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:45:24.005986 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6efc0350-495f-4639-9d20-714912ddd225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:24.024784 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:24.063315 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1396/2762] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:45:24.073125 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042fb85-e04e-4dc5-bf62-c70e592d9ef2 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:24.078741 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-1042fb85-e04e-4dc5-bf62-c70e592d9ef2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:24.089730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:24.132442 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1042fb85-e04e-4dc5-bf62-c70e592d9ef2 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:24.136369 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479e0b7-3f41-44ef-80df-dd880e87e7dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:24.137023 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479e0b7-3f41-44ef-80df-dd880e87e7dc service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:24.137313 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479e0b7-3f41-44ef-80df-dd880e87e7dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:24.137594 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479e0b7-3f41-44ef-80df-dd880e87e7dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:24.149308 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479e0b7-3f41-44ef-80df-dd880e87e7dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:24.150808 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479e0b7-3f41-44ef-80df-dd880e87e7dc service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:24.160490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1367/2763] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:45:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:45:24.533813 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc0350-495f-4639-9d20-714912ddd225 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:24.535327 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-6efc0350-495f-4639-9d20-714912ddd225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:24.548044 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc0350-495f-4639-9d20-714912ddd225 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:24.552718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51642893-b48e-443b-9794-c1befc837d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:24.553618 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51642893-b48e-443b-9794-c1befc837d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:24.554005 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51642893-b48e-443b-9794-c1befc837d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:24.554280 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51642893-b48e-443b-9794-c1befc837d5b admin admin] PATH_INFO: `/v3/projects/cfeb440135b24a28aad8dc108ea37fa7` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:24.555467 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51642893-b48e-443b-9794-c1befc837d5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfeb440135b24a28aad8dc108ea37fa7)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:24.557367 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51642893-b48e-443b-9794-c1befc837d5b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:24.706434 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-51642893-b48e-443b-9794-c1befc837d5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfeb440135b24a28aad8dc108ea37fa7', 'request_id': 'req-51642893-b48e-443b-9794-c1befc837d5b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:24.711945 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-51642893-b48e-443b-9794-c1befc837d5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfeb440135b24a28aad8dc108ea37fa7', 'request_id': 'req-51642893-b48e-443b-9794-c1befc837d5b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:24.718161 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-51642893-b48e-443b-9794-c1befc837d5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfeb440135b24a28aad8dc108ea37fa7', 'request_id': 'req-51642893-b48e-443b-9794-c1befc837d5b'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:24.804335 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-51642893-b48e-443b-9794-c1befc837d5b admin admin] The token cache is being invalidate because project cfeb440135b24a28aad8dc108ea37fa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:45:24.804628 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-51642893-b48e-443b-9794-c1befc837d5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:24.805355 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-51642893-b48e-443b-9794-c1befc837d5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:24.806968 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1397/2764] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:45:24 2022] DELETE /identity/v3/projects/cfeb440135b24a28aad8dc108ea37fa7 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:45:24.810945 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479e0b7-3f41-44ef-80df-dd880e87e7dc service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:24.820989 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479e0b7-3f41-44ef-80df-dd880e87e7dc service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:24.876443 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443a553-2c1b-49b0-9915-30d3cca2d774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:24.877351 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443a553-2c1b-49b0-9915-30d3cca2d774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:24.877659 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443a553-2c1b-49b0-9915-30d3cca2d774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:24.877965 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443a553-2c1b-49b0-9915-30d3cca2d774 admin admin] PATH_INFO: `/v3/users/04d41dbfd24a46098cf06d9810a7c211` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:24.879138 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443a553-2c1b-49b0-9915-30d3cca2d774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04d41dbfd24a46098cf06d9810a7c211)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:24.881114 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443a553-2c1b-49b0-9915-30d3cca2d774 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:25.069099 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6443a553-2c1b-49b0-9915-30d3cca2d774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04d41dbfd24a46098cf06d9810a7c211'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:25.069740 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6443a553-2c1b-49b0-9915-30d3cca2d774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04d41dbfd24a46098cf06d9810a7c211'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:25.070381 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6443a553-2c1b-49b0-9915-30d3cca2d774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04d41dbfd24a46098cf06d9810a7c211'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:25.083087 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6443a553-2c1b-49b0-9915-30d3cca2d774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04d41dbfd24a46098cf06d9810a7c211'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:25.175477 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-6443a553-2c1b-49b0-9915-30d3cca2d774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04d41dbfd24a46098cf06d9810a7c211'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:25.188237 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1368/2765] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:45:24 2022] DELETE /identity/v3/users/04d41dbfd24a46098cf06d9810a7c211 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:45:25.703955 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51642893-b48e-443b-9794-c1befc837d5b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:25.705432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-51642893-b48e-443b-9794-c1befc837d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:25.719689 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51642893-b48e-443b-9794-c1befc837d5b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:25.775613 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942c39a-05c5-462b-9316-da5d222d60d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:25.776600 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942c39a-05c5-462b-9316-da5d222d60d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:25.776881 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942c39a-05c5-462b-9316-da5d222d60d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:25.777154 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942c39a-05c5-462b-9316-da5d222d60d3 admin admin] PATH_INFO: `/v3/projects/13b6ec64958f4a16824a4832352d5f22` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:25.778347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942c39a-05c5-462b-9316-da5d222d60d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b6ec64958f4a16824a4832352d5f22)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:25.780234 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942c39a-05c5-462b-9316-da5d222d60d3 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:25.867220 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0942c39a-05c5-462b-9316-da5d222d60d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b6ec64958f4a16824a4832352d5f22', 'request_id': 'req-0942c39a-05c5-462b-9316-da5d222d60d3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:25.868474 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:25.873173 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0942c39a-05c5-462b-9316-da5d222d60d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b6ec64958f4a16824a4832352d5f22', 'request_id': 'req-0942c39a-05c5-462b-9316-da5d222d60d3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:25.879738 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0942c39a-05c5-462b-9316-da5d222d60d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b6ec64958f4a16824a4832352d5f22', 'request_id': 'req-0942c39a-05c5-462b-9316-da5d222d60d3'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:25.992171 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0942c39a-05c5-462b-9316-da5d222d60d3 admin admin] The token cache is being invalidate because project 13b6ec64958f4a16824a4832352d5f22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:45:25.992391 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0942c39a-05c5-462b-9316-da5d222d60d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:25.993012 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0942c39a-05c5-462b-9316-da5d222d60d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:25.994704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1398/2766] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:45:25 2022] DELETE /identity/v3/projects/13b6ec64958f4a16824a4832352d5f22 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:45:25.999571 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903bb0d-43da-403a-b4cb-ec1194315642 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:26.000659 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903bb0d-43da-403a-b4cb-ec1194315642 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:26.000778 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7903bb0d-43da-403a-b4cb-ec1194315642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:26.018854 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7903bb0d-43da-403a-b4cb-ec1194315642 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:45:26.020076 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7903bb0d-43da-403a-b4cb-ec1194315642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:26.049543 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:26.078410 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1369/2767] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:45:26.140998 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968575c-01ce-40c1-b849-d11f9508bd61 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:26.141287 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968575c-01ce-40c1-b849-d11f9508bd61 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:26.141566 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968575c-01ce-40c1-b849-d11f9508bd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:26.160877 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-5968575c-01ce-40c1-b849-d11f9508bd61 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:45:26.162101 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5968575c-01ce-40c1-b849-d11f9508bd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:26.169869 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1399/2768] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:45:26.174696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903bb0d-43da-403a-b4cb-ec1194315642 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:26.184300 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7903bb0d-43da-403a-b4cb-ec1194315642 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:26.188882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d5868-8e80-46f2-bf35-ba7f1033c19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:26.189534 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d5868-8e80-46f2-bf35-ba7f1033c19e admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:26.190143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d5868-8e80-46f2-bf35-ba7f1033c19e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:26.190435 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d5868-8e80-46f2-bf35-ba7f1033c19e admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:26.191158 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d5868-8e80-46f2-bf35-ba7f1033c19e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:45:26.191468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d5868-8e80-46f2-bf35-ba7f1033c19e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:26.193061 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9d5868-8e80-46f2-bf35-ba7f1033c19e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:26.204693 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1370/2769] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:45:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:45:26.209011 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968575c-01ce-40c1-b849-d11f9508bd61 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:26.218247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5968575c-01ce-40c1-b849-d11f9508bd61 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:26.223558 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7839f-6dbe-487a-8d38-9b1c09fb81b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:26.224207 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7839f-6dbe-487a-8d38-9b1c09fb81b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:26.224493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7839f-6dbe-487a-8d38-9b1c09fb81b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:26.224772 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a7839f-6dbe-487a-8d38-9b1c09fb81b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:26.225459 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7839f-6dbe-487a-8d38-9b1c09fb81b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:26.227409 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a7839f-6dbe-487a-8d38-9b1c09fb81b2 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:26.306218 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1400/2770] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:45:26 2022] POST /identity/v3/projects => generated 389 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:45:26.307419 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d5868-8e80-46f2-bf35-ba7f1033c19e admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:26.317874 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d5868-8e80-46f2-bf35-ba7f1033c19e admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:26.374700 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf77ec2-39f8-485d-9f3c-6ef0c465255b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:26.375365 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf77ec2-39f8-485d-9f3c-6ef0c465255b admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:26.375646 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf77ec2-39f8-485d-9f3c-6ef0c465255b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:26.375920 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf77ec2-39f8-485d-9f3c-6ef0c465255b admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:26.376665 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf77ec2-39f8-485d-9f3c-6ef0c465255b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:26.378617 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf77ec2-39f8-485d-9f3c-6ef0c465255b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:26.477431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1371/2771] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:45:26 2022] POST /identity/v3/users => generated 295 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:45:26.481870 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7839f-6dbe-487a-8d38-9b1c09fb81b2 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:26.492935 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a7839f-6dbe-487a-8d38-9b1c09fb81b2 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:26.497775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b6a82-9c4d-4dc2-b518-d88531fa876c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:26.498439 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b6a82-9c4d-4dc2-b518-d88531fa876c admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:26.498723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b6a82-9c4d-4dc2-b518-d88531fa876c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:26.499019 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b6a82-9c4d-4dc2-b518-d88531fa876c admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:26.499737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b6a82-9c4d-4dc2-b518-d88531fa876c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:26.501360 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b6a82-9c4d-4dc2-b518-d88531fa876c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:26.511748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1401/2772] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:45:26.519738 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf77ec2-39f8-485d-9f3c-6ef0c465255b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:26.526139 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf77ec2-39f8-485d-9f3c-6ef0c465255b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:26.530792 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022654a-1f8c-4432-99c9-96d325337071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:26.531960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022654a-1f8c-4432-99c9-96d325337071 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:26.532249 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022654a-1f8c-4432-99c9-96d325337071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:26.532531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022654a-1f8c-4432-99c9-96d325337071 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:26.533251 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022654a-1f8c-4432-99c9-96d325337071 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:26.534876 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022654a-1f8c-4432-99c9-96d325337071 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:26.544932 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1372/2773] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:45:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:45:26.549526 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b6a82-9c4d-4dc2-b518-d88531fa876c admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:26.559171 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b6a82-9c4d-4dc2-b518-d88531fa876c admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:26.563653 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d4312-b9bb-4680-815e-ef2e04efa2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:26.564547 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d4312-b9bb-4680-815e-ef2e04efa2d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:26.564827 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d4312-b9bb-4680-815e-ef2e04efa2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:26.565356 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d4312-b9bb-4680-815e-ef2e04efa2d0 admin admin] PATH_INFO: `/v3/projects/d1472c7ba2f6489b87646b480858fbbb/users/aeb4fbd0aa7741ad909a009b0f0bd270/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:26.581408 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d4312-b9bb-4680-815e-ef2e04efa2d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1472c7ba2f6489b87646b480858fbbb, user_id=aeb4fbd0aa7741ad909a009b0f0bd270, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:26.584073 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d4312-b9bb-4680-815e-ef2e04efa2d0 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:26.667672 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1402/2774] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:45:26 2022] PUT /identity/v3/projects/d1472c7ba2f6489b87646b480858fbbb/users/aeb4fbd0aa7741ad909a009b0f0bd270/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:45:26.677663 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32ab07-57bc-418d-85ab-0c6633a7eb26 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:26.678102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32ab07-57bc-418d-85ab-0c6633a7eb26 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:26.678386 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32ab07-57bc-418d-85ab-0c6633a7eb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:26.706335 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-fc32ab07-57bc-418d-85ab-0c6633a7eb26 None None] MFA Rules not processed for user `aeb4fbd0aa7741ad909a009b0f0bd270`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:45:26.707738 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fc32ab07-57bc-418d-85ab-0c6633a7eb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:26.770937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1373/2775] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:45:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:45:26.782501 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d4312-b9bb-4680-815e-ef2e04efa2d0 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:26.785025 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9c7d4312-b9bb-4680-815e-ef2e04efa2d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:26.847844 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d4312-b9bb-4680-815e-ef2e04efa2d0 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:26.851637 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f41022-167b-4dc9-acfe-da6f3ff628e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:26.852287 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f41022-167b-4dc9-acfe-da6f3ff628e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:26.852574 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f41022-167b-4dc9-acfe-da6f3ff628e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:26.852854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f41022-167b-4dc9-acfe-da6f3ff628e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:26.861300 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f41022-167b-4dc9-acfe-da6f3ff628e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:26.862771 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f41022-167b-4dc9-acfe-da6f3ff628e8 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:26.872287 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1403/2776] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:45:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:45:36.768040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:36.867611 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:DELETE=3,keystone:SELECT=59,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:38.597210 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32ab07-57bc-418d-85ab-0c6633a7eb26 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:38.659457 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32ab07-57bc-418d-85ab-0c6633a7eb26 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:38.664114 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252bc1a-8750-43ef-aeaf-98b97e2b543a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:38.664978 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252bc1a-8750-43ef-aeaf-98b97e2b543a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:38.665268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252bc1a-8750-43ef-aeaf-98b97e2b543a admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:38.665582 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252bc1a-8750-43ef-aeaf-98b97e2b543a admin admin] PATH_INFO: `/v3/users/aeb4fbd0aa7741ad909a009b0f0bd270` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:38.666809 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252bc1a-8750-43ef-aeaf-98b97e2b543a admin admin] RBAC: Authorizing `identity:delete_user(user_id=aeb4fbd0aa7741ad909a009b0f0bd270)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:38.668755 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252bc1a-8750-43ef-aeaf-98b97e2b543a admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:38.937928 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaccc9b-0e24-43de-90df-4696dd91af6a None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:38.938428 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaccc9b-0e24-43de-90df-4696dd91af6a None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:38.938550 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaccc9b-0e24-43de-90df-4696dd91af6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:38.955747 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-caaccc9b-0e24-43de-90df-4696dd91af6a None None] MFA Rules not processed for user `ec9f325ac8e746fbb201640419c27548`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:45:38.956989 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-caaccc9b-0e24-43de-90df-4696dd91af6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:39.007860 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d252bc1a-8750-43ef-aeaf-98b97e2b543a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aeb4fbd0aa7741ad909a009b0f0bd270'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:39.008612 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d252bc1a-8750-43ef-aeaf-98b97e2b543a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aeb4fbd0aa7741ad909a009b0f0bd270'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:39.009268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d252bc1a-8750-43ef-aeaf-98b97e2b543a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aeb4fbd0aa7741ad909a009b0f0bd270'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:39.013015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1404/2777] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:45:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:45:39.022163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d252bc1a-8750-43ef-aeaf-98b97e2b543a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aeb4fbd0aa7741ad909a009b0f0bd270'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:39.095634 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-d252bc1a-8750-43ef-aeaf-98b97e2b543a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aeb4fbd0aa7741ad909a009b0f0bd270'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:39.109779 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1374/2778] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:45:38 2022] DELETE /identity/v3/users/aeb4fbd0aa7741ad909a009b0f0bd270 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:45:39.114946 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9e303-2cd3-4c9b-a41c-d52d09b313cc None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:39.115238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9e303-2cd3-4c9b-a41c-d52d09b313cc None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:39.115543 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9e303-2cd3-4c9b-a41c-d52d09b313cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:39.133739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-76f9e303-2cd3-4c9b-a41c-d52d09b313cc None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:45:39.137319 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-76f9e303-2cd3-4c9b-a41c-d52d09b313cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:39.197564 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1405/2779] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:45:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:45:39.213132 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252bc1a-8750-43ef-aeaf-98b97e2b543a admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:39.214567 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-d252bc1a-8750-43ef-aeaf-98b97e2b543a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:39.272844 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252bc1a-8750-43ef-aeaf-98b97e2b543a admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:39.276507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8c6f4-b5a3-4517-bc5f-889cec3fd9a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:39.277167 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8c6f4-b5a3-4517-bc5f-889cec3fd9a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:39.277458 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8c6f4-b5a3-4517-bc5f-889cec3fd9a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:39.277786 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8c6f4-b5a3-4517-bc5f-889cec3fd9a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:39.287692 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8c6f4-b5a3-4517-bc5f-889cec3fd9a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:39.289140 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8c6f4-b5a3-4517-bc5f-889cec3fd9a2 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:39.298995 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1375/2780] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:45:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:45:39.983083 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9e303-2cd3-4c9b-a41c-d52d09b313cc None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:39.984298 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-76f9e303-2cd3-4c9b-a41c-d52d09b313cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:40.018492 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9e303-2cd3-4c9b-a41c-d52d09b313cc None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:40.032568 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562cc451-8b39-434c-8288-b0f6adfedbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:40.033463 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cc451-8b39-434c-8288-b0f6adfedbf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:40.033781 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cc451-8b39-434c-8288-b0f6adfedbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:40.034065 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562cc451-8b39-434c-8288-b0f6adfedbf8 admin admin] PATH_INFO: `/v3/projects/d1472c7ba2f6489b87646b480858fbbb` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:40.041883 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562cc451-8b39-434c-8288-b0f6adfedbf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1472c7ba2f6489b87646b480858fbbb)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:40.041883 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562cc451-8b39-434c-8288-b0f6adfedbf8 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:40.187583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-562cc451-8b39-434c-8288-b0f6adfedbf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1472c7ba2f6489b87646b480858fbbb', 'request_id': 'req-562cc451-8b39-434c-8288-b0f6adfedbf8'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:40.193814 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-562cc451-8b39-434c-8288-b0f6adfedbf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1472c7ba2f6489b87646b480858fbbb', 'request_id': 'req-562cc451-8b39-434c-8288-b0f6adfedbf8'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:40.199868 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-562cc451-8b39-434c-8288-b0f6adfedbf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1472c7ba2f6489b87646b480858fbbb', 'request_id': 'req-562cc451-8b39-434c-8288-b0f6adfedbf8'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:40.278225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-562cc451-8b39-434c-8288-b0f6adfedbf8 admin admin] The token cache is being invalidate because project d1472c7ba2f6489b87646b480858fbbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:45:40.282605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-562cc451-8b39-434c-8288-b0f6adfedbf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:40.282605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-562cc451-8b39-434c-8288-b0f6adfedbf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:45:40.282605 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1406/2781] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:45:39 2022] DELETE /identity/v3/projects/d1472c7ba2f6489b87646b480858fbbb => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:45:40.286239 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179e8d6-c6e8-4ab2-93b0-8dc0af78584d None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:40.286709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179e8d6-c6e8-4ab2-93b0-8dc0af78584d None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:40.286819 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179e8d6-c6e8-4ab2-93b0-8dc0af78584d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:40.306915 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7179e8d6-c6e8-4ab2-93b0-8dc0af78584d None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:45:40.308268 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7179e8d6-c6e8-4ab2-93b0-8dc0af78584d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:40.327445 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:40.385135 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1376/2782] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:45:40.387101 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85038553-8f3c-41b6-8718-f1891b1542cf None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:40.387536 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85038553-8f3c-41b6-8718-f1891b1542cf None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:40.387927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85038553-8f3c-41b6-8718-f1891b1542cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:40.407893 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-85038553-8f3c-41b6-8718-f1891b1542cf None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:45:40.410294 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-85038553-8f3c-41b6-8718-f1891b1542cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:40.418770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1407/2783] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:45:40.423422 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179e8d6-c6e8-4ab2-93b0-8dc0af78584d None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:40.433362 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7179e8d6-c6e8-4ab2-93b0-8dc0af78584d None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:40.438075 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d578814-c553-419e-93a7-b2c29c923449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:40.438741 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d578814-c553-419e-93a7-b2c29c923449 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:40.439029 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d578814-c553-419e-93a7-b2c29c923449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:40.439309 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d578814-c553-419e-93a7-b2c29c923449 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:40.440034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d578814-c553-419e-93a7-b2c29c923449 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:45:40.441142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d578814-c553-419e-93a7-b2c29c923449 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:40.442781 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d578814-c553-419e-93a7-b2c29c923449 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:40.455590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1377/2784] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:45:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:45:40.460301 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85038553-8f3c-41b6-8718-f1891b1542cf None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:40.469595 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85038553-8f3c-41b6-8718-f1891b1542cf None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:40.474340 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c1471-acdb-4548-b323-bbac18817968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:40.474990 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c1471-acdb-4548-b323-bbac18817968 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:40.475273 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c1471-acdb-4548-b323-bbac18817968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:40.475549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c1471-acdb-4548-b323-bbac18817968 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:40.476235 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c1471-acdb-4548-b323-bbac18817968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:40.478170 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c1471-acdb-4548-b323-bbac18817968 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:40.577324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:40.584522 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1408/2785] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:45:40 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:45:40.588758 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d578814-c553-419e-93a7-b2c29c923449 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:40.599110 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d578814-c553-419e-93a7-b2c29c923449 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:40.655393 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded3db6-9db5-4f50-abfe-1da165135f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:40.656100 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded3db6-9db5-4f50-abfe-1da165135f9c admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:40.656390 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded3db6-9db5-4f50-abfe-1da165135f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:40.656670 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded3db6-9db5-4f50-abfe-1da165135f9c admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:40.657358 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded3db6-9db5-4f50-abfe-1da165135f9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:40.659307 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ded3db6-9db5-4f50-abfe-1da165135f9c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:40.776699 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1378/2786] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:45:40 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:45:40.780713 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c1471-acdb-4548-b323-bbac18817968 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:40.791647 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c1471-acdb-4548-b323-bbac18817968 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:40.796229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee1ce9-aeb7-4b0e-8776-6a456d4eab4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:40.796886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee1ce9-aeb7-4b0e-8776-6a456d4eab4a admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:40.797174 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee1ce9-aeb7-4b0e-8776-6a456d4eab4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:40.797453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee1ce9-aeb7-4b0e-8776-6a456d4eab4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:40.798249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee1ce9-aeb7-4b0e-8776-6a456d4eab4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:40.799843 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee1ce9-aeb7-4b0e-8776-6a456d4eab4a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:40.810064 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1409/2787] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:45:40.821407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded3db6-9db5-4f50-abfe-1da165135f9c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:40.832106 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ded3db6-9db5-4f50-abfe-1da165135f9c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:40.836807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd6ff28-4dd3-4e74-8374-aa14ad275f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:40.837461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6ff28-4dd3-4e74-8374-aa14ad275f13 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:40.837781 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6ff28-4dd3-4e74-8374-aa14ad275f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:40.838066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6ff28-4dd3-4e74-8374-aa14ad275f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:40.838788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6ff28-4dd3-4e74-8374-aa14ad275f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:40.840380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd6ff28-4dd3-4e74-8374-aa14ad275f13 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:40.850984 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1379/2788] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:45:40.855245 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee1ce9-aeb7-4b0e-8776-6a456d4eab4a admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:40.865251 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee1ce9-aeb7-4b0e-8776-6a456d4eab4a admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:40.869827 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812efe1-b3c5-4053-bf5d-d78009481603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:40.870699 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812efe1-b3c5-4053-bf5d-d78009481603 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:40.870977 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812efe1-b3c5-4053-bf5d-d78009481603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:40.871251 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812efe1-b3c5-4053-bf5d-d78009481603 admin admin] PATH_INFO: `/v3/projects/6aa8569ef61543bab87b0c54e0850f15/users/ce69ea470ab64af082e96ffd29934dab/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:40.885334 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812efe1-b3c5-4053-bf5d-d78009481603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa8569ef61543bab87b0c54e0850f15, user_id=ce69ea470ab64af082e96ffd29934dab, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:40.887981 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812efe1-b3c5-4053-bf5d-d78009481603 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:41.022224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1410/2789] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:45:40 2022] PUT /identity/v3/projects/6aa8569ef61543bab87b0c54e0850f15/users/ce69ea470ab64af082e96ffd29934dab/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:45:41.027439 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364bae6-090d-4417-a672-3861491667ed None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:41.027678 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364bae6-090d-4417-a672-3861491667ed None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:41.027964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364bae6-090d-4417-a672-3861491667ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:41.046304 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-5364bae6-090d-4417-a672-3861491667ed None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:45:41.047517 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-5364bae6-090d-4417-a672-3861491667ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:41.106630 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1380/2790] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:45:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:45:41.117238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812efe1-b3c5-4053-bf5d-d78009481603 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:41.118991 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5812efe1-b3c5-4053-bf5d-d78009481603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:41.185898 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812efe1-b3c5-4053-bf5d-d78009481603 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:41.189780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291c85f-9a87-48c3-8ade-5874dfc9158b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:41.191224 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291c85f-9a87-48c3-8ade-5874dfc9158b service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:41.191503 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291c85f-9a87-48c3-8ade-5874dfc9158b service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:41.191775 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291c85f-9a87-48c3-8ade-5874dfc9158b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:41.201045 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291c85f-9a87-48c3-8ade-5874dfc9158b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:41.202522 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c291c85f-9a87-48c3-8ade-5874dfc9158b service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:41.212476 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1411/2791] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:45:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:45:46.946064 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95de3c-eaab-4191-b3c1-bb8b4bd1ecdb None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:46.946578 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95de3c-eaab-4191-b3c1-bb8b4bd1ecdb None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:46.946678 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d95de3c-eaab-4191-b3c1-bb8b4bd1ecdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:46.976427 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-9d95de3c-eaab-4191-b3c1-bb8b4bd1ecdb None None] MFA Rules not processed for user `ce69ea470ab64af082e96ffd29934dab`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:45:46.977724 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-9d95de3c-eaab-4191-b3c1-bb8b4bd1ecdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:46.996602 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:47.049425 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1381/2792] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:45:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:45:47.054285 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291c85f-9a87-48c3-8ade-5874dfc9158b service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:47.064333 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291c85f-9a87-48c3-8ade-5874dfc9158b service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:47.069877 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6b1cf-1f56-47a3-8aeb-bb7064fcd82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:47.070578 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6b1cf-1f56-47a3-8aeb-bb7064fcd82e admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:47.070870 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6b1cf-1f56-47a3-8aeb-bb7064fcd82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:47.071148 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6b1cf-1f56-47a3-8aeb-bb7064fcd82e admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:47.071863 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6b1cf-1f56-47a3-8aeb-bb7064fcd82e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:47.073818 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e6b1cf-1f56-47a3-8aeb-bb7064fcd82e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:47.183780 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1412/2793] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:45:47 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:45:47.187881 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95de3c-eaab-4191-b3c1-bb8b4bd1ecdb None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:47.199938 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d95de3c-eaab-4191-b3c1-bb8b4bd1ecdb None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:47.256135 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec4bb0-f87d-4c03-982e-ae50a6b0011b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:47.256806 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec4bb0-f87d-4c03-982e-ae50a6b0011b admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:47.257092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec4bb0-f87d-4c03-982e-ae50a6b0011b admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:47.257370 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec4bb0-f87d-4c03-982e-ae50a6b0011b admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:47.258093 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec4bb0-f87d-4c03-982e-ae50a6b0011b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:47.260001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec4bb0-f87d-4c03-982e-ae50a6b0011b admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:47.336192 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1382/2794] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:45:47 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:45:47.340248 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6b1cf-1f56-47a3-8aeb-bb7064fcd82e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:47.350527 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6b1cf-1f56-47a3-8aeb-bb7064fcd82e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:47.355372 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d67a2-c8be-48c7-9118-bfcd3827f16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:47.356042 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d67a2-c8be-48c7-9118-bfcd3827f16e admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:47.356320 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d67a2-c8be-48c7-9118-bfcd3827f16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:47.356602 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636d67a2-c8be-48c7-9118-bfcd3827f16e admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:47.357365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d67a2-c8be-48c7-9118-bfcd3827f16e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:47.359088 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636d67a2-c8be-48c7-9118-bfcd3827f16e admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:47.370515 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1413/2795] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:45:47.374727 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec4bb0-f87d-4c03-982e-ae50a6b0011b admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:47.385521 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec4bb0-f87d-4c03-982e-ae50a6b0011b admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:47.390118 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304810e8-a594-4232-9368-c65a3449d0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:47.391066 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304810e8-a594-4232-9368-c65a3449d0f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:47.391523 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304810e8-a594-4232-9368-c65a3449d0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:47.391852 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304810e8-a594-4232-9368-c65a3449d0f5 admin admin] PATH_INFO: `/v3/projects/8d0d9f4534bd447ba9753e920f49ca2b/users/e369434cc4f6451ea32a4f0d0d12140f/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:47.407299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304810e8-a594-4232-9368-c65a3449d0f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d0d9f4534bd447ba9753e920f49ca2b, user_id=e369434cc4f6451ea32a4f0d0d12140f, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:47.409969 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304810e8-a594-4232-9368-c65a3449d0f5 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:47.547699 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1383/2796] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:45:47 2022] PUT /identity/v3/projects/8d0d9f4534bd447ba9753e920f49ca2b/users/e369434cc4f6451ea32a4f0d0d12140f/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:45:47.552194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d67a2-c8be-48c7-9118-bfcd3827f16e admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:47.562286 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636d67a2-c8be-48c7-9118-bfcd3827f16e admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:47.625438 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a307dc-c937-481d-acd8-734a9eeab737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:47.626238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a307dc-c937-481d-acd8-734a9eeab737 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:47.626584 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a307dc-c937-481d-acd8-734a9eeab737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:47.626924 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a307dc-c937-481d-acd8-734a9eeab737 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:47.627745 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a307dc-c937-481d-acd8-734a9eeab737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:47.629436 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a307dc-c937-481d-acd8-734a9eeab737 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:47.643145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1414/2797] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:45:47.645341 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304810e8-a594-4232-9368-c65a3449d0f5 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:47.656646 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304810e8-a594-4232-9368-c65a3449d0f5 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:47.661774 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5872d8-3671-478a-9d65-76feac159ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:47.662674 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5872d8-3671-478a-9d65-76feac159ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:47.662964 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5872d8-3671-478a-9d65-76feac159ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:47.663246 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5872d8-3671-478a-9d65-76feac159ac3 admin admin] PATH_INFO: `/v3/projects/8d0d9f4534bd447ba9753e920f49ca2b/users/e369434cc4f6451ea32a4f0d0d12140f/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:47.665276 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5872d8-3671-478a-9d65-76feac159ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d0d9f4534bd447ba9753e920f49ca2b, user_id=e369434cc4f6451ea32a4f0d0d12140f, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:47.668061 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5872d8-3671-478a-9d65-76feac159ac3 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:47.680079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1384/2798] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:45:47 2022] PUT /identity/v3/projects/8d0d9f4534bd447ba9753e920f49ca2b/users/e369434cc4f6451ea32a4f0d0d12140f/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:45:53.182874 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9256b-446c-42df-91e0-5cf40ecf89b0 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:53.190369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9256b-446c-42df-91e0-5cf40ecf89b0 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:53.190369 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f9256b-446c-42df-91e0-5cf40ecf89b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:53.214802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-00f9256b-446c-42df-91e0-5cf40ecf89b0 None None] MFA Rules not processed for user `e369434cc4f6451ea32a4f0d0d12140f`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:45:53.216102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-00f9256b-446c-42df-91e0-5cf40ecf89b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:53.235070 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:53.285416 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1415/2799] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:45:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:45:53.299862 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5872d8-3671-478a-9d65-76feac159ac3 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:45:53.302914 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-ed5872d8-3671-478a-9d65-76feac159ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:53.374750 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:45:53.409409 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5872d8-3671-478a-9d65-76feac159ac3 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:45:53.419034 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfe2f3-188c-45b7-b054-91206a465e43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:45:53.419720 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfe2f3-188c-45b7-b054-91206a465e43 service nova] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:53.420010 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfe2f3-188c-45b7-b054-91206a465e43 service nova] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:53.420296 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdfe2f3-188c-45b7-b054-91206a465e43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:53.480431 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfe2f3-188c-45b7-b054-91206a465e43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:45:53.482169 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdfe2f3-188c-45b7-b054-91206a465e43 service nova] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:45:53.493519 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1385/2800] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:45:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:45:56.127172 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baa5ff-4bcc-48e0-949d-a4f2a4e47eaf None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:45:56.127703 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baa5ff-4bcc-48e0-949d-a4f2a4e47eaf None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:45:56.127817 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60baa5ff-4bcc-48e0-949d-a4f2a4e47eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:45:56.146380 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-60baa5ff-4bcc-48e0-949d-a4f2a4e47eaf None None] MFA Rules not processed for user `ce69ea470ab64af082e96ffd29934dab`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:45:56.149561 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-60baa5ff-4bcc-48e0-949d-a4f2a4e47eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:45:56.154670 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1416/2801] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:45:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:46:03.537580 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=36 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:06.140350 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=23 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:10.997456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfe2f3-188c-45b7-b054-91206a465e43 service nova] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:46:11.050901 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdfe2f3-188c-45b7-b054-91206a465e43 service nova] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:46:11.054506 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c37a20-d393-4e71-8df1-09d194306745 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:46:11.055143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c37a20-d393-4e71-8df1-09d194306745 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:46:11.055435 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c37a20-d393-4e71-8df1-09d194306745 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:46:11.055708 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c37a20-d393-4e71-8df1-09d194306745 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:46:11.057488 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e2c37a20-d393-4e71-8df1-09d194306745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:46:11.067133 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c37a20-d393-4e71-8df1-09d194306745 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:46:11.068551 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c37a20-d393-4e71-8df1-09d194306745 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:46:11.077000 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1386/2802] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:46:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:46:21.073476 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=26 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:27.064016 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60baa5ff-4bcc-48e0-949d-a4f2a4e47eaf None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:46:27.073722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60baa5ff-4bcc-48e0-949d-a4f2a4e47eaf None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:46:27.077402 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d58e50-50ea-4036-94d8-db0e2e376243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:46:27.078098 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d58e50-50ea-4036-94d8-db0e2e376243 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:46:27.078387 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d58e50-50ea-4036-94d8-db0e2e376243 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:46:27.078667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d58e50-50ea-4036-94d8-db0e2e376243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:46:27.088209 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d58e50-50ea-4036-94d8-db0e2e376243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:46:27.089640 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d58e50-50ea-4036-94d8-db0e2e376243 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:46:27.099159 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1417/2803] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:46:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:46:37.094988 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=6 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:43.368075 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c37a20-d393-4e71-8df1-09d194306745 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:46:43.370040 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e2c37a20-d393-4e71-8df1-09d194306745 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:46:43.424951 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c37a20-d393-4e71-8df1-09d194306745 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:46:43.428535 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c04240-3832-4520-b306-a92053e69aef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:46:43.429227 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c04240-3832-4520-b306-a92053e69aef service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:46:43.429547 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c04240-3832-4520-b306-a92053e69aef service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:46:43.429859 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c04240-3832-4520-b306-a92053e69aef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:46:43.432182 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-61c04240-3832-4520-b306-a92053e69aef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:46:43.445596 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c04240-3832-4520-b306-a92053e69aef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:46:43.447144 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c04240-3832-4520-b306-a92053e69aef service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:46:43.458165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1387/2804] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:46:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:46:49.244912 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d58e50-50ea-4036-94d8-db0e2e376243 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:46:49.253464 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d58e50-50ea-4036-94d8-db0e2e376243 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:46:49.257095 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b37766-0a2b-40e0-a1ae-0891a24a5d63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:46:49.257756 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b37766-0a2b-40e0-a1ae-0891a24a5d63 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:46:49.258047 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b37766-0a2b-40e0-a1ae-0891a24a5d63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:46:49.258329 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b37766-0a2b-40e0-a1ae-0891a24a5d63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:46:49.260093 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-08b37766-0a2b-40e0-a1ae-0891a24a5d63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:46:49.273802 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b37766-0a2b-40e0-a1ae-0891a24a5d63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:46:49.275211 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b37766-0a2b-40e0-a1ae-0891a24a5d63 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:46:49.286730 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1418/2805] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:46:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:46:53.453206 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=26 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:46:59.281886 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=6 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:01.382475 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c04240-3832-4520-b306-a92053e69aef service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:01.383097 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-61c04240-3832-4520-b306-a92053e69aef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:01.450583 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c04240-3832-4520-b306-a92053e69aef service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:01.455319 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45051b9d-d9fd-49eb-a35d-bb92655ed3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:01.456190 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45051b9d-d9fd-49eb-a35d-bb92655ed3cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:01.456479 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45051b9d-d9fd-49eb-a35d-bb92655ed3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:01.456760 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45051b9d-d9fd-49eb-a35d-bb92655ed3cc admin admin] PATH_INFO: `/v3/users/ec9f325ac8e746fbb201640419c27548` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:01.457991 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45051b9d-d9fd-49eb-a35d-bb92655ed3cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec9f325ac8e746fbb201640419c27548)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:01.459969 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45051b9d-d9fd-49eb-a35d-bb92655ed3cc admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:01.698782 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-45051b9d-d9fd-49eb-a35d-bb92655ed3cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec9f325ac8e746fbb201640419c27548'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:01.699349 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-45051b9d-d9fd-49eb-a35d-bb92655ed3cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec9f325ac8e746fbb201640419c27548'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:01.700624 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-45051b9d-d9fd-49eb-a35d-bb92655ed3cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec9f325ac8e746fbb201640419c27548'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:01.712675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-45051b9d-d9fd-49eb-a35d-bb92655ed3cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec9f325ac8e746fbb201640419c27548'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:01.792549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-45051b9d-d9fd-49eb-a35d-bb92655ed3cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec9f325ac8e746fbb201640419c27548'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:01.810429 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1388/2806] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:47:01 2022] DELETE /identity/v3/users/ec9f325ac8e746fbb201640419c27548 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:47:02.073753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b37766-0a2b-40e0-a1ae-0891a24a5d63 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:02.087181 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b37766-0a2b-40e0-a1ae-0891a24a5d63 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:02.150007 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45397a0-db22-47fe-8268-229de560bee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:02.150883 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45397a0-db22-47fe-8268-229de560bee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:02.151162 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45397a0-db22-47fe-8268-229de560bee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:02.151436 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45397a0-db22-47fe-8268-229de560bee0 admin admin] PATH_INFO: `/v3/projects/46a8fce9b274470e9e376dd855254739` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:02.152600 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45397a0-db22-47fe-8268-229de560bee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46a8fce9b274470e9e376dd855254739)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:02.155151 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45397a0-db22-47fe-8268-229de560bee0 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:02.288950 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d45397a0-db22-47fe-8268-229de560bee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46a8fce9b274470e9e376dd855254739', 'request_id': 'req-d45397a0-db22-47fe-8268-229de560bee0'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:02.294790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d45397a0-db22-47fe-8268-229de560bee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46a8fce9b274470e9e376dd855254739', 'request_id': 'req-d45397a0-db22-47fe-8268-229de560bee0'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:02.301015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d45397a0-db22-47fe-8268-229de560bee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46a8fce9b274470e9e376dd855254739', 'request_id': 'req-d45397a0-db22-47fe-8268-229de560bee0'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:02.392371 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d45397a0-db22-47fe-8268-229de560bee0 admin admin] The token cache is being invalidate because project 46a8fce9b274470e9e376dd855254739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:47:02.392691 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d45397a0-db22-47fe-8268-229de560bee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:02.393328 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-d45397a0-db22-47fe-8268-229de560bee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:02.394998 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1419/2807] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:47:02 2022] DELETE /identity/v3/projects/46a8fce9b274470e9e376dd855254739 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:47:02.400062 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392fd8b-1289-4a5a-9b39-188fa08b37eb None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:02.400524 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392fd8b-1289-4a5a-9b39-188fa08b37eb None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:02.400646 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b392fd8b-1289-4a5a-9b39-188fa08b37eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:02.418712 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-b392fd8b-1289-4a5a-9b39-188fa08b37eb None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:47:02.419972 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b392fd8b-1289-4a5a-9b39-188fa08b37eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:02.479252 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1389/2808] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:47:02.487783 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001776a6-84a6-49fa-b570-0ea706db3c00 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:02.488074 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001776a6-84a6-49fa-b570-0ea706db3c00 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:02.488357 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001776a6-84a6-49fa-b570-0ea706db3c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:02.506824 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-001776a6-84a6-49fa-b570-0ea706db3c00 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:47:02.508018 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-001776a6-84a6-49fa-b570-0ea706db3c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:02.516301 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1420/2809] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:47:02.520556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392fd8b-1289-4a5a-9b39-188fa08b37eb None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:02.530307 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b392fd8b-1289-4a5a-9b39-188fa08b37eb None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:02.534882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943452d2-7f97-4b83-9bac-c2e24c05c1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:02.535535 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943452d2-7f97-4b83-9bac-c2e24c05c1e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:02.535824 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943452d2-7f97-4b83-9bac-c2e24c05c1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:02.536104 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943452d2-7f97-4b83-9bac-c2e24c05c1e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:02.536829 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943452d2-7f97-4b83-9bac-c2e24c05c1e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:47:02.537143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943452d2-7f97-4b83-9bac-c2e24c05c1e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:02.538785 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943452d2-7f97-4b83-9bac-c2e24c05c1e9 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:02.550696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1390/2810] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:47:02.554818 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001776a6-84a6-49fa-b570-0ea706db3c00 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:02.564539 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001776a6-84a6-49fa-b570-0ea706db3c00 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:02.569456 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c24abb-9658-43ea-b30d-e4342d0c21bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:02.570142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c24abb-9658-43ea-b30d-e4342d0c21bc admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:02.570432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c24abb-9658-43ea-b30d-e4342d0c21bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:02.570711 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c24abb-9658-43ea-b30d-e4342d0c21bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:02.571442 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c24abb-9658-43ea-b30d-e4342d0c21bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:02.573324 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c24abb-9658-43ea-b30d-e4342d0c21bc admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:02.708338 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1421/2811] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:47:02 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:47:02.712478 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943452d2-7f97-4b83-9bac-c2e24c05c1e9 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:02.722615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943452d2-7f97-4b83-9bac-c2e24c05c1e9 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:02.726195 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:02.779643 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a33f1-a782-4db1-a699-1d7505ad8523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:02.780314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a33f1-a782-4db1-a699-1d7505ad8523 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:02.780600 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a33f1-a782-4db1-a699-1d7505ad8523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:02.780879 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a33f1-a782-4db1-a699-1d7505ad8523 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:02.781575 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a33f1-a782-4db1-a699-1d7505ad8523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:02.783518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3a33f1-a782-4db1-a699-1d7505ad8523 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:02.916945 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1391/2812] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:47:02 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:47:02.921601 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c24abb-9658-43ea-b30d-e4342d0c21bc admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:02.931682 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c24abb-9658-43ea-b30d-e4342d0c21bc admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:02.937027 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07563d1d-cae6-4dc9-924b-dd74086b400f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:02.937661 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07563d1d-cae6-4dc9-924b-dd74086b400f admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:02.937993 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07563d1d-cae6-4dc9-924b-dd74086b400f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:02.938279 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07563d1d-cae6-4dc9-924b-dd74086b400f admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:02.939012 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07563d1d-cae6-4dc9-924b-dd74086b400f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:02.940589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07563d1d-cae6-4dc9-924b-dd74086b400f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:02.950606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1422/2813] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:47:02.954596 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a33f1-a782-4db1-a699-1d7505ad8523 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:02.966390 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a33f1-a782-4db1-a699-1d7505ad8523 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:02.969845 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd76982-dce6-46d8-b4f1-4a34ae349971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:02.970518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd76982-dce6-46d8-b4f1-4a34ae349971 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:02.970788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd76982-dce6-46d8-b4f1-4a34ae349971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:02.971067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd76982-dce6-46d8-b4f1-4a34ae349971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:02.971793 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd76982-dce6-46d8-b4f1-4a34ae349971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:02.973372 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd76982-dce6-46d8-b4f1-4a34ae349971 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:02.983854 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1392/2814] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:47:02.988083 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07563d1d-cae6-4dc9-924b-dd74086b400f admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:02.998011 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07563d1d-cae6-4dc9-924b-dd74086b400f admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:03.002518 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b01add-7228-48c1-a641-b906e0966ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:03.003391 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b01add-7228-48c1-a641-b906e0966ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:03.003679 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b01add-7228-48c1-a641-b906e0966ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:03.005133 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b01add-7228-48c1-a641-b906e0966ff6 admin admin] PATH_INFO: `/v3/projects/509373db198545e1a2a70705e3f1a5d9/users/97f4dd5ecd754e0d9404b0d727738917/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:03.018414 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b01add-7228-48c1-a641-b906e0966ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=509373db198545e1a2a70705e3f1a5d9, user_id=97f4dd5ecd754e0d9404b0d727738917, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:03.021102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b01add-7228-48c1-a641-b906e0966ff6 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:03.089326 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1423/2815] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:47:02 2022] PUT /identity/v3/projects/509373db198545e1a2a70705e3f1a5d9/users/97f4dd5ecd754e0d9404b0d727738917/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:47:03.105428 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6462c93-22a5-4c93-88ec-82c22c8773d8 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:03.105788 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6462c93-22a5-4c93-88ec-82c22c8773d8 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:03.106078 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6462c93-22a5-4c93-88ec-82c22c8773d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:03.132673 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-c6462c93-22a5-4c93-88ec-82c22c8773d8 None None] MFA Rules not processed for user `97f4dd5ecd754e0d9404b0d727738917`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:47:03.133959 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-c6462c93-22a5-4c93-88ec-82c22c8773d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:03.197276 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1393/2816] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:47:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:47:03.201949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b01add-7228-48c1-a641-b906e0966ff6 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:03.221505 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:03.262696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b01add-7228-48c1-a641-b906e0966ff6 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:03.267330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4d73c-5b9e-43a0-a45a-fd018d988f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:03.270359 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4d73c-5b9e-43a0-a45a-fd018d988f49 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:03.270359 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4d73c-5b9e-43a0-a45a-fd018d988f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:03.270359 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b4d73c-5b9e-43a0-a45a-fd018d988f49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:03.270359 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4d73c-5b9e-43a0-a45a-fd018d988f49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:03.271205 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b4d73c-5b9e-43a0-a45a-fd018d988f49 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:03.364603 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1424/2817] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:47:03 2022] POST /identity/v3/projects => generated 371 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:47:03.368778 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6462c93-22a5-4c93-88ec-82c22c8773d8 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:03.379960 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6462c93-22a5-4c93-88ec-82c22c8773d8 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:03.436468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac812e5b-8e45-41aa-882c-22654a105237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:03.437129 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac812e5b-8e45-41aa-882c-22654a105237 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:03.437422 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac812e5b-8e45-41aa-882c-22654a105237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:03.437722 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac812e5b-8e45-41aa-882c-22654a105237 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:03.438417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac812e5b-8e45-41aa-882c-22654a105237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:03.440332 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac812e5b-8e45-41aa-882c-22654a105237 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:03.529109 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1394/2818] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:47:03 2022] POST /identity/v3/users => generated 292 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:47:03.533300 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4d73c-5b9e-43a0-a45a-fd018d988f49 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:03.544382 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b4d73c-5b9e-43a0-a45a-fd018d988f49 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:03.548929 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372e166-66e0-482c-8f5c-d53005436616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:03.549592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372e166-66e0-482c-8f5c-d53005436616 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:03.549912 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372e166-66e0-482c-8f5c-d53005436616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:03.550194 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372e166-66e0-482c-8f5c-d53005436616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:03.550962 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372e166-66e0-482c-8f5c-d53005436616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:03.552557 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372e166-66e0-482c-8f5c-d53005436616 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:03.563306 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1425/2819] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:47:03.567732 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac812e5b-8e45-41aa-882c-22654a105237 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:03.574258 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:03.578498 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac812e5b-8e45-41aa-882c-22654a105237 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:03.583231 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f47332-2480-4a6a-a2ca-4cec74b2cdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:03.584109 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f47332-2480-4a6a-a2ca-4cec74b2cdb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:03.584399 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f47332-2480-4a6a-a2ca-4cec74b2cdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:03.584681 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f47332-2480-4a6a-a2ca-4cec74b2cdb2 admin admin] PATH_INFO: `/v3/projects/73f546799f2b4a9a99bebdf9c2177185/users/df2a7d0ce1ba403e9f25b8bd6ffe348a/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:03.600009 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f47332-2480-4a6a-a2ca-4cec74b2cdb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f546799f2b4a9a99bebdf9c2177185, user_id=df2a7d0ce1ba403e9f25b8bd6ffe348a, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:03.602723 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f47332-2480-4a6a-a2ca-4cec74b2cdb2 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:03.672147 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1395/2820] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:47:03 2022] PUT /identity/v3/projects/73f546799f2b4a9a99bebdf9c2177185/users/df2a7d0ce1ba403e9f25b8bd6ffe348a/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:47:03.676199 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372e166-66e0-482c-8f5c-d53005436616 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:03.686990 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372e166-66e0-482c-8f5c-d53005436616 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:03.743676 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba28145-38b7-491a-893b-52922a1dd8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:03.743828 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba28145-38b7-491a-893b-52922a1dd8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:03.744119 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba28145-38b7-491a-893b-52922a1dd8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:03.744398 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba28145-38b7-491a-893b-52922a1dd8c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:03.745116 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba28145-38b7-491a-893b-52922a1dd8c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:03.747304 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba28145-38b7-491a-893b-52922a1dd8c9 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:03.757920 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1426/2821] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:47:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:47:03.762092 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f47332-2480-4a6a-a2ca-4cec74b2cdb2 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:03.772894 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f47332-2480-4a6a-a2ca-4cec74b2cdb2 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:03.777507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6844d77-4f68-4430-9f19-b33ab945674c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:03.778444 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6844d77-4f68-4430-9f19-b33ab945674c admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:03.778728 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6844d77-4f68-4430-9f19-b33ab945674c admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:03.779005 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6844d77-4f68-4430-9f19-b33ab945674c admin admin] PATH_INFO: `/v3/projects/73f546799f2b4a9a99bebdf9c2177185/users/df2a7d0ce1ba403e9f25b8bd6ffe348a/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:03.781073 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6844d77-4f68-4430-9f19-b33ab945674c admin admin] RBAC: Authorizing `identity:create_grant(project_id=73f546799f2b4a9a99bebdf9c2177185, user_id=df2a7d0ce1ba403e9f25b8bd6ffe348a, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:03.783743 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6844d77-4f68-4430-9f19-b33ab945674c admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:03.794417 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1396/2822] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:47:03 2022] PUT /identity/v3/projects/73f546799f2b4a9a99bebdf9c2177185/users/df2a7d0ce1ba403e9f25b8bd6ffe348a/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:47:03.819636 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5e207-3762-4cbc-af18-e470fafeb14f None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:03.820086 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5e207-3762-4cbc-af18-e470fafeb14f None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:03.820424 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5e207-3762-4cbc-af18-e470fafeb14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:03.847339 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-4fb5e207-3762-4cbc-af18-e470fafeb14f None None] MFA Rules not processed for user `df2a7d0ce1ba403e9f25b8bd6ffe348a`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:47:03.848618 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-4fb5e207-3762-4cbc-af18-e470fafeb14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:03.916648 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1427/2823] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:47:03 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:47:03.927761 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6844d77-4f68-4430-9f19-b33ab945674c admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:03.929595 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-a6844d77-4f68-4430-9f19-b33ab945674c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:03.987207 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6844d77-4f68-4430-9f19-b33ab945674c admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:03.990854 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc9e51-ad31-4a7c-ad67-dcf15bfb8559 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:03.991495 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc9e51-ad31-4a7c-ad67-dcf15bfb8559 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:03.991783 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc9e51-ad31-4a7c-ad67-dcf15bfb8559 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:03.992064 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc9e51-ad31-4a7c-ad67-dcf15bfb8559 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:04.001518 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc9e51-ad31-4a7c-ad67-dcf15bfb8559 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:04.002977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc9e51-ad31-4a7c-ad67-dcf15bfb8559 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:04.012967 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1397/2824] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:47:03 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:47:04.215563 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5e207-3762-4cbc-af18-e470fafeb14f None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:04.225190 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5e207-3762-4cbc-af18-e470fafeb14f None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:04.229008 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e849798c-d1ed-493a-acc0-51fb8be58fdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:04.229708 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849798c-d1ed-493a-acc0-51fb8be58fdd service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:04.230034 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849798c-d1ed-493a-acc0-51fb8be58fdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:04.230310 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e849798c-d1ed-493a-acc0-51fb8be58fdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:04.240077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:04.286177 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849798c-d1ed-493a-acc0-51fb8be58fdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:04.287622 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e849798c-d1ed-493a-acc0-51fb8be58fdd service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:04.296914 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1428/2825] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:47:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:47:14.008264 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=39,keystone:INSERT=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:14.306420 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=22 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:42.529081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc9e51-ad31-4a7c-ad67-dcf15bfb8559 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:42.591089 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc9e51-ad31-4a7c-ad67-dcf15bfb8559 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:42.595615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32579801-05c1-4fa2-88ce-0b300a7131a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:42.596486 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32579801-05c1-4fa2-88ce-0b300a7131a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:42.596773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32579801-05c1-4fa2-88ce-0b300a7131a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:42.597052 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32579801-05c1-4fa2-88ce-0b300a7131a7 admin admin] PATH_INFO: `/v3/users/97f4dd5ecd754e0d9404b0d727738917` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:42.598259 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32579801-05c1-4fa2-88ce-0b300a7131a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97f4dd5ecd754e0d9404b0d727738917)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:42.600176 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32579801-05c1-4fa2-88ce-0b300a7131a7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:42.838785 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-32579801-05c1-4fa2-88ce-0b300a7131a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97f4dd5ecd754e0d9404b0d727738917'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:42.839461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-32579801-05c1-4fa2-88ce-0b300a7131a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97f4dd5ecd754e0d9404b0d727738917'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:42.840070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-32579801-05c1-4fa2-88ce-0b300a7131a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97f4dd5ecd754e0d9404b0d727738917'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:42.852471 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-32579801-05c1-4fa2-88ce-0b300a7131a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97f4dd5ecd754e0d9404b0d727738917'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:42.939668 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-32579801-05c1-4fa2-88ce-0b300a7131a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97f4dd5ecd754e0d9404b0d727738917'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:42.952153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1398/2826] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:47:42 2022] DELETE /identity/v3/users/97f4dd5ecd754e0d9404b0d727738917 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:47:42.956772 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f467bd0-2659-4ca1-8ed1-5339a87f979b None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:42.957263 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f467bd0-2659-4ca1-8ed1-5339a87f979b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:42.957365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f467bd0-2659-4ca1-8ed1-5339a87f979b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:42.974328 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-1f467bd0-2659-4ca1-8ed1-5339a87f979b None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:47:42.976082 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1f467bd0-2659-4ca1-8ed1-5339a87f979b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:43.033391 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1429/2827] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:47:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:47:43.043615 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32579801-05c1-4fa2-88ce-0b300a7131a7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:43.045045 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-32579801-05c1-4fa2-88ce-0b300a7131a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:43.103648 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32579801-05c1-4fa2-88ce-0b300a7131a7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:43.107348 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30e8a0-f95c-451b-a354-d290e20b448b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:43.107996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30e8a0-f95c-451b-a354-d290e20b448b service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:43.108284 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30e8a0-f95c-451b-a354-d290e20b448b service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:43.108563 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30e8a0-f95c-451b-a354-d290e20b448b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:43.118351 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30e8a0-f95c-451b-a354-d290e20b448b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:43.119786 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30e8a0-f95c-451b-a354-d290e20b448b service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:43.129245 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1399/2828] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:47:43.542465 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f467bd0-2659-4ca1-8ed1-5339a87f979b None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:43.543928 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1f467bd0-2659-4ca1-8ed1-5339a87f979b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:43.556606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f467bd0-2659-4ca1-8ed1-5339a87f979b None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:43.561323 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ec834-f832-456b-a718-65d408db5648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:43.562365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ec834-f832-456b-a718-65d408db5648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:43.562723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ec834-f832-456b-a718-65d408db5648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:43.563016 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ec834-f832-456b-a718-65d408db5648 admin admin] PATH_INFO: `/v3/projects/509373db198545e1a2a70705e3f1a5d9` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:43.564208 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ec834-f832-456b-a718-65d408db5648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=509373db198545e1a2a70705e3f1a5d9)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:43.566170 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ec834-f832-456b-a718-65d408db5648 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:43.666503 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-9b4ec834-f832-456b-a718-65d408db5648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '509373db198545e1a2a70705e3f1a5d9', 'request_id': 'req-9b4ec834-f832-456b-a718-65d408db5648'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:43.672247 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-9b4ec834-f832-456b-a718-65d408db5648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '509373db198545e1a2a70705e3f1a5d9', 'request_id': 'req-9b4ec834-f832-456b-a718-65d408db5648'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:43.678477 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-9b4ec834-f832-456b-a718-65d408db5648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '509373db198545e1a2a70705e3f1a5d9', 'request_id': 'req-9b4ec834-f832-456b-a718-65d408db5648'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:43.750290 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-9b4ec834-f832-456b-a718-65d408db5648 admin admin] The token cache is being invalidate because project 509373db198545e1a2a70705e3f1a5d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:47:43.750583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-9b4ec834-f832-456b-a718-65d408db5648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:43.751211 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-9b4ec834-f832-456b-a718-65d408db5648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:43.752748 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1430/2829] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:47:43 2022] DELETE /identity/v3/projects/509373db198545e1a2a70705e3f1a5d9 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:47:43.757361 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30e8a0-f95c-451b-a354-d290e20b448b service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:43.767183 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30e8a0-f95c-451b-a354-d290e20b448b service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:43.785599 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:43.823559 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0b00f-025d-4122-9907-fb26624f8ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:43.824478 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0b00f-025d-4122-9907-fb26624f8ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:43.824763 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0b00f-025d-4122-9907-fb26624f8ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:43.825072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0b00f-025d-4122-9907-fb26624f8ee7 admin admin] PATH_INFO: `/v3/users/df2a7d0ce1ba403e9f25b8bd6ffe348a` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:43.826307 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0b00f-025d-4122-9907-fb26624f8ee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df2a7d0ce1ba403e9f25b8bd6ffe348a)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:43.828261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0b00f-025d-4122-9907-fb26624f8ee7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:44.062018 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0eb0b00f-025d-4122-9907-fb26624f8ee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df2a7d0ce1ba403e9f25b8bd6ffe348a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:44.062712 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0eb0b00f-025d-4122-9907-fb26624f8ee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df2a7d0ce1ba403e9f25b8bd6ffe348a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:44.063422 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0eb0b00f-025d-4122-9907-fb26624f8ee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df2a7d0ce1ba403e9f25b8bd6ffe348a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:44.077239 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0eb0b00f-025d-4122-9907-fb26624f8ee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df2a7d0ce1ba403e9f25b8bd6ffe348a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:44.145579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0eb0b00f-025d-4122-9907-fb26624f8ee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df2a7d0ce1ba403e9f25b8bd6ffe348a'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:44.158303 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1400/2830] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:47:43 2022] DELETE /identity/v3/users/df2a7d0ce1ba403e9f25b8bd6ffe348a => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:47:44.559153 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ec834-f832-456b-a718-65d408db5648 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:44.560733 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9b4ec834-f832-456b-a718-65d408db5648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:44.574367 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ec834-f832-456b-a718-65d408db5648 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:44.631669 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a753d1-c650-4619-bd4d-b0e536b1c8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:44.632562 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a753d1-c650-4619-bd4d-b0e536b1c8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:44.632851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a753d1-c650-4619-bd4d-b0e536b1c8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:44.633127 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a753d1-c650-4619-bd4d-b0e536b1c8c1 admin admin] PATH_INFO: `/v3/projects/73f546799f2b4a9a99bebdf9c2177185` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:44.634347 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a753d1-c650-4619-bd4d-b0e536b1c8c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73f546799f2b4a9a99bebdf9c2177185)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:44.636262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a753d1-c650-4619-bd4d-b0e536b1c8c1 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:44.747233 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:44.762992 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c5a753d1-c650-4619-bd4d-b0e536b1c8c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73f546799f2b4a9a99bebdf9c2177185', 'request_id': 'req-c5a753d1-c650-4619-bd4d-b0e536b1c8c1'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:44.768565 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c5a753d1-c650-4619-bd4d-b0e536b1c8c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73f546799f2b4a9a99bebdf9c2177185', 'request_id': 'req-c5a753d1-c650-4619-bd4d-b0e536b1c8c1'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:44.775202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c5a753d1-c650-4619-bd4d-b0e536b1c8c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73f546799f2b4a9a99bebdf9c2177185', 'request_id': 'req-c5a753d1-c650-4619-bd4d-b0e536b1c8c1'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:44.859280 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c5a753d1-c650-4619-bd4d-b0e536b1c8c1 admin admin] The token cache is being invalidate because project 73f546799f2b4a9a99bebdf9c2177185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:47:44.859541 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c5a753d1-c650-4619-bd4d-b0e536b1c8c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:44.860172 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-c5a753d1-c650-4619-bd4d-b0e536b1c8c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:44.861756 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1431/2831] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:47:44 2022] DELETE /identity/v3/projects/73f546799f2b4a9a99bebdf9c2177185 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:47:44.866773 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd9fc-69de-445e-b583-5675d79a0b5b None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:44.867248 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd9fc-69de-445e-b583-5675d79a0b5b None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:44.867368 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acd9fc-69de-445e-b583-5675d79a0b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:44.886556 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f9acd9fc-69de-445e-b583-5675d79a0b5b None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:47:44.887910 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f9acd9fc-69de-445e-b583-5675d79a0b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:44.949804 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1401/2832] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:47:44.957656 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd8dc8-7520-46a7-b39d-f7aeda02096b None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:44.957986 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd8dc8-7520-46a7-b39d-f7aeda02096b None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:44.958270 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd8dc8-7520-46a7-b39d-f7aeda02096b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:44.977481 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-7fdd8dc8-7520-46a7-b39d-f7aeda02096b None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:47:44.978794 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-7fdd8dc8-7520-46a7-b39d-f7aeda02096b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:44.986704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1432/2833] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:47:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:47:44.990947 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acd9fc-69de-445e-b583-5675d79a0b5b None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:45.000418 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acd9fc-69de-445e-b583-5675d79a0b5b None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:45.004920 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834a783-f92c-4988-950c-a466cb9e9c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:45.005564 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834a783-f92c-4988-950c-a466cb9e9c90 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:45.005938 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834a783-f92c-4988-950c-a466cb9e9c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:45.006228 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a834a783-f92c-4988-950c-a466cb9e9c90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:45.006986 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834a783-f92c-4988-950c-a466cb9e9c90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80358) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:47:45.007296 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834a783-f92c-4988-950c-a466cb9e9c90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:45.008967 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a834a783-f92c-4988-950c-a466cb9e9c90 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:45.020593 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1402/2834] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:47:45.025246 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd8dc8-7520-46a7-b39d-f7aeda02096b None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:45.034395 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd8dc8-7520-46a7-b39d-f7aeda02096b None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:45.039589 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaf7e9-7fe9-4c87-8467-e565b7a5849c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:45.040230 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaf7e9-7fe9-4c87-8467-e565b7a5849c admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:45.040514 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaf7e9-7fe9-4c87-8467-e565b7a5849c admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:45.040795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eaf7e9-7fe9-4c87-8467-e565b7a5849c admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:45.041474 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eaf7e9-7fe9-4c87-8467-e565b7a5849c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:45.043435 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52eaf7e9-7fe9-4c87-8467-e565b7a5849c admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:45.147717 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1433/2835] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:47:45 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:47:45.151821 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834a783-f92c-4988-950c-a466cb9e9c90 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:45.161992 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a834a783-f92c-4988-950c-a466cb9e9c90 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:45.187194 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:45.218355 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfdc396-fde9-4429-b364-8b035ab8ec62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:45.219269 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdc396-fde9-4429-b364-8b035ab8ec62 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:45.219780 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdc396-fde9-4429-b364-8b035ab8ec62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:45.220083 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdc396-fde9-4429-b364-8b035ab8ec62 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:45.221227 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfdc396-fde9-4429-b364-8b035ab8ec62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:45.223269 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfdc396-fde9-4429-b364-8b035ab8ec62 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:45.327821 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1403/2836] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:47:45 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:47:45.331926 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaf7e9-7fe9-4c87-8467-e565b7a5849c admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:45.343093 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eaf7e9-7fe9-4c87-8467-e565b7a5849c admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:45.351848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378486a-7c9d-4fe1-8d01-882b65f91f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:45.351848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378486a-7c9d-4fe1-8d01-882b65f91f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:45.351848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378486a-7c9d-4fe1-8d01-882b65f91f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:45.351848 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2378486a-7c9d-4fe1-8d01-882b65f91f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:45.352214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378486a-7c9d-4fe1-8d01-882b65f91f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:45.352214 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2378486a-7c9d-4fe1-8d01-882b65f91f08 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:45.361766 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1434/2837] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:47:45.365474 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfdc396-fde9-4429-b364-8b035ab8ec62 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:45.375463 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfdc396-fde9-4429-b364-8b035ab8ec62 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:45.380062 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093505c1-0af4-48d9-ae37-ffd65d6b2f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:45.380708 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093505c1-0af4-48d9-ae37-ffd65d6b2f40 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:45.380991 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093505c1-0af4-48d9-ae37-ffd65d6b2f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:45.381803 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093505c1-0af4-48d9-ae37-ffd65d6b2f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:45.382550 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093505c1-0af4-48d9-ae37-ffd65d6b2f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:45.384122 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093505c1-0af4-48d9-ae37-ffd65d6b2f40 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:45.394269 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1404/2838] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:47:45.398904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378486a-7c9d-4fe1-8d01-882b65f91f08 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:45.408583 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2378486a-7c9d-4fe1-8d01-882b65f91f08 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:45.413136 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fb828-af48-40fc-a0af-e5a5ac35d7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:45.414039 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fb828-af48-40fc-a0af-e5a5ac35d7ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:45.414327 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fb828-af48-40fc-a0af-e5a5ac35d7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:45.414606 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fb828-af48-40fc-a0af-e5a5ac35d7ca admin admin] PATH_INFO: `/v3/projects/3ac7e535facb4e2483220af058b1d045/users/437d95de71154c999bf999263786387c/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:45.429591 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3fb828-af48-40fc-a0af-e5a5ac35d7ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ac7e535facb4e2483220af058b1d045, user_id=437d95de71154c999bf999263786387c, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:45.432298 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3fb828-af48-40fc-a0af-e5a5ac35d7ca admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:45.494477 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1435/2839] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:47:45 2022] PUT /identity/v3/projects/3ac7e535facb4e2483220af058b1d045/users/437d95de71154c999bf999263786387c/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:47:45.504847 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111301b-4d59-424d-aaf0-4fc18b739450 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:45.505142 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111301b-4d59-424d-aaf0-4fc18b739450 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:45.505425 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111301b-4d59-424d-aaf0-4fc18b739450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:45.531507 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-6111301b-4d59-424d-aaf0-4fc18b739450 None None] MFA Rules not processed for user `437d95de71154c999bf999263786387c`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:47:45.532713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-6111301b-4d59-424d-aaf0-4fc18b739450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:45.595898 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1405/2840] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:47:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:47:45.600355 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fb828-af48-40fc-a0af-e5a5ac35d7ca admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:45.660549 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3fb828-af48-40fc-a0af-e5a5ac35d7ca admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:45.665209 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589c032-0b92-4bba-9d53-7535896fae42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:45.665913 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589c032-0b92-4bba-9d53-7535896fae42 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:45.666202 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589c032-0b92-4bba-9d53-7535896fae42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:45.666478 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589c032-0b92-4bba-9d53-7535896fae42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:45.667259 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589c032-0b92-4bba-9d53-7535896fae42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:45.669157 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589c032-0b92-4bba-9d53-7535896fae42 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:45.780845 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1436/2841] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:47:45 2022] POST /identity/v3/projects => generated 381 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:47:45.784925 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111301b-4d59-424d-aaf0-4fc18b739450 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:45.796648 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111301b-4d59-424d-aaf0-4fc18b739450 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:45.853008 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfac66-fa3a-4d5d-ab6d-e597eb22cc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:45.853675 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfac66-fa3a-4d5d-ab6d-e597eb22cc06 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:45.853996 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfac66-fa3a-4d5d-ab6d-e597eb22cc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:45.854279 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dfac66-fa3a-4d5d-ab6d-e597eb22cc06 admin admin] PATH_INFO: `/v3/users` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:45.854963 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfac66-fa3a-4d5d-ab6d-e597eb22cc06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:45.856880 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dfac66-fa3a-4d5d-ab6d-e597eb22cc06 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:45.939362 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1406/2842] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:47:45 2022] POST /identity/v3/users => generated 297 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:47:45.943629 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589c032-0b92-4bba-9d53-7535896fae42 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:45.954056 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589c032-0b92-4bba-9d53-7535896fae42 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:45.958924 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c177e-773e-4bf9-8050-4fbca169f3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:45.966782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c177e-773e-4bf9-8050-4fbca169f3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:45.966782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c177e-773e-4bf9-8050-4fbca169f3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:45.966782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c177e-773e-4bf9-8050-4fbca169f3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:45.966782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c177e-773e-4bf9-8050-4fbca169f3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:45.966782 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c177e-773e-4bf9-8050-4fbca169f3c0 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:45.972968 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1437/2843] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:47:45.977477 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfac66-fa3a-4d5d-ab6d-e597eb22cc06 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:45.987361 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dfac66-fa3a-4d5d-ab6d-e597eb22cc06 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:45.992630 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d6d87-e857-44fb-941d-9a07a209cc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:45.993484 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d6d87-e857-44fb-941d-9a07a209cc94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:45.993865 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d6d87-e857-44fb-941d-9a07a209cc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:45.994152 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d6d87-e857-44fb-941d-9a07a209cc94 admin admin] PATH_INFO: `/v3/projects/2fc4904c37fb47858d5ae52b84ed232c/users/605f2cefb8bb4f609a80b04ea0b8e753/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:46.008555 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d6d87-e857-44fb-941d-9a07a209cc94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fc4904c37fb47858d5ae52b84ed232c, user_id=605f2cefb8bb4f609a80b04ea0b8e753, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:46.011282 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d6d87-e857-44fb-941d-9a07a209cc94 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:46.117921 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1407/2844] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:47:45 2022] PUT /identity/v3/projects/2fc4904c37fb47858d5ae52b84ed232c/users/605f2cefb8bb4f609a80b04ea0b8e753/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:47:46.122014 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c177e-773e-4bf9-8050-4fbca169f3c0 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:46.131971 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c177e-773e-4bf9-8050-4fbca169f3c0 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:46.152930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:46.189186 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50312a06-3139-4cdc-b051-0a4af4e398ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:46.189996 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50312a06-3139-4cdc-b051-0a4af4e398ad admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:46.190231 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50312a06-3139-4cdc-b051-0a4af4e398ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:46.190517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50312a06-3139-4cdc-b051-0a4af4e398ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:46.191235 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50312a06-3139-4cdc-b051-0a4af4e398ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:46.193155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50312a06-3139-4cdc-b051-0a4af4e398ad admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:46.202746 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1438/2845] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:47:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:47:46.206980 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d6d87-e857-44fb-941d-9a07a209cc94 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:46.213664 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:46.220554 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d6d87-e857-44fb-941d-9a07a209cc94 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:46.225925 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe615fc2-aa5c-41c4-8494-96d02a41e159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:46.226817 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe615fc2-aa5c-41c4-8494-96d02a41e159 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:46.227101 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe615fc2-aa5c-41c4-8494-96d02a41e159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:46.227379 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe615fc2-aa5c-41c4-8494-96d02a41e159 admin admin] PATH_INFO: `/v3/projects/2fc4904c37fb47858d5ae52b84ed232c/users/605f2cefb8bb4f609a80b04ea0b8e753/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:46.229485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe615fc2-aa5c-41c4-8494-96d02a41e159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fc4904c37fb47858d5ae52b84ed232c, user_id=605f2cefb8bb4f609a80b04ea0b8e753, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:46.233082 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe615fc2-aa5c-41c4-8494-96d02a41e159 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:46.248499 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1408/2846] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:47:46 2022] PUT /identity/v3/projects/2fc4904c37fb47858d5ae52b84ed232c/users/605f2cefb8bb4f609a80b04ea0b8e753/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:47:46.260179 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587bce1-0b0a-43ca-b73e-570acb98d55c None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:46.260494 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587bce1-0b0a-43ca-b73e-570acb98d55c None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:46.260776 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587bce1-0b0a-43ca-b73e-570acb98d55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:46.288565 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-5587bce1-0b0a-43ca-b73e-570acb98d55c None None] MFA Rules not processed for user `605f2cefb8bb4f609a80b04ea0b8e753`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:47:46.289797 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-5587bce1-0b0a-43ca-b73e-570acb98d55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:46.355496 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1439/2847] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:47:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:47:46.366563 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe615fc2-aa5c-41c4-8494-96d02a41e159 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:46.368249 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-fe615fc2-aa5c-41c4-8494-96d02a41e159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:46.423952 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe615fc2-aa5c-41c4-8494-96d02a41e159 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:46.427627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82061f0-6df5-4700-b910-428824956128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:46.428292 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82061f0-6df5-4700-b910-428824956128 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:46.428578 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82061f0-6df5-4700-b910-428824956128 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:46.428855 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82061f0-6df5-4700-b910-428824956128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:46.438154 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82061f0-6df5-4700-b910-428824956128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:46.439586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82061f0-6df5-4700-b910-428824956128 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:46.449304 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1409/2848] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:47:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:47:46.684216 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587bce1-0b0a-43ca-b73e-570acb98d55c None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:46.694717 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587bce1-0b0a-43ca-b73e-570acb98d55c None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:46.698418 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafbe44-4985-4b63-89fb-d7291e9e3170 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:46.699067 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafbe44-4985-4b63-89fb-d7291e9e3170 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:46.699425 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafbe44-4985-4b63-89fb-d7291e9e3170 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:46.699634 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fafbe44-4985-4b63-89fb-d7291e9e3170 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:46.735654 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82061f0-6df5-4700-b910-428824956128 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:46.737088 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-b82061f0-6df5-4700-b910-428824956128 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:46.758720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafbe44-4985-4b63-89fb-d7291e9e3170 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:46.760165 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fafbe44-4985-4b63-89fb-d7291e9e3170 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:46.769249 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1440/2849] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:47:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:47:46.796496 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82061f0-6df5-4700-b910-428824956128 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:46.800487 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040dcccd-6f79-4bb9-ac9b-872e2c92c245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:46.801159 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dcccd-6f79-4bb9-ac9b-872e2c92c245 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:46.801540 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dcccd-6f79-4bb9-ac9b-872e2c92c245 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:46.801848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040dcccd-6f79-4bb9-ac9b-872e2c92c245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:46.805455 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-040dcccd-6f79-4bb9-ac9b-872e2c92c245 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:46.813640 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040dcccd-6f79-4bb9-ac9b-872e2c92c245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:46.815091 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040dcccd-6f79-4bb9-ac9b-872e2c92c245 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:46.824131 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1410/2850] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:47:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:47:55.154773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafbe44-4985-4b63-89fb-d7291e9e3170 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:55.200289 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=100 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:55.216509 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fafbe44-4985-4b63-89fb-d7291e9e3170 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:55.221053 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930be213-49a6-41f6-8a55-8b526f6269ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:55.221949 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930be213-49a6-41f6-8a55-8b526f6269ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:55.222241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930be213-49a6-41f6-8a55-8b526f6269ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:55.222520 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930be213-49a6-41f6-8a55-8b526f6269ea admin admin] PATH_INFO: `/v3/users/437d95de71154c999bf999263786387c` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:55.223728 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930be213-49a6-41f6-8a55-8b526f6269ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=437d95de71154c999bf999263786387c)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:55.225641 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930be213-49a6-41f6-8a55-8b526f6269ea admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:55.433691 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-930be213-49a6-41f6-8a55-8b526f6269ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '437d95de71154c999bf999263786387c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:55.434562 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-930be213-49a6-41f6-8a55-8b526f6269ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '437d95de71154c999bf999263786387c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:55.435033 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-930be213-49a6-41f6-8a55-8b526f6269ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '437d95de71154c999bf999263786387c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:55.448474 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-930be213-49a6-41f6-8a55-8b526f6269ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '437d95de71154c999bf999263786387c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:55.455451 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-930be213-49a6-41f6-8a55-8b526f6269ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '437d95de71154c999bf999263786387c'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:55.516891 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1441/2851] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:47:55 2022] DELETE /identity/v3/users/437d95de71154c999bf999263786387c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:47:55.521609 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac64d9-4c1f-48b0-a9d1-6968989b1c8f None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:55.522209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac64d9-4c1f-48b0-a9d1-6968989b1c8f None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:55.522209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac64d9-4c1f-48b0-a9d1-6968989b1c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:55.540914 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-75ac64d9-4c1f-48b0-a9d1-6968989b1c8f None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:47:55.542173 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-75ac64d9-4c1f-48b0-a9d1-6968989b1c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:55.602655 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1411/2852] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:47:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:47:55.612438 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930be213-49a6-41f6-8a55-8b526f6269ea admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:55.613874 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-930be213-49a6-41f6-8a55-8b526f6269ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:55.670436 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930be213-49a6-41f6-8a55-8b526f6269ea admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:55.674083 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad188cf-06ac-444a-96fb-ebd623f556d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:55.674733 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad188cf-06ac-444a-96fb-ebd623f556d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:55.675022 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad188cf-06ac-444a-96fb-ebd623f556d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:55.675302 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad188cf-06ac-444a-96fb-ebd623f556d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:55.685039 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad188cf-06ac-444a-96fb-ebd623f556d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:55.686449 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad188cf-06ac-444a-96fb-ebd623f556d5 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:55.696139 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1442/2853] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:47:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:47:56.147143 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac64d9-4c1f-48b0-a9d1-6968989b1c8f None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:56.149162 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-75ac64d9-4c1f-48b0-a9d1-6968989b1c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:56.161345 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac64d9-4c1f-48b0-a9d1-6968989b1c8f None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:56.166583 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d7661-f033-4f98-8100-6445ba21e591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:56.167450 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d7661-f033-4f98-8100-6445ba21e591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:56.167737 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d7661-f033-4f98-8100-6445ba21e591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:56.168012 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d7661-f033-4f98-8100-6445ba21e591 admin admin] PATH_INFO: `/v3/projects/3ac7e535facb4e2483220af058b1d045` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:56.169201 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d7661-f033-4f98-8100-6445ba21e591 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ac7e535facb4e2483220af058b1d045)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:56.171162 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d7661-f033-4f98-8100-6445ba21e591 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:56.275962 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:56.288380 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dc1d7661-f033-4f98-8100-6445ba21e591 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ac7e535facb4e2483220af058b1d045', 'request_id': 'req-dc1d7661-f033-4f98-8100-6445ba21e591'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:56.293977 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dc1d7661-f033-4f98-8100-6445ba21e591 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ac7e535facb4e2483220af058b1d045', 'request_id': 'req-dc1d7661-f033-4f98-8100-6445ba21e591'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:56.300025 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dc1d7661-f033-4f98-8100-6445ba21e591 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ac7e535facb4e2483220af058b1d045', 'request_id': 'req-dc1d7661-f033-4f98-8100-6445ba21e591'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:56.390770 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dc1d7661-f033-4f98-8100-6445ba21e591 admin admin] The token cache is being invalidate because project 3ac7e535facb4e2483220af058b1d045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:47:56.391217 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dc1d7661-f033-4f98-8100-6445ba21e591 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:56.391953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-dc1d7661-f033-4f98-8100-6445ba21e591 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:56.393602 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1412/2854] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:47:56 2022] DELETE /identity/v3/projects/3ac7e535facb4e2483220af058b1d045 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:47:56.397929 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad188cf-06ac-444a-96fb-ebd623f556d5 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:56.408261 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad188cf-06ac-444a-96fb-ebd623f556d5 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:56.463905 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cc9b8-d9c6-4a6a-ad36-33019966670f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:56.464787 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cc9b8-d9c6-4a6a-ad36-33019966670f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:56.465077 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cc9b8-d9c6-4a6a-ad36-33019966670f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:56.465359 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cc9b8-d9c6-4a6a-ad36-33019966670f admin admin] PATH_INFO: `/v3/users/605f2cefb8bb4f609a80b04ea0b8e753` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:56.466577 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cc9b8-d9c6-4a6a-ad36-33019966670f admin admin] RBAC: Authorizing `identity:delete_user(user_id=605f2cefb8bb4f609a80b04ea0b8e753)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:56.468500 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cc9b8-d9c6-4a6a-ad36-33019966670f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:56.473754 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:56.638525 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-971cc9b8-d9c6-4a6a-ad36-33019966670f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '605f2cefb8bb4f609a80b04ea0b8e753'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:56.639188 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-971cc9b8-d9c6-4a6a-ad36-33019966670f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '605f2cefb8bb4f609a80b04ea0b8e753'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:56.639795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-971cc9b8-d9c6-4a6a-ad36-33019966670f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '605f2cefb8bb4f609a80b04ea0b8e753'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:56.651537 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-971cc9b8-d9c6-4a6a-ad36-33019966670f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '605f2cefb8bb4f609a80b04ea0b8e753'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:56.659113 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-971cc9b8-d9c6-4a6a-ad36-33019966670f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '605f2cefb8bb4f609a80b04ea0b8e753'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:56.767718 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1443/2855] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:47:56 2022] DELETE /identity/v3/users/605f2cefb8bb4f609a80b04ea0b8e753 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:47:57.198489 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d7661-f033-4f98-8100-6445ba21e591 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:57.200048 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-dc1d7661-f033-4f98-8100-6445ba21e591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:57.213512 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d7661-f033-4f98-8100-6445ba21e591 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:57.270696 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68c357-e957-4609-b0e3-6e805e23c95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:57.271557 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68c357-e957-4609-b0e3-6e805e23c95e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:57.271848 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68c357-e957-4609-b0e3-6e805e23c95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:57.272131 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68c357-e957-4609-b0e3-6e805e23c95e admin admin] PATH_INFO: `/v3/projects/2fc4904c37fb47858d5ae52b84ed232c` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:57.273311 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68c357-e957-4609-b0e3-6e805e23c95e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fc4904c37fb47858d5ae52b84ed232c)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:57.275347 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68c357-e957-4609-b0e3-6e805e23c95e admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:57.373875 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3a68c357-e957-4609-b0e3-6e805e23c95e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fc4904c37fb47858d5ae52b84ed232c', 'request_id': 'req-3a68c357-e957-4609-b0e3-6e805e23c95e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:57.379261 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3a68c357-e957-4609-b0e3-6e805e23c95e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fc4904c37fb47858d5ae52b84ed232c', 'request_id': 'req-3a68c357-e957-4609-b0e3-6e805e23c95e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:57.385209 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3a68c357-e957-4609-b0e3-6e805e23c95e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fc4904c37fb47858d5ae52b84ed232c', 'request_id': 'req-3a68c357-e957-4609-b0e3-6e805e23c95e'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:57.458360 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3a68c357-e957-4609-b0e3-6e805e23c95e admin admin] The token cache is being invalidate because project 2fc4904c37fb47858d5ae52b84ed232c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:47:57.458653 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3a68c357-e957-4609-b0e3-6e805e23c95e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:57.459292 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-3a68c357-e957-4609-b0e3-6e805e23c95e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:57.460818 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1413/2856] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:47:57 2022] DELETE /identity/v3/projects/2fc4904c37fb47858d5ae52b84ed232c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:47:57.468365 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70549640-7de6-400b-8284-38769dab1d31 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:57.468854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70549640-7de6-400b-8284-38769dab1d31 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:57.468957 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70549640-7de6-400b-8284-38769dab1d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:57.487516 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-70549640-7de6-400b-8284-38769dab1d31 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:47:57.488657 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-70549640-7de6-400b-8284-38769dab1d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:57.545750 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1444/2857] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:47:57.553581 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837ee97-7d9d-401a-8e35-9f061eb56dd1 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:57.553904 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837ee97-7d9d-401a-8e35-9f061eb56dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:57.554185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837ee97-7d9d-401a-8e35-9f061eb56dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:57.572480 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8837ee97-7d9d-401a-8e35-9f061eb56dd1 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:47:57.573781 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8837ee97-7d9d-401a-8e35-9f061eb56dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:57.581612 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1414/2858] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:47:57.585811 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70549640-7de6-400b-8284-38769dab1d31 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:57.595791 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70549640-7de6-400b-8284-38769dab1d31 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:57.600286 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d6c05-5c3e-4151-a527-4f0acb2915e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:57.600973 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d6c05-5c3e-4151-a527-4f0acb2915e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:57.601256 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d6c05-5c3e-4151-a527-4f0acb2915e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:57.601534 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d6c05-5c3e-4151-a527-4f0acb2915e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:57.602890 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d6c05-5c3e-4151-a527-4f0acb2915e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:47:57.603200 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d6c05-5c3e-4151-a527-4f0acb2915e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:57.604790 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7d6c05-5c3e-4151-a527-4f0acb2915e1 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:57.616075 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1445/2859] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:47:57.620252 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837ee97-7d9d-401a-8e35-9f061eb56dd1 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:57.629523 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837ee97-7d9d-401a-8e35-9f061eb56dd1 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:57.634246 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b968eb-6799-4402-aaed-69b47649f51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:57.634891 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b968eb-6799-4402-aaed-69b47649f51f admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:57.635175 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b968eb-6799-4402-aaed-69b47649f51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:57.635453 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b968eb-6799-4402-aaed-69b47649f51f admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:57.636139 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b968eb-6799-4402-aaed-69b47649f51f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:57.638078 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b968eb-6799-4402-aaed-69b47649f51f admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:57.723677 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1415/2860] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:47:57 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:47:57.728453 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d6c05-5c3e-4151-a527-4f0acb2915e1 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:57.738432 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d6c05-5c3e-4151-a527-4f0acb2915e1 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:57.795474 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920841f8-fae0-44b8-8210-9ad298abeea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:57.796774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920841f8-fae0-44b8-8210-9ad298abeea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:57.796774 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920841f8-fae0-44b8-8210-9ad298abeea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:57.797049 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920841f8-fae0-44b8-8210-9ad298abeea8 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:57.797849 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920841f8-fae0-44b8-8210-9ad298abeea8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:57.800921 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920841f8-fae0-44b8-8210-9ad298abeea8 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:57.876631 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1446/2861] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:47:57 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:47:57.880750 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b968eb-6799-4402-aaed-69b47649f51f admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:57.891658 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b968eb-6799-4402-aaed-69b47649f51f admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:57.896403 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9154f-ce86-4e57-a9ed-5e700fae6156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:57.897067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9154f-ce86-4e57-a9ed-5e700fae6156 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:57.897358 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9154f-ce86-4e57-a9ed-5e700fae6156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:57.897641 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9154f-ce86-4e57-a9ed-5e700fae6156 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:57.898400 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9154f-ce86-4e57-a9ed-5e700fae6156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:57.900641 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9154f-ce86-4e57-a9ed-5e700fae6156 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:57.911090 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1416/2862] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:47:57.914881 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920841f8-fae0-44b8-8210-9ad298abeea8 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:57.920018 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:57.925346 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920841f8-fae0-44b8-8210-9ad298abeea8 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:57.929929 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ddbf24-4351-47cc-9bd3-0ccb85a5f49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:57.930575 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddbf24-4351-47cc-9bd3-0ccb85a5f49f admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:57.933511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddbf24-4351-47cc-9bd3-0ccb85a5f49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:57.933511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddbf24-4351-47cc-9bd3-0ccb85a5f49f admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:57.933511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ddbf24-4351-47cc-9bd3-0ccb85a5f49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:57.933511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ddbf24-4351-47cc-9bd3-0ccb85a5f49f admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:57.944091 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1447/2863] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:47:57.948851 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9154f-ce86-4e57-a9ed-5e700fae6156 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:57.958929 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9154f-ce86-4e57-a9ed-5e700fae6156 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:57.964300 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2a7d7-f974-4921-8b28-987b0e824636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:57.967910 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2a7d7-f974-4921-8b28-987b0e824636 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:57.967910 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2a7d7-f974-4921-8b28-987b0e824636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:57.967910 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2a7d7-f974-4921-8b28-987b0e824636 admin admin] PATH_INFO: `/v3/projects/0eaaa5fb520b4e84a1e77291cf6c560e/users/ec0738b956fe4ce59507689caf29f8f9/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:57.969001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:57.980546 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2a7d7-f974-4921-8b28-987b0e824636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eaaa5fb520b4e84a1e77291cf6c560e, user_id=ec0738b956fe4ce59507689caf29f8f9, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:57.983269 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2a7d7-f974-4921-8b28-987b0e824636 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:58.065017 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1417/2864] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:47:57 2022] PUT /identity/v3/projects/0eaaa5fb520b4e84a1e77291cf6c560e/users/ec0738b956fe4ce59507689caf29f8f9/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:47:58.077239 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32849bd3-6c9e-472b-b75d-56de21dca86e None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:58.077532 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32849bd3-6c9e-472b-b75d-56de21dca86e None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:58.077860 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32849bd3-6c9e-472b-b75d-56de21dca86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:58.105456 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-32849bd3-6c9e-472b-b75d-56de21dca86e None None] MFA Rules not processed for user `ec0738b956fe4ce59507689caf29f8f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:47:58.106705 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-32849bd3-6c9e-472b-b75d-56de21dca86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:58.170423 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1448/2865] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:47:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:47:58.183537 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2a7d7-f974-4921-8b28-987b0e824636 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:58.185224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-cae2a7d7-f974-4921-8b28-987b0e824636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:58.241525 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2a7d7-f974-4921-8b28-987b0e824636 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:58.245843 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a37cf5-dd1e-43b5-9733-486308fe937b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:58.246491 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a37cf5-dd1e-43b5-9733-486308fe937b service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:58.246778 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a37cf5-dd1e-43b5-9733-486308fe937b service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:58.247054 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a37cf5-dd1e-43b5-9733-486308fe937b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:58.256438 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a37cf5-dd1e-43b5-9733-486308fe937b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:58.257909 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a37cf5-dd1e-43b5-9733-486308fe937b service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:58.267309 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1418/2866] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:47:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:47:58.286187 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32849bd3-6c9e-472b-b75d-56de21dca86e None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:58.347285 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32849bd3-6c9e-472b-b75d-56de21dca86e None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:58.351705 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9049e9-85d8-4339-af81-50d90f53daba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:58.352565 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9049e9-85d8-4339-af81-50d90f53daba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:58.352846 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9049e9-85d8-4339-af81-50d90f53daba admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:58.353136 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9049e9-85d8-4339-af81-50d90f53daba admin admin] PATH_INFO: `/v3/users/ec0738b956fe4ce59507689caf29f8f9` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:58.354325 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9049e9-85d8-4339-af81-50d90f53daba admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec0738b956fe4ce59507689caf29f8f9)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:58.356351 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9049e9-85d8-4339-af81-50d90f53daba admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:58.512537 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1d9049e9-85d8-4339-af81-50d90f53daba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec0738b956fe4ce59507689caf29f8f9'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:58.513218 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1d9049e9-85d8-4339-af81-50d90f53daba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec0738b956fe4ce59507689caf29f8f9'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:58.513894 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1d9049e9-85d8-4339-af81-50d90f53daba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec0738b956fe4ce59507689caf29f8f9'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:58.525773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1d9049e9-85d8-4339-af81-50d90f53daba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec0738b956fe4ce59507689caf29f8f9'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:58.532634 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-1d9049e9-85d8-4339-af81-50d90f53daba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec0738b956fe4ce59507689caf29f8f9'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:58.632649 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:58.637158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1449/2867] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:47:58 2022] DELETE /identity/v3/users/ec0738b956fe4ce59507689caf29f8f9 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:47:58.641908 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc5136-a37e-44fb-82fe-efeebc67bbba None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:58.647373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc5136-a37e-44fb-82fe-efeebc67bbba None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:58.647373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc5136-a37e-44fb-82fe-efeebc67bbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:58.659664 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-7efc5136-a37e-44fb-82fe-efeebc67bbba None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:47:58.660852 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7efc5136-a37e-44fb-82fe-efeebc67bbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:58.719221 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1419/2868] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:47:58.729490 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9049e9-85d8-4339-af81-50d90f53daba admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:58.731041 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-1d9049e9-85d8-4339-af81-50d90f53daba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:58.786817 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9049e9-85d8-4339-af81-50d90f53daba admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:58.790971 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8656a65-036c-4e3a-a95c-76c7f9f9c7d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:58.791617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8656a65-036c-4e3a-a95c-76c7f9f9c7d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:58.791904 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8656a65-036c-4e3a-a95c-76c7f9f9c7d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:58.792182 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8656a65-036c-4e3a-a95c-76c7f9f9c7d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:58.801102 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8656a65-036c-4e3a-a95c-76c7f9f9c7d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:58.802617 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8656a65-036c-4e3a-a95c-76c7f9f9c7d7 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:58.812671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1450/2869] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:47:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:47:59.272730 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc5136-a37e-44fb-82fe-efeebc67bbba None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:59.274971 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-7efc5136-a37e-44fb-82fe-efeebc67bbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:59.287914 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc5136-a37e-44fb-82fe-efeebc67bbba None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:59.292734 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca328249-a231-475f-8f8e-b2542de06cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:59.293607 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca328249-a231-475f-8f8e-b2542de06cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:59.293934 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca328249-a231-475f-8f8e-b2542de06cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:59.294220 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca328249-a231-475f-8f8e-b2542de06cdc admin admin] PATH_INFO: `/v3/projects/0eaaa5fb520b4e84a1e77291cf6c560e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:59.295413 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca328249-a231-475f-8f8e-b2542de06cdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eaaa5fb520b4e84a1e77291cf6c560e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:59.297415 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca328249-a231-475f-8f8e-b2542de06cdc admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:59.396849 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ca328249-a231-475f-8f8e-b2542de06cdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eaaa5fb520b4e84a1e77291cf6c560e', 'request_id': 'req-ca328249-a231-475f-8f8e-b2542de06cdc'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:59.403016 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ca328249-a231-475f-8f8e-b2542de06cdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eaaa5fb520b4e84a1e77291cf6c560e', 'request_id': 'req-ca328249-a231-475f-8f8e-b2542de06cdc'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:59.409223 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ca328249-a231-475f-8f8e-b2542de06cdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eaaa5fb520b4e84a1e77291cf6c560e', 'request_id': 'req-ca328249-a231-475f-8f8e-b2542de06cdc'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:59.452549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ca328249-a231-475f-8f8e-b2542de06cdc admin admin] The token cache is being invalidate because project 0eaaa5fb520b4e84a1e77291cf6c560e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:47:59.452776 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ca328249-a231-475f-8f8e-b2542de06cdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:59.453428 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-ca328249-a231-475f-8f8e-b2542de06cdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:47:59.454989 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1420/2870] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:47:59 2022] DELETE /identity/v3/projects/0eaaa5fb520b4e84a1e77291cf6c560e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:47:59.465592 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c67fe-1d56-41b8-841a-76d016e2f641 None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:59.465927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c67fe-1d56-41b8-841a-76d016e2f641 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:59.466193 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c67fe-1d56-41b8-841a-76d016e2f641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:59.483916 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-df9c67fe-1d56-41b8-841a-76d016e2f641 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:47:59.485168 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-df9c67fe-1d56-41b8-841a-76d016e2f641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:59.543795 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1451/2871] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:47:59.601994 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcd528-ddc8-4e5f-9eaf-f47c4637d918 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:59.602332 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcd528-ddc8-4e5f-9eaf-f47c4637d918 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:59.602619 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbcd528-ddc8-4e5f-9eaf-f47c4637d918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:59.621466 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-8fbcd528-ddc8-4e5f-9eaf-f47c4637d918 None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:47:59.622713 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-8fbcd528-ddc8-4e5f-9eaf-f47c4637d918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:47:59.630614 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1421/2872] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:47:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:47:59.635529 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c67fe-1d56-41b8-841a-76d016e2f641 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:59.645312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c67fe-1d56-41b8-841a-76d016e2f641 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:59.649992 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82738a5a-12db-49e3-8d3e-6a7fbc17285b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:59.650675 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82738a5a-12db-49e3-8d3e-6a7fbc17285b admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:59.650962 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82738a5a-12db-49e3-8d3e-6a7fbc17285b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:59.651241 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82738a5a-12db-49e3-8d3e-6a7fbc17285b admin admin] PATH_INFO: `/v3/domains` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:59.651961 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82738a5a-12db-49e3-8d3e-6a7fbc17285b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80357) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 02:47:59.652270 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82738a5a-12db-49e3-8d3e-6a7fbc17285b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:59.653894 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82738a5a-12db-49e3-8d3e-6a7fbc17285b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:59.665218 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1452/2873] 10.222.0.64 () {58 vars in 1152 bytes} [Mon Jul 18 02:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 02:47:59.669373 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcd528-ddc8-4e5f-9eaf-f47c4637d918 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:59.674978 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:47:59.678867 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbcd528-ddc8-4e5f-9eaf-f47c4637d918 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:59.684121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05e5b0-707f-4512-aba0-d847f1996188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:59.684802 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05e5b0-707f-4512-aba0-d847f1996188 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:59.685102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05e5b0-707f-4512-aba0-d847f1996188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:59.685375 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef05e5b0-707f-4512-aba0-d847f1996188 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:59.686124 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05e5b0-707f-4512-aba0-d847f1996188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:59.688079 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef05e5b0-707f-4512-aba0-d847f1996188 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:59.775170 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1422/2874] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:47:59 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:47:59.779418 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82738a5a-12db-49e3-8d3e-6a7fbc17285b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:59.789511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82738a5a-12db-49e3-8d3e-6a7fbc17285b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:59.844565 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82324d-de8b-4989-a464-1067cf29407b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:59.845236 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82324d-de8b-4989-a464-1067cf29407b admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:59.845522 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82324d-de8b-4989-a464-1067cf29407b admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:59.845831 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82324d-de8b-4989-a464-1067cf29407b admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:59.846530 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82324d-de8b-4989-a464-1067cf29407b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:59.848445 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82324d-de8b-4989-a464-1067cf29407b admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:59.933874 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1453/2875] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:47:59 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:47:59.938183 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05e5b0-707f-4512-aba0-d847f1996188 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:59.949391 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef05e5b0-707f-4512-aba0-d847f1996188 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:59.954053 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21bf8b-7271-4243-9851-c51a2953eacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:59.954717 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21bf8b-7271-4243-9851-c51a2953eacb admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:59.955001 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21bf8b-7271-4243-9851-c51a2953eacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:59.955279 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21bf8b-7271-4243-9851-c51a2953eacb admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:59.956000 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21bf8b-7271-4243-9851-c51a2953eacb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:59.957586 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21bf8b-7271-4243-9851-c51a2953eacb admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:47:59.967383 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1423/2876] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:47:59.971233 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82324d-de8b-4989-a464-1067cf29407b admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:47:59.981762 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82324d-de8b-4989-a464-1067cf29407b admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:47:59.986289 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd133e-fd6e-4b14-9cdc-d7c8340c0685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:47:59.986948 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd133e-fd6e-4b14-9cdc-d7c8340c0685 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:47:59.987232 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd133e-fd6e-4b14-9cdc-d7c8340c0685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:47:59.987511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd133e-fd6e-4b14-9cdc-d7c8340c0685 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:47:59.988225 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd133e-fd6e-4b14-9cdc-d7c8340c0685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:47:59.989850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd133e-fd6e-4b14-9cdc-d7c8340c0685 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:00.000199 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1454/2877] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:48:00.004158 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21bf8b-7271-4243-9851-c51a2953eacb admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:00.014083 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21bf8b-7271-4243-9851-c51a2953eacb admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:00.018895 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094ed5d-391d-479e-b6cc-cfd559d70c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:00.019760 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094ed5d-391d-479e-b6cc-cfd559d70c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:00.020072 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094ed5d-391d-479e-b6cc-cfd559d70c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:00.020351 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5094ed5d-391d-479e-b6cc-cfd559d70c90 admin admin] PATH_INFO: `/v3/projects/2b00c0bd3bf04540bd974b084cb443c3/users/2455d364fc394d579d95d05fcebdf2aa/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:00.034998 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094ed5d-391d-479e-b6cc-cfd559d70c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b00c0bd3bf04540bd974b084cb443c3, user_id=2455d364fc394d579d95d05fcebdf2aa, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:00.037568 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5094ed5d-391d-479e-b6cc-cfd559d70c90 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:00.087566 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1424/2878] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:48:00 2022] PUT /identity/v3/projects/2b00c0bd3bf04540bd974b084cb443c3/users/2455d364fc394d579d95d05fcebdf2aa/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:48:00.097806 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a91a8d-cbb5-4793-a368-3c0bef25a6ec None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:00.098122 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a91a8d-cbb5-4793-a368-3c0bef25a6ec None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:00.098406 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a91a8d-cbb5-4793-a368-3c0bef25a6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:00.117101 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:00.125941 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-75a91a8d-cbb5-4793-a368-3c0bef25a6ec None None] MFA Rules not processed for user `2455d364fc394d579d95d05fcebdf2aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:48:00.128737 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-75a91a8d-cbb5-4793-a368-3c0bef25a6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:48:00.192015 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1455/2879] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:48:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:48:00.196849 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094ed5d-391d-479e-b6cc-cfd559d70c90 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:00.257691 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5094ed5d-391d-479e-b6cc-cfd559d70c90 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:00.262354 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1779f-402c-43c3-bc67-2d43c55a6bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:00.263012 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1779f-402c-43c3-bc67-2d43c55a6bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:00.263299 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1779f-402c-43c3-bc67-2d43c55a6bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:00.263579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1779f-402c-43c3-bc67-2d43c55a6bb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:00.264304 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1779f-402c-43c3-bc67-2d43c55a6bb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:00.266229 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1779f-402c-43c3-bc67-2d43c55a6bb4 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:00.351336 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1425/2880] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:48:00 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:48:00.356797 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a91a8d-cbb5-4793-a368-3c0bef25a6ec None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:00.368486 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a91a8d-cbb5-4793-a368-3c0bef25a6ec None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:00.424852 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88aabe2-fb89-41d7-8df3-620537828619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:00.425528 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aabe2-fb89-41d7-8df3-620537828619 admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:00.425874 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aabe2-fb89-41d7-8df3-620537828619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:00.426155 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88aabe2-fb89-41d7-8df3-620537828619 admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:00.426911 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88aabe2-fb89-41d7-8df3-620537828619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:00.428893 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88aabe2-fb89-41d7-8df3-620537828619 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:00.539694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1456/2881] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:48:00 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 02:48:00.544199 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1779f-402c-43c3-bc67-2d43c55a6bb4 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:00.554553 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1779f-402c-43c3-bc67-2d43c55a6bb4 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:00.559141 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00617bfa-3b38-47e3-af6c-46163a8f1009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:00.559793 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00617bfa-3b38-47e3-af6c-46163a8f1009 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:00.561359 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00617bfa-3b38-47e3-af6c-46163a8f1009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:00.561359 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00617bfa-3b38-47e3-af6c-46163a8f1009 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:00.561359 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00617bfa-3b38-47e3-af6c-46163a8f1009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:00.562678 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00617bfa-3b38-47e3-af6c-46163a8f1009 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:00.573305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1426/2882] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:48:00.577551 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88aabe2-fb89-41d7-8df3-620537828619 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:00.588148 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88aabe2-fb89-41d7-8df3-620537828619 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:00.592768 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fd8a35-11ab-4f70-a15a-d427c35cf8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:00.593418 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd8a35-11ab-4f70-a15a-d427c35cf8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:00.593723 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd8a35-11ab-4f70-a15a-d427c35cf8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:00.594004 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fd8a35-11ab-4f70-a15a-d427c35cf8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:00.594719 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd8a35-11ab-4f70-a15a-d427c35cf8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:00.596295 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fd8a35-11ab-4f70-a15a-d427c35cf8a9 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:00.606729 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1457/2883] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:48:00.610705 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00617bfa-3b38-47e3-af6c-46163a8f1009 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:00.621121 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00617bfa-3b38-47e3-af6c-46163a8f1009 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:00.625737 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5835e18-b9b2-4c3a-9a2f-1a930710b2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:00.626610 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5835e18-b9b2-4c3a-9a2f-1a930710b2db admin admin] REQUEST_METHOD: `PUT` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:00.626897 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5835e18-b9b2-4c3a-9a2f-1a930710b2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:00.627174 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5835e18-b9b2-4c3a-9a2f-1a930710b2db admin admin] PATH_INFO: `/v3/projects/f8d12089831645ce986ecbcbb2652ce2/users/5865a9aff5a1469f99fd28ac12187583/roles/7db255e54afa4cecac2d6c93da70795e` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:00.642620 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5835e18-b9b2-4c3a-9a2f-1a930710b2db admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d12089831645ce986ecbcbb2652ce2, user_id=5865a9aff5a1469f99fd28ac12187583, role_id=7db255e54afa4cecac2d6c93da70795e)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:00.645324 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5835e18-b9b2-4c3a-9a2f-1a930710b2db admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:00.745852 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1427/2884] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:48:00 2022] PUT /identity/v3/projects/f8d12089831645ce986ecbcbb2652ce2/users/5865a9aff5a1469f99fd28ac12187583/roles/7db255e54afa4cecac2d6c93da70795e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:48:00.757393 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762cced-431e-460b-9658-96d12ccbf1fa None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:00.757680 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762cced-431e-460b-9658-96d12ccbf1fa None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:00.757990 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762cced-431e-460b-9658-96d12ccbf1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:00.783918 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-a762cced-431e-460b-9658-96d12ccbf1fa None None] MFA Rules not processed for user `5865a9aff5a1469f99fd28ac12187583`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:48:00.785123 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-a762cced-431e-460b-9658-96d12ccbf1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:48:00.846925 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1458/2885] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:48:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:48:00.851414 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5835e18-b9b2-4c3a-9a2f-1a930710b2db admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:00.909534 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:00.913165 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5835e18-b9b2-4c3a-9a2f-1a930710b2db admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:00.918414 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b983174-bc1b-495a-8bf9-f4a308ac6741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:00.922421 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b983174-bc1b-495a-8bf9-f4a308ac6741 admin admin] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:00.922421 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b983174-bc1b-495a-8bf9-f4a308ac6741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:00.922421 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b983174-bc1b-495a-8bf9-f4a308ac6741 admin admin] PATH_INFO: `/v3/projects` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:00.922421 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b983174-bc1b-495a-8bf9-f4a308ac6741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:00.922421 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b983174-bc1b-495a-8bf9-f4a308ac6741 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:01.003070 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1428/2886] 10.222.0.64 () {60 vars in 1152 bytes} [Mon Jul 18 02:48:00 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:48:01.007097 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762cced-431e-460b-9658-96d12ccbf1fa None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:01.017665 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762cced-431e-460b-9658-96d12ccbf1fa None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:01.021200 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:01.075066 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e822cc-0335-4bcc-9fff-3973722fdf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:01.075773 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e822cc-0335-4bcc-9fff-3973722fdf6a admin admin] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:01.076299 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e822cc-0335-4bcc-9fff-3973722fdf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:01.076757 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e822cc-0335-4bcc-9fff-3973722fdf6a admin admin] PATH_INFO: `/v3/users` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:01.077832 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e822cc-0335-4bcc-9fff-3973722fdf6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:01.079725 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e822cc-0335-4bcc-9fff-3973722fdf6a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:01.151642 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1459/2887] 10.222.0.64 () {60 vars in 1143 bytes} [Mon Jul 18 02:48:01 2022] POST /identity/v3/users => generated 299 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 02:48:01.155725 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b983174-bc1b-495a-8bf9-f4a308ac6741 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:01.167419 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b983174-bc1b-495a-8bf9-f4a308ac6741 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:01.172211 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cebfa-1865-49fa-9ac1-fb3d72a28b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:01.181227 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cebfa-1865-49fa-9ac1-fb3d72a28b76 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:01.181227 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cebfa-1865-49fa-9ac1-fb3d72a28b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:01.181227 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3cebfa-1865-49fa-9ac1-fb3d72a28b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:01.181227 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cebfa-1865-49fa-9ac1-fb3d72a28b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:01.181227 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3cebfa-1865-49fa-9ac1-fb3d72a28b76 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:01.186573 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1429/2888] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:48:01.190761 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e822cc-0335-4bcc-9fff-3973722fdf6a admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:01.201056 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e822cc-0335-4bcc-9fff-3973722fdf6a admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:01.205759 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df03894-3fc3-48a8-93d6-1d262ced3ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:01.206639 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df03894-3fc3-48a8-93d6-1d262ced3ae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:01.206927 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df03894-3fc3-48a8-93d6-1d262ced3ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:01.207207 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df03894-3fc3-48a8-93d6-1d262ced3ae0 admin admin] PATH_INFO: `/v3/projects/e81f5c0ded494a0ca21ca1be02f11035/users/9e7c736f01854cb4afec7de4355679cb/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:01.222210 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df03894-3fc3-48a8-93d6-1d262ced3ae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e81f5c0ded494a0ca21ca1be02f11035, user_id=9e7c736f01854cb4afec7de4355679cb, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:01.224854 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df03894-3fc3-48a8-93d6-1d262ced3ae0 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:01.287893 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1460/2889] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:48:01 2022] PUT /identity/v3/projects/e81f5c0ded494a0ca21ca1be02f11035/users/9e7c736f01854cb4afec7de4355679cb/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 02:48:01.292516 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cebfa-1865-49fa-9ac1-fb3d72a28b76 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:01.302490 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3cebfa-1865-49fa-9ac1-fb3d72a28b76 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:01.358289 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28510dd9-3984-4298-aaa0-17352d0fc8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:01.358963 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28510dd9-3984-4298-aaa0-17352d0fc8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:01.359249 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28510dd9-3984-4298-aaa0-17352d0fc8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:01.359531 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28510dd9-3984-4298-aaa0-17352d0fc8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:01.360247 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28510dd9-3984-4298-aaa0-17352d0fc8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:01.361871 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28510dd9-3984-4298-aaa0-17352d0fc8d1 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:01.371590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1430/2890] 10.222.0.64 () {58 vars in 1121 bytes} [Mon Jul 18 02:48:01 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 02:48:01.375720 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df03894-3fc3-48a8-93d6-1d262ced3ae0 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:01.385677 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df03894-3fc3-48a8-93d6-1d262ced3ae0 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:01.390704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483784cb-40fe-4b0a-95b6-4ee9c9f60e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:01.391567 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483784cb-40fe-4b0a-95b6-4ee9c9f60e97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:01.391850 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483784cb-40fe-4b0a-95b6-4ee9c9f60e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:01.392123 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483784cb-40fe-4b0a-95b6-4ee9c9f60e97 admin admin] PATH_INFO: `/v3/projects/e81f5c0ded494a0ca21ca1be02f11035/users/9e7c736f01854cb4afec7de4355679cb/roles/5dfa34e7a4594751aed7c0495c9a2383` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:01.394112 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483784cb-40fe-4b0a-95b6-4ee9c9f60e97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e81f5c0ded494a0ca21ca1be02f11035, user_id=9e7c736f01854cb4afec7de4355679cb, role_id=5dfa34e7a4594751aed7c0495c9a2383)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:01.396702 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483784cb-40fe-4b0a-95b6-4ee9c9f60e97 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:01.407196 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1461/2891] 10.222.0.64 () {60 vars in 1482 bytes} [Mon Jul 18 02:48:01 2022] PUT /identity/v3/projects/e81f5c0ded494a0ca21ca1be02f11035/users/9e7c736f01854cb4afec7de4355679cb/roles/5dfa34e7a4594751aed7c0495c9a2383 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:48:01.418067 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09169090-e62d-4f13-b699-39a16f52e677 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:01.418328 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09169090-e62d-4f13-b699-39a16f52e677 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:01.418637 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09169090-e62d-4f13-b699-39a16f52e677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:01.444160 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-09169090-e62d-4f13-b699-39a16f52e677 None None] MFA Rules not processed for user `9e7c736f01854cb4afec7de4355679cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:48:01.445362 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-09169090-e62d-4f13-b699-39a16f52e677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:48:01.512772 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1431/2892] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:48:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:48:01.524908 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483784cb-40fe-4b0a-95b6-4ee9c9f60e97 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:01.526704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-483784cb-40fe-4b0a-95b6-4ee9c9f60e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:48:01.581767 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483784cb-40fe-4b0a-95b6-4ee9c9f60e97 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:01.585358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb33e51-3570-415a-bf0e-f3b5e90d8780 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:01.586031 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb33e51-3570-415a-bf0e-f3b5e90d8780 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:01.586312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb33e51-3570-415a-bf0e-f3b5e90d8780 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:01.587179 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb33e51-3570-415a-bf0e-f3b5e90d8780 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:01.641524 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb33e51-3570-415a-bf0e-f3b5e90d8780 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:01.643044 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb33e51-3570-415a-bf0e-f3b5e90d8780 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:01.652481 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1462/2893] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:48:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:48:03.599815 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09169090-e62d-4f13-b699-39a16f52e677 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:03.601275 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-09169090-e62d-4f13-b699-39a16f52e677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:48:03.613500 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09169090-e62d-4f13-b699-39a16f52e677 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:03.617076 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3f77b-12c0-4fe0-8a54-a2523c4a6b97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:03.618272 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3f77b-12c0-4fe0-8a54-a2523c4a6b97 service cinder] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:03.618559 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3f77b-12c0-4fe0-8a54-a2523c4a6b97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:03.618839 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3f77b-12c0-4fe0-8a54-a2523c4a6b97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:03.666455 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:03.675112 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3f77b-12c0-4fe0-8a54-a2523c4a6b97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:03.676549 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3f77b-12c0-4fe0-8a54-a2523c4a6b97 service cinder] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:03.686102 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1432/2894] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:48:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:48:05.076175 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb33e51-3570-415a-bf0e-f3b5e90d8780 service cinder] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:05.084843 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb33e51-3570-415a-bf0e-f3b5e90d8780 service cinder] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:05.088444 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b8139-f2c8-44de-b0bc-ce4ebabcd737 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdb0a04d568e4b14b07cd6d6092bc49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:05.089129 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b8139-f2c8-44de-b0bc-ce4ebabcd737 service cinder] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:05.089416 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b8139-f2c8-44de-b0bc-ce4ebabcd737 service cinder] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:05.089695 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b8139-f2c8-44de-b0bc-ce4ebabcd737 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:05.098570 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b8139-f2c8-44de-b0bc-ce4ebabcd737 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:05.099986 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b8139-f2c8-44de-b0bc-ce4ebabcd737 service cinder] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:05.104851 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:05.109596 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1463/2895] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:48:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:48:09.642244 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3f77b-12c0-4fe0-8a54-a2523c4a6b97 service cinder] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:09.707666 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3f77b-12c0-4fe0-8a54-a2523c4a6b97 service cinder] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:09.712461 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d2346-c2f6-4726-bedd-167b72618a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:09.713981 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d2346-c2f6-4726-bedd-167b72618a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:09.714297 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d2346-c2f6-4726-bedd-167b72618a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:09.714579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760d2346-c2f6-4726-bedd-167b72618a37 admin admin] PATH_INFO: `/v3/users/2455d364fc394d579d95d05fcebdf2aa` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:09.715809 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d2346-c2f6-4726-bedd-167b72618a37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2455d364fc394d579d95d05fcebdf2aa)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:09.717787 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760d2346-c2f6-4726-bedd-167b72618a37 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:09.890314 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-760d2346-c2f6-4726-bedd-167b72618a37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2455d364fc394d579d95d05fcebdf2aa'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:09.891002 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-760d2346-c2f6-4726-bedd-167b72618a37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2455d364fc394d579d95d05fcebdf2aa'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:09.891664 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-760d2346-c2f6-4726-bedd-167b72618a37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2455d364fc394d579d95d05fcebdf2aa'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:09.904567 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-760d2346-c2f6-4726-bedd-167b72618a37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2455d364fc394d579d95d05fcebdf2aa'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:09.990521 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-760d2346-c2f6-4726-bedd-167b72618a37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2455d364fc394d579d95d05fcebdf2aa'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:10.003343 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1433/2896] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:48:09 2022] DELETE /identity/v3/users/2455d364fc394d579d95d05fcebdf2aa => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:48:10.007989 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33113e9f-0507-459d-9ab6-398888b4068d None None] REQUEST_METHOD: `POST` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:10.008471 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33113e9f-0507-459d-9ab6-398888b4068d None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:10.008582 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33113e9f-0507-459d-9ab6-398888b4068d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:10.026016 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.auth.core [None req-33113e9f-0507-459d-9ab6-398888b4068d None None] MFA Rules not processed for user `66adc49d0e444db3bd259768a9d10521`. Rule list: `[]` (Enabled: `True`). {{(pid=80357) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:48:10.027815 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-33113e9f-0507-459d-9ab6-398888b4068d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:48:10.085667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1464/2897] 10.222.0.64 () {58 vars in 957 bytes} [Mon Jul 18 02:48:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 02:48:10.095399 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d2346-c2f6-4726-bedd-167b72618a37 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:10.096842 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-760d2346-c2f6-4726-bedd-167b72618a37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:48:10.155033 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760d2346-c2f6-4726-bedd-167b72618a37 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:10.158749 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1266970-3ea2-4ac0-8b8e-42b325bfbe12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:10.159403 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1266970-3ea2-4ac0-8b8e-42b325bfbe12 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:10.159692 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1266970-3ea2-4ac0-8b8e-42b325bfbe12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:10.159976 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1266970-3ea2-4ac0-8b8e-42b325bfbe12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:10.168957 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1266970-3ea2-4ac0-8b8e-42b325bfbe12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:10.170433 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1266970-3ea2-4ac0-8b8e-42b325bfbe12 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:10.180047 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1434/2898] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:48:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:48:10.570236 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33113e9f-0507-459d-9ab6-398888b4068d None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:10.572229 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-33113e9f-0507-459d-9ab6-398888b4068d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:48:10.587979 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33113e9f-0507-459d-9ab6-398888b4068d None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:10.593010 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdffe5-b708-4d9a-b7d5-952a57db0c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:10.593966 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdffe5-b708-4d9a-b7d5-952a57db0c45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:10.594207 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdffe5-b708-4d9a-b7d5-952a57db0c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:10.594484 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bdffe5-b708-4d9a-b7d5-952a57db0c45 admin admin] PATH_INFO: `/v3/projects/2b00c0bd3bf04540bd974b084cb443c3` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:10.595694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bdffe5-b708-4d9a-b7d5-952a57db0c45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b00c0bd3bf04540bd974b084cb443c3)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:10.597620 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bdffe5-b708-4d9a-b7d5-952a57db0c45 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:10.705136 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-27bdffe5-b708-4d9a-b7d5-952a57db0c45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b00c0bd3bf04540bd974b084cb443c3', 'request_id': 'req-27bdffe5-b708-4d9a-b7d5-952a57db0c45'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:10.710613 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-27bdffe5-b708-4d9a-b7d5-952a57db0c45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b00c0bd3bf04540bd974b084cb443c3', 'request_id': 'req-27bdffe5-b708-4d9a-b7d5-952a57db0c45'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:10.717089 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-27bdffe5-b708-4d9a-b7d5-952a57db0c45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b00c0bd3bf04540bd974b084cb443c3', 'request_id': 'req-27bdffe5-b708-4d9a-b7d5-952a57db0c45'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:10.796068 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-27bdffe5-b708-4d9a-b7d5-952a57db0c45 admin admin] The token cache is being invalidate because project 2b00c0bd3bf04540bd974b084cb443c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:48:10.796358 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-27bdffe5-b708-4d9a-b7d5-952a57db0c45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:10.797026 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-27bdffe5-b708-4d9a-b7d5-952a57db0c45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:10.798604 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1465/2899] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:48:10 2022] DELETE /identity/v3/projects/2b00c0bd3bf04540bd974b084cb443c3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:48:10.802639 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1266970-3ea2-4ac0-8b8e-42b325bfbe12 service neutron] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:10.812309 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1266970-3ea2-4ac0-8b8e-42b325bfbe12 service neutron] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:10.821358 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:10.869484 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4be01-01fd-49a4-b6fb-d412db4676c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:10.870407 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4be01-01fd-49a4-b6fb-d412db4676c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:10.871357 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4be01-01fd-49a4-b6fb-d412db4676c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:10.871357 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4be01-01fd-49a4-b6fb-d412db4676c7 admin admin] PATH_INFO: `/v3/users/5865a9aff5a1469f99fd28ac12187583` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:10.872162 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4be01-01fd-49a4-b6fb-d412db4676c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5865a9aff5a1469f99fd28ac12187583)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:10.874135 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4be01-01fd-49a4-b6fb-d412db4676c7 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:11.050689 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-73e4be01-01fd-49a4-b6fb-d412db4676c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5865a9aff5a1469f99fd28ac12187583'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:11.051334 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-73e4be01-01fd-49a4-b6fb-d412db4676c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5865a9aff5a1469f99fd28ac12187583'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:11.051937 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-73e4be01-01fd-49a4-b6fb-d412db4676c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5865a9aff5a1469f99fd28ac12187583'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:11.063627 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-73e4be01-01fd-49a4-b6fb-d412db4676c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5865a9aff5a1469f99fd28ac12187583'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:11.139305 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-73e4be01-01fd-49a4-b6fb-d412db4676c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5865a9aff5a1469f99fd28ac12187583'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:11.152953 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1435/2900] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:48:10 2022] DELETE /identity/v3/users/5865a9aff5a1469f99fd28ac12187583 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:48:11.609736 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdffe5-b708-4d9a-b7d5-952a57db0c45 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:11.611275 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-27bdffe5-b708-4d9a-b7d5-952a57db0c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:48:11.625336 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bdffe5-b708-4d9a-b7d5-952a57db0c45 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:11.683493 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb783b49-ce03-4b14-b571-b725d1402160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:11.684443 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb783b49-ce03-4b14-b571-b725d1402160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:11.685253 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb783b49-ce03-4b14-b571-b725d1402160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:11.685531 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb783b49-ce03-4b14-b571-b725d1402160 admin admin] PATH_INFO: `/v3/projects/f8d12089831645ce986ecbcbb2652ce2` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:11.686767 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb783b49-ce03-4b14-b571-b725d1402160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8d12089831645ce986ecbcbb2652ce2)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:11.688715 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb783b49-ce03-4b14-b571-b725d1402160 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:11.763800 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:11.779667 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-eb783b49-ce03-4b14-b571-b725d1402160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8d12089831645ce986ecbcbb2652ce2', 'request_id': 'req-eb783b49-ce03-4b14-b571-b725d1402160'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:11.785240 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-eb783b49-ce03-4b14-b571-b725d1402160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8d12089831645ce986ecbcbb2652ce2', 'request_id': 'req-eb783b49-ce03-4b14-b571-b725d1402160'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:11.791348 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-eb783b49-ce03-4b14-b571-b725d1402160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8d12089831645ce986ecbcbb2652ce2', 'request_id': 'req-eb783b49-ce03-4b14-b571-b725d1402160'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:11.858449 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-eb783b49-ce03-4b14-b571-b725d1402160 admin admin] The token cache is being invalidate because project f8d12089831645ce986ecbcbb2652ce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:48:11.858739 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-eb783b49-ce03-4b14-b571-b725d1402160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:11.859389 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-eb783b49-ce03-4b14-b571-b725d1402160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:11.860930 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1466/2901] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:48:11 2022] DELETE /identity/v3/projects/f8d12089831645ce986ecbcbb2652ce2 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:48:11.865177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4be01-01fd-49a4-b6fb-d412db4676c7 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:11.866575 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-73e4be01-01fd-49a4-b6fb-d412db4676c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:48:11.880081 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4be01-01fd-49a4-b6fb-d412db4676c7 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:11.936313 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3903652-1cee-40b5-ae87-b82d8c3f3c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:11.937177 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3903652-1cee-40b5-ae87-b82d8c3f3c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:11.937456 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3903652-1cee-40b5-ae87-b82d8c3f3c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:11.937754 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3903652-1cee-40b5-ae87-b82d8c3f3c92 admin admin] PATH_INFO: `/v3/users/9e7c736f01854cb4afec7de4355679cb` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:11.938930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3903652-1cee-40b5-ae87-b82d8c3f3c92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e7c736f01854cb4afec7de4355679cb)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:11.940837 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3903652-1cee-40b5-ae87-b82d8c3f3c92 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:12.128037 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:12.137050 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e3903652-1cee-40b5-ae87-b82d8c3f3c92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e7c736f01854cb4afec7de4355679cb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:12.137882 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e3903652-1cee-40b5-ae87-b82d8c3f3c92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e7c736f01854cb4afec7de4355679cb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:12.138485 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e3903652-1cee-40b5-ae87-b82d8c3f3c92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e7c736f01854cb4afec7de4355679cb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:12.150395 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e3903652-1cee-40b5-ae87-b82d8c3f3c92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e7c736f01854cb4afec7de4355679cb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:12.236265 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-e3903652-1cee-40b5-ae87-b82d8c3f3c92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e7c736f01854cb4afec7de4355679cb'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:12.249598 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1436/2902] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:48:11 2022] DELETE /identity/v3/users/9e7c736f01854cb4afec7de4355679cb => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:48:12.684404 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb783b49-ce03-4b14-b571-b725d1402160 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:12.686142 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-eb783b49-ce03-4b14-b571-b725d1402160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:48:12.699007 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb783b49-ce03-4b14-b571-b725d1402160 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:12.756178 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8560291e-f9f4-4f4e-a129-986843d3f696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:12.757051 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560291e-f9f4-4f4e-a129-986843d3f696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:12.757330 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560291e-f9f4-4f4e-a129-986843d3f696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:12.757611 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8560291e-f9f4-4f4e-a129-986843d3f696 admin admin] PATH_INFO: `/v3/projects/e81f5c0ded494a0ca21ca1be02f11035` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:12.758826 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560291e-f9f4-4f4e-a129-986843d3f696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e81f5c0ded494a0ca21ca1be02f11035)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:12.760803 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8560291e-f9f4-4f4e-a129-986843d3f696 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:12.870633 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8560291e-f9f4-4f4e-a129-986843d3f696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e81f5c0ded494a0ca21ca1be02f11035', 'request_id': 'req-8560291e-f9f4-4f4e-a129-986843d3f696'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:12.876162 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8560291e-f9f4-4f4e-a129-986843d3f696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e81f5c0ded494a0ca21ca1be02f11035', 'request_id': 'req-8560291e-f9f4-4f4e-a129-986843d3f696'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:12.882312 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8560291e-f9f4-4f4e-a129-986843d3f696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e81f5c0ded494a0ca21ca1be02f11035', 'request_id': 'req-8560291e-f9f4-4f4e-a129-986843d3f696'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:12.961270 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8560291e-f9f4-4f4e-a129-986843d3f696 admin admin] The token cache is being invalidate because project e81f5c0ded494a0ca21ca1be02f11035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80357) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:48:12.961492 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8560291e-f9f4-4f4e-a129-986843d3f696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:12.962145 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-8560291e-f9f4-4f4e-a129-986843d3f696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:48:12.963841 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1467/2903] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:48:12 2022] DELETE /identity/v3/projects/e81f5c0ded494a0ca21ca1be02f11035 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:48:22.344930 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:22.958096 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:DELETE=13,keystone:SELECT=65,keystone:INSERT=2 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:40.095590 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3903652-1cee-40b5-ae87-b82d8c3f3c92 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:40.097129 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e3903652-1cee-40b5-ae87-b82d8c3f3c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:48:40.162116 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3903652-1cee-40b5-ae87-b82d8c3f3c92 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:40.211482 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab15367-24eb-4a31-8e83-8d2c5c430ee2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:40.212137 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab15367-24eb-4a31-8e83-8d2c5c430ee2 service neutron] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:40.212429 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab15367-24eb-4a31-8e83-8d2c5c430ee2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:40.212709 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab15367-24eb-4a31-8e83-8d2c5c430ee2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:40.214536 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-aab15367-24eb-4a31-8e83-8d2c5c430ee2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:48:40.224257 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab15367-24eb-4a31-8e83-8d2c5c430ee2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:40.225677 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab15367-24eb-4a31-8e83-8d2c5c430ee2 service neutron] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:40.234090 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1437/2904] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:48:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:48:41.316328 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19007d83-0564-4be4-ae29-ae169dda71f4 None None] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:41.317081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19007d83-0564-4be4-ae29-ae169dda71f4 None None] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:41.317081 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19007d83-0564-4be4-ae29-ae169dda71f4 None None] PATH_INFO: `/` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:41.318704 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1468/2905] 10.222.0.64 () {54 vars in 921 bytes} [Mon Jul 18 02:48:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 02:48:41.324384 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223ea29-8aa1-4be1-b968-1471b000ad69 None None] REQUEST_METHOD: `POST` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:41.324867 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223ea29-8aa1-4be1-b968-1471b000ad69 None None] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:41.325114 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f223ea29-8aa1-4be1-b968-1471b000ad69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:41.373185 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.auth.core [None req-f223ea29-8aa1-4be1-b968-1471b000ad69 None None] MFA Rules not processed for user `6f51aae36f0b42868567840fa957ffe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80358) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 02:48:41.375114 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f223ea29-8aa1-4be1-b968-1471b000ad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:48:41.440044 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1438/2906] 10.222.0.64 () {58 vars in 1018 bytes} [Mon Jul 18 02:48:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 02:48:41.450913 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19007d83-0564-4be4-ae29-ae169dda71f4 None None] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:41.452585 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-19007d83-0564-4be4-ae29-ae169dda71f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:48:41.465571 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19007d83-0564-4be4-ae29-ae169dda71f4 None None] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:41.469573 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4db4a-f66e-4a1f-8bae-dfcaaf84c556 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa9e6d3fe3e740e6aedab33d727ec478', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:41.470237 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4db4a-f66e-4a1f-8bae-dfcaaf84c556 service neutron] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:41.470517 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4db4a-f66e-4a1f-8bae-dfcaaf84c556 service neutron] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:41.470793 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e4db4a-f66e-4a1f-8bae-dfcaaf84c556 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:41.480858 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4db4a-f66e-4a1f-8bae-dfcaaf84c556 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:41.482398 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e4db4a-f66e-4a1f-8bae-dfcaaf84c556 service neutron] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:41.493665 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1469/2907] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:48:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:48:41.553357 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223ea29-8aa1-4be1-b968-1471b000ad69 None None] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:41.554828 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-f223ea29-8aa1-4be1-b968-1471b000ad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:48:41.586777 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=100 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:41.623595 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f223ea29-8aa1-4be1-b968-1471b000ad69 None None] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:41.628514 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c32a82-f4de-4963-82b1-45812d290a81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '213ba948a3f34c39bce3f6db093479eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:41.629153 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c32a82-f4de-4963-82b1-45812d290a81 service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:41.629465 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c32a82-f4de-4963-82b1-45812d290a81 service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:41.629765 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c32a82-f4de-4963-82b1-45812d290a81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:41.631487 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-91c32a82-f4de-4963-82b1-45812d290a81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:48:41.642860 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c32a82-f4de-4963-82b1-45812d290a81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:41.644453 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c32a82-f4de-4963-82b1-45812d290a81 service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:41.654237 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1439/2908] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:48:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:48:41.811753 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4db4a-f66e-4a1f-8bae-dfcaaf84c556 service neutron] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:48:41.814799 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-39e4db4a-f66e-4a1f-8bae-dfcaaf84c556 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:48:41.828530 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e4db4a-f66e-4a1f-8bae-dfcaaf84c556 service neutron] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:48:41.834189 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bc4ab-fc4d-42e4-868a-f01034d3a67e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:48:41.834842 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bc4ab-fc4d-42e4-868a-f01034d3a67e service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:48:41.835123 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bc4ab-fc4d-42e4-868a-f01034d3a67e service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:48:41.835399 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0bc4ab-fc4d-42e4-868a-f01034d3a67e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:48:41.837384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-9f0bc4ab-fc4d-42e4-868a-f01034d3a67e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:48:41.851314 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0bc4ab-fc4d-42e4-868a-f01034d3a67e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:48:41.852834 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0bc4ab-fc4d-42e4-868a-f01034d3a67e service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:48:41.863847 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1470/2909] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:48:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:48:51.650022 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=19 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:48:51.859862 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=12 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:49:55.124031 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c32a82-f4de-4963-82b1-45812d290a81 service placement] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:49:55.125449 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-91c32a82-f4de-4963-82b1-45812d290a81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:49:55.139178 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c32a82-f4de-4963-82b1-45812d290a81 service placement] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:49:55.144669 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f0029-1f0d-4ec6-9af6-ccc27a1720f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '213ba948a3f34c39bce3f6db093479eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:49:55.145325 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f0029-1f0d-4ec6-9af6-ccc27a1720f8 service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:49:55.145658 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f0029-1f0d-4ec6-9af6-ccc27a1720f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:49:55.146099 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f0029-1f0d-4ec6-9af6-ccc27a1720f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:49:55.148544 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-844f0029-1f0d-4ec6-9af6-ccc27a1720f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:49:55.160411 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f0029-1f0d-4ec6-9af6-ccc27a1720f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:49:55.162071 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f0029-1f0d-4ec6-9af6-ccc27a1720f8 service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:49:55.174147 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1440/2910] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:49:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:50:05.168923 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=6 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:08.422694 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bc4ab-fc4d-42e4-868a-f01034d3a67e service nova] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:50:08.431817 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0bc4ab-fc4d-42e4-868a-f01034d3a67e service nova] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:50:08.440743 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a06a89-9d60-4b0b-84ab-10b49ed5fbb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f51aae36f0b42868567840fa957ffe9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:50:08.441406 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a06a89-9d60-4b0b-84ab-10b49ed5fbb4 service nova] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:50:08.441696 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a06a89-9d60-4b0b-84ab-10b49ed5fbb4 service nova] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:50:08.442262 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a06a89-9d60-4b0b-84ab-10b49ed5fbb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:50:08.444254 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-30a06a89-9d60-4b0b-84ab-10b49ed5fbb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:50:08.457119 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a06a89-9d60-4b0b-84ab-10b49ed5fbb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:50:08.458754 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a06a89-9d60-4b0b-84ab-10b49ed5fbb4 service nova] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:50:08.470885 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1471/2911] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:50:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:50:17.104741 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f0029-1f0d-4ec6-9af6-ccc27a1720f8 service placement] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:50:17.115370 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f0029-1f0d-4ec6-9af6-ccc27a1720f8 service placement] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:50:17.121093 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9759e08-808e-434d-827a-5af14cfeab6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '213ba948a3f34c39bce3f6db093479eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:50:17.121807 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9759e08-808e-434d-827a-5af14cfeab6a service placement] REQUEST_METHOD: `GET` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:50:17.122054 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9759e08-808e-434d-827a-5af14cfeab6a service placement] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:50:17.122357 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9759e08-808e-434d-827a-5af14cfeab6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:50:17.124156 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-e9759e08-808e-434d-827a-5af14cfeab6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:50:17.137626 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9759e08-808e-434d-827a-5af14cfeab6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:50:17.139272 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9759e08-808e-434d-827a-5af14cfeab6a service placement] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:50:17.150394 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1441/2912] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:50:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 02:50:18.466741 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=6 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:20.748563 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a06a89-9d60-4b0b-84ab-10b49ed5fbb4 service nova] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:50:20.750148 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-30a06a89-9d60-4b0b-84ab-10b49ed5fbb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:50:20.817511 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a06a89-9d60-4b0b-84ab-10b49ed5fbb4 service nova] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:50:20.822275 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521507d-12f1-4965-9461-a428bb78a147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:50:20.823153 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521507d-12f1-4965-9461-a428bb78a147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:50:20.823444 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521507d-12f1-4965-9461-a428bb78a147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:50:20.823725 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521507d-12f1-4965-9461-a428bb78a147 admin admin] PATH_INFO: `/v3/users/ce69ea470ab64af082e96ffd29934dab` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:50:20.824916 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521507d-12f1-4965-9461-a428bb78a147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce69ea470ab64af082e96ffd29934dab)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:50:20.826972 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0521507d-12f1-4965-9461-a428bb78a147 admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:50:20.966017 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0521507d-12f1-4965-9461-a428bb78a147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce69ea470ab64af082e96ffd29934dab'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:50:20.966604 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0521507d-12f1-4965-9461-a428bb78a147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce69ea470ab64af082e96ffd29934dab'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:50:20.967217 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0521507d-12f1-4965-9461-a428bb78a147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce69ea470ab64af082e96ffd29934dab'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:50:20.979416 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0521507d-12f1-4965-9461-a428bb78a147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce69ea470ab64af082e96ffd29934dab'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:50:20.986435 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-0521507d-12f1-4965-9461-a428bb78a147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce69ea470ab64af082e96ffd29934dab'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:50:21.060727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1472/2913] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:50:20 2022] DELETE /identity/v3/users/ce69ea470ab64af082e96ffd29934dab => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:50:21.297224 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9759e08-808e-434d-827a-5af14cfeab6a service placement] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:50:21.313095 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9759e08-808e-434d-827a-5af14cfeab6a service placement] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:50:21.369579 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384fb8e-eef2-41be-97bd-edff4ef0f369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:50:21.370468 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384fb8e-eef2-41be-97bd-edff4ef0f369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:50:21.370753 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384fb8e-eef2-41be-97bd-edff4ef0f369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:50:21.371030 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384fb8e-eef2-41be-97bd-edff4ef0f369 admin admin] PATH_INFO: `/v3/projects/6aa8569ef61543bab87b0c54e0850f15` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:50:21.372198 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384fb8e-eef2-41be-97bd-edff4ef0f369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa8569ef61543bab87b0c54e0850f15)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:50:21.374134 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384fb8e-eef2-41be-97bd-edff4ef0f369 admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:50:21.481440 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0384fb8e-eef2-41be-97bd-edff4ef0f369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa8569ef61543bab87b0c54e0850f15', 'request_id': 'req-0384fb8e-eef2-41be-97bd-edff4ef0f369'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:50:21.489355 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0384fb8e-eef2-41be-97bd-edff4ef0f369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa8569ef61543bab87b0c54e0850f15', 'request_id': 'req-0384fb8e-eef2-41be-97bd-edff4ef0f369'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:50:21.498737 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0384fb8e-eef2-41be-97bd-edff4ef0f369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa8569ef61543bab87b0c54e0850f15', 'request_id': 'req-0384fb8e-eef2-41be-97bd-edff4ef0f369'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:50:21.569683 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0384fb8e-eef2-41be-97bd-edff4ef0f369 admin admin] The token cache is being invalidate because project 6aa8569ef61543bab87b0c54e0850f15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:50:21.569998 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0384fb8e-eef2-41be-97bd-edff4ef0f369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:50:21.570636 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-0384fb8e-eef2-41be-97bd-edff4ef0f369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:50:21.572685 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1442/2914] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:50:21 2022] DELETE /identity/v3/projects/6aa8569ef61543bab87b0c54e0850f15 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:50:21.576722 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521507d-12f1-4965-9461-a428bb78a147 admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:50:21.578184 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-0521507d-12f1-4965-9461-a428bb78a147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:50:21.592293 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521507d-12f1-4965-9461-a428bb78a147 admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:50:21.649100 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cca23-9dd2-4f7d-8add-554c012a030a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:50:21.650086 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cca23-9dd2-4f7d-8add-554c012a030a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:50:21.650370 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cca23-9dd2-4f7d-8add-554c012a030a admin admin] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:50:21.650645 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cca23-9dd2-4f7d-8add-554c012a030a admin admin] PATH_INFO: `/v3/users/e369434cc4f6451ea32a4f0d0d12140f` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:50:21.651839 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9cca23-9dd2-4f7d-8add-554c012a030a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e369434cc4f6451ea32a4f0d0d12140f)` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:50:21.653913 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9cca23-9dd2-4f7d-8add-554c012a030a admin admin] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:50:21.675104 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:21.843840 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ad9cca23-9dd2-4f7d-8add-554c012a030a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e369434cc4f6451ea32a4f0d0d12140f'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:50:21.844770 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ad9cca23-9dd2-4f7d-8add-554c012a030a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e369434cc4f6451ea32a4f0d0d12140f'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:50:21.845520 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ad9cca23-9dd2-4f7d-8add-554c012a030a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e369434cc4f6451ea32a4f0d0d12140f'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:50:21.859825 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ad9cca23-9dd2-4f7d-8add-554c012a030a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e369434cc4f6451ea32a4f0d0d12140f'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:50:21.867048 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.notifications [None req-ad9cca23-9dd2-4f7d-8add-554c012a030a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e369434cc4f6451ea32a4f0d0d12140f'} {{(pid=80357) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:50:21.969905 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1473/2915] 10.222.0.64 () {58 vars in 1223 bytes} [Mon Jul 18 02:50:21 2022] DELETE /identity/v3/users/e369434cc4f6451ea32a4f0d0d12140f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:50:22.223552 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384fb8e-eef2-41be-97bd-edff4ef0f369 admin admin] Authenticating user token {{(pid=80358) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:50:22.225093 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.fernet_utils [None req-0384fb8e-eef2-41be-97bd-edff4ef0f369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80358) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:50:22.241207 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384fb8e-eef2-41be-97bd-edff4ef0f369 admin admin] Validating token access rules against request {{(pid=80358) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:50:22.299563 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27c0f7-14db-4d64-b1ee-6d5d2df1701d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66adc49d0e444db3bd259768a9d10521', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '588ca26de9454c75b0a1f50762b8b0a2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80358) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:50:22.300436 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27c0f7-14db-4d64-b1ee-6d5d2df1701d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:50:22.300727 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27c0f7-14db-4d64-b1ee-6d5d2df1701d admin admin] SCRIPT_NAME: `/identity` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:50:22.300999 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27c0f7-14db-4d64-b1ee-6d5d2df1701d admin admin] PATH_INFO: `/v3/projects/8d0d9f4534bd447ba9753e920f49ca2b` {{(pid=80358) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:50:22.302226 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27c0f7-14db-4d64-b1ee-6d5d2df1701d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d0d9f4534bd447ba9753e920f49ca2b)` {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:50:22.304203 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27c0f7-14db-4d64-b1ee-6d5d2df1701d admin admin] RBAC: Authorization granted {{(pid=80358) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:50:22.326021 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:22.398211 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-aa27c0f7-14db-4d64-b1ee-6d5d2df1701d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d0d9f4534bd447ba9753e920f49ca2b', 'request_id': 'req-aa27c0f7-14db-4d64-b1ee-6d5d2df1701d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:50:22.404212 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-aa27c0f7-14db-4d64-b1ee-6d5d2df1701d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d0d9f4534bd447ba9753e920f49ca2b', 'request_id': 'req-aa27c0f7-14db-4d64-b1ee-6d5d2df1701d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:50:22.410390 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-aa27c0f7-14db-4d64-b1ee-6d5d2df1701d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d0d9f4534bd447ba9753e920f49ca2b', 'request_id': 'req-aa27c0f7-14db-4d64-b1ee-6d5d2df1701d'} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:50:22.501163 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-aa27c0f7-14db-4d64-b1ee-6d5d2df1701d admin admin] The token cache is being invalidate because project 8d0d9f4534bd447ba9753e920f49ca2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80358) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 02:50:22.501441 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-aa27c0f7-14db-4d64-b1ee-6d5d2df1701d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:50:22.502108 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG keystone.notifications [None req-aa27c0f7-14db-4d64-b1ee-6d5d2df1701d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80358) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 02:50:22.503707 dv-cinder-850015-3-smb devstack@keystone.service[80358]: [pid: 80358|app: 0|req: 1443/2916] 10.222.0.64 () {58 vars in 1232 bytes} [Mon Jul 18 02:50:22 2022] DELETE /identity/v3/projects/8d0d9f4534bd447ba9753e920f49ca2b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 02:50:31.975597 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:50:32.497538 dv-cinder-850015-3-smb devstack@keystone.service[80358]: DEBUG dbcounter [-] [80358] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80358) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 02:54:59.046824 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cca23-9dd2-4f7d-8add-554c012a030a admin admin] Authenticating user token {{(pid=80357) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 02:54:59.048238 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-ad9cca23-9dd2-4f7d-8add-554c012a030a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:54:59.191565 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cca23-9dd2-4f7d-8add-554c012a030a admin admin] Validating token access rules against request {{(pid=80357) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 02:54:59.248731 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da010bdf-49e1-48ae-9809-bdf485b3772c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '213ba948a3f34c39bce3f6db093479eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1f6f840feba049ee9eeaf7bf0b300730', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80357) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 02:54:59.249384 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da010bdf-49e1-48ae-9809-bdf485b3772c service placement] REQUEST_METHOD: `GET` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 02:54:59.249671 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da010bdf-49e1-48ae-9809-bdf485b3772c service placement] SCRIPT_NAME: `/identity` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 02:54:59.249977 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da010bdf-49e1-48ae-9809-bdf485b3772c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80357) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 02:54:59.251727 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.fernet_utils [None req-da010bdf-49e1-48ae-9809-bdf485b3772c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80357) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 02:54:59.263251 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da010bdf-49e1-48ae-9809-bdf485b3772c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 02:54:59.264822 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da010bdf-49e1-48ae-9809-bdf485b3772c service placement] RBAC: Authorization granted {{(pid=80357) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 02:54:59.275158 dv-cinder-850015-3-smb devstack@keystone.service[80357]: [pid: 80357|app: 0|req: 1474/2917] 10.222.0.64 () {60 vars in 1365 bytes} [Mon Jul 18 02:54:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 02:55:09.270397 dv-cinder-850015-3-smb devstack@keystone.service[80357]: DEBUG dbcounter [-] [80357] Writing DB stats keystone:SELECT=89 {{(pid=80357) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}